Effect of Web-Based Versus Paper-Based Questionnaires and Follow-Up Strategies on Participation Rates of Dutch Childhood Cancer Survivors: A Randomized Controlled Trial

Abstract

BackgroundQuestionnaires are widely used in survey research, especially in cohort studies. However, participation in questionnaire studies has been declining over the past decades. Because high participation rates are needed to limit the risk of selection bias and produce valid results, it is important to investigate invitation strategies which may improve participation.ObjectivesThe purpose of this study is to investigate the effect of Web-based versus paper-based questionnaires on participation rates in a questionnaire survey on late effects among childhood cancer survivors (CCSs).MethodsA total of 750 CCSs were randomized across 3 study arms. The initial invitation in study arms 1 and 2 consisted of a Web-based questionnaire only, whereas in study arm 3 this invitation was complemented with a paper-based version of the questionnaire. The first postal reminder, sent to the nonresponding CCSs in all 3 study arms, consisted of either a reminder letter only (study arms 1 and 3) or a reminder letter complemented with a paper-based questionnaire (study arm 2). The second postal reminder was restricted to CCSs in study arms 1 and 2, with only those in study arm 1 also receiving a paper-based questionnaire. CCSs in study arm 3 received a second reminder by telephone instead of by mail. In contrast to CCSs in study arm 3, CCSs in study arms 1 and 2 received a third reminder, this time by telephone.Results: Overall, 58.1% (436/750) of the CCSs participated in the survey. Participation rates were equal in all 3 study arms with 57.4% (143/249) in arm 1, 60.6% (152/251) in arm 2, and 56.4% (141/250) in arm 3 (P=.09). Participation rates of CCSs who received an initial invitation for the Web-based questionnaire only and CCSs who received an invitation to complete either a paper-based or Web-based questionnaire did not differ (P=.55). After the first postal reminder, participation rates of CCSs invited for the Web-based questionnaire only also did not differ compared with CCSs invited for both the Web-based and paper-based questionnaires (P=.48). In general, CCSs preferred the paper-based over the Web-based questionnaire, and those completing the paper-based questionnaire were more often unemployed (P=.004) and lower educated (P<.001).ConclusionInvitation strategies offering a Web-based questionnaire without a paper-based alternative at first invitation can be used without compromising participation rates of CCS. Offering the choice between paper- and Web-based questionnaires seems to result in the highest accrual participation rate. Future research should look into the quality of the data delivered by both questionnaires filled in by respondents themselves.Trial RegistrationInternational Standard Randomized Controlled Trial Number (ISRCTN): 84711754; http://www.controlled-trials.com/ISRCTN84711754 (Archived by WebCite at http://www.webcitation.org/6c9ZB8paX)

Heeding the psychological concerns of young cancer survivors: a single-arm feasibility trial of CBT and a cognitive behavioral conceptualization of distress

“…Another notable finding was that 98 (47%) of potential participants were provided with study information via post, as opposed to the telephone, due to incorrect or non-identifiable contact details. This concurs with earlier studies on adult survivors of childhood cancer observing recruitment difficulties due to incorrect contact information (Kilsdonk et al, 2015). As many AYAs undergo transitions in housing, employment, and education, which may cause potential changes in preferred contact methods (Barnett et al, 2016), a wider approach including social media and internet-based methods may be more appropriate.…”

Optimizing follow-up and study retention in the 21st century: Advances from the front line in alcohol and tobacco research

“…Unfortunately, it is often difficult to forecast at the outset of longitudinal research which participants will be difficult to track over time and ruling out such persons might compromise the integrity of recruitment (Kipke et al, 1997; Plane and Jurjevich, 2009; Solorio et al, 2008). Thus, modification of a follow-up protocol for challenging participants can provide necessary flexibility (Kilsdonk et al, 2015). These modifications can include a waiting period before reinitiating contact attempts or having participants elect a one-time “opt out” of a follow-up wave, as we used in our CSDP study, but have only needed to apply in < 0.004% of all follow-ups thus far.…”

The feasibility of web surveys for obtaining patient-reported outcomes from cancer survivors: a randomized experiment comparing survey modes and brochure enclosures

“…There is some evidence that this approach may even be more effective than paper-only in certain populations who are accustomed to receiving similar communications from the surveyor via email [68]. Further, in a study of Dutch childhood cancer survivors, various strategies of offering a paper-based alternative to a web survey produced similar response rates [69]. Thus, using a paper follow-up response option to a web survey administered by a cancer registry may be an effective approach to obtain responses from those reluctant to respond to a web survey.…”