Participant Recruitment and Retention in Remote eHealth Intervention Trials: Methods and Lessons Learned From a Large Randomized Controlled Trial of Two Web-Based Smoking Interventions

Abstract

BackgroundDespite having many advantages, online eHealth trials are not without challenges—notably, participant recruitment, and outcome data retention. Moreover, publications from these trials rarely provide detailed information on the methods used for recruitment and retention or discuss implications of the methods for future studies.ObjectiveTo address this need for empirical guidance regarding recruitment and outcome data retention planning, we aim to describe the methods and lessons learned from the recruitment and retention procedures used in a large randomized trial of 2 Web-based smoking cessation interventions.MethodsTo ensure a demographically and geographically diverse participant sample, we used the recruitment strategies (1) traditional, (2) Web-based, and (3) online survey panel methods and adaptively modified each in response to recruitment success. At baseline, participants indicated how they heard about the study and answered demographic questions. To maximize trial retention at each of the 3-, 6-, and 12-month assessment points, 4 survey modalities (first Web, followed by phone, mail, and postcard) were sequentially timed over a 30-day period. Participants received US $25 for submitting their responses, regardless of modality, and received an additional US $10 bonus for completing the Web survey within 24h of electronic notification.ResultsWe randomized 2637 smokers in 16 months and achieved 88% retention at 12-months. Participants (79.26% female, 72.60% Caucasian) were recruited from all 50 states. The majority of participants were recruited through Facebook (49.43%), followed by the survey panel (20.85%), free internet sources (14.54%), traditional media (11.34%), and Google ads (3.84%). Descriptively, participant demographics varied by recruitment source. Of the completed follow-up surveys, most were completed by Web (92%). Retention rates did not vary by recruitment source.ConclusionsContinuous monitoring and refinement of multiple recruitment methods, particularly of online advertising campaigns, allowed us to maximize the effectiveness of recruitment strategies in recruiting a large, diverse sample of smokers. Likewise, offering multiple follow-up survey modalities in sequential order along with time-dependent bonus incentives enabled us to obtain outcome data from a very high level of enrolled participants for the duration of the trial protocol. These strategies may be similarly useful in other trials.Trial RegistrationClinicalTrials.gov NCT01812278; https://clinicaltrials.gov/ct2/show/NCT01812278 (Archived by WebCite at http://www.webcitation.org/71gy5GLvO)

Effect of an eHealth Intervention to Reduce Sickness Absence Frequency Among Employees With Frequent Sickness Absence: Randomized Controlled Trial

“…Due to scientific ethical codes (voluntary participation), involvement of the employer may be difficult to implement in a research setting. Several EHI studies found that recruitment using social media such as Facebook is more successful than more traditional recruitment strategies such as advertising [ 53 , 54 ]. However, such strategies seem difficult to apply to the population of employees with frequent SA.…”

Sun Safe Partners: A pilot and feasibility trial of a couple-focused intervention to improve sun protection practices

“…Participation was low, which suggests that future research should consider other strategies to facilitate increased uptake. Enhancing participation by providing quotes from previous participants, a study information page, following up with email reminders, including information about the importance of sun protection in skin cancer risk reduction, and using multiple social media recruitment methods (Google, Instagram) may increase uptake ( Treweek et al, 2018 ; Watson et al, 2018 ).…”

Methodological Challenges in Web-Based Trials: Update and Insights From the Relatives Education and Coping Toolkit Trial

“…Study promotion and recruitment approaches have been identified as important determinants of successful recruitment [ 39 ]. A combination of web-based and offline strategies has worked well to recruit participants into web-based trials in health research [ 19 , 40 ]. Despite some challenges, such as cost, the potential for misrepresentation, and potentially low recruitment rates [ 11 ], Facebook has proved to be a highly successful web-based recruitment strategy [ 19 , 41 ].…”

“…Previous studies have found a difference in demographics depending on whether participants were recruited on the web or offline [ 19 , 38 , 39 ], but not all studies have identified the same differences. There is some agreement that more females than males come into research through web-based strategies, such as Facebook [ 19 , 42 ], and evidence that more highly educated participants are more likely to be recruited offline [ 19 ].…”

“…Since then, there have been a number of reviews of the methodological challenges associated with evaluating digital interventions [ 5 - 7 ], and many studies have focused on specific challenges such as recruitment [ 8 - 11 ], retention [ 12 - 19 ], and intervention engagement [ 17 , 18 , 20 - 26 ].…”