Recruiting Probability Samples for a Multi-Mode Research Panel with Internet and Mail Components

Abstract

Survey response rates have been declining over the past several decades, particularly for random-digit-dialing (RDD) telephone surveys (see de Leeuw and de Heer 2002; Steeh 1981). This trend affects research panels such as the Gallup Panel, which uses RDD methodology to recruit its members. If significant improvements in panel recruitment response rates are to be achieved, new approaches must be considered. This paper presents the findings of a mail and telephone mode experiment conducted by the Gallup Panel to analyze the individual and combined effects of incentives, advance letters, and follow-up telephone calls on the panel recruitment response rate. Study results indicate that the mail recruitment approach nets a higher panel response rate, and that the cost-effectiveness of the mail recruitment approach is significantly greater than the telephone recruitment approach. Study results also suggest that the advance letter, incentive, and telephone follow-up conditions all have independent, positive influences on the response rate; and that the groups that receive an advance letter, that receive incentives, and that receive a follow-up telephone call have higher panel recruitment response rates than the control group.

Look at me Saving the Planet! The Imitation of Visible Green Behavior and its Impact on the Climate Value-Action Gap

“…As the data was collected via an online survey, it is worth considering how accurate this data is compared to traditional survey approaches involving face-to-face interviews and telephone surveys. In this regard, a substantial review of the literature has examined the relative strengths and merits of traditional survey administration methodologies compared with online surveys, with the strong consensus being that well designed and executed webbased surveys typically achieve very comparable if not superior results to conventional best practice (e.g., Birnbaum, 2004;Chang & Krosnick, 2009;Rao, Kaminska,& McCutcheon, 2010). A common concern is that respondents tend to spend little time.…”

The Online Student Connectedness Survey: Evidence of Initial Construct Validity

“…Participants were identified through the research firm Qualtrics, which pre-recruits and pools together individuals who are representative of a particular population and have agreed to take part in the survey for incentives (Rao, Kaminska, & McCutcheon, 2010). Qualtrics was provided with the sample size needed, the survey questions, and prescreening questions to ensure that participants met the criteria.…”

Self-Rated Health Assessed by Web Versus Mail Modes in a Mixed Mode Survey

“…29 Twenty-six percent of initial recruitment telephone calls were completed (AAPOR RR3); about 55% of those who completed the recruitment call consented and participated, resulting in a total of 55,921 active panelists when the 2008 Health Survey was conducted. 30 On the basis of household Internet connection and Internet use, Gallup assigned panelists who had Internet connection and used it frequently (2 times a week and more often) to the web panel unless they opted out for the mail panel (28,405, or 50.8% of the total panel).…”