Mind the Mode: Differences in Paper vs. Web-Based Survey Modes Among Women With Cancer

Abstract

Context Researchers administering surveys seek to balance data quality, sources of error, and practical concerns when selecting an administration mode. Rarely are decisions about survey administration based on the background of study participants, though socio-demographic characteristics like age, education, and race may contribute to participants’ (non)responses. Objectives In this study, we describe differences in paper- and web-based surveys administered in a national cancer survivor study of women with a history of cancer in order to compare the ability of each survey administrative mode to provide quality, generalizable data. Methods We compared paper- and web-based survey data by socio-demographic characteristics of respondents, missing data rates, scores on primary outcome measure, and administrative costs and time using descriptive statistics, tests of mean group differences, and linear regression. Results Our findings indicate that more potentially vulnerable patients preferred paper questionnaires and that data quality, responses, and costs significantly varied by mode and participants’ demographic information. We provide targeted suggestions for researchers conducting survey research to reduce survey error and increase generalizability of study results to the patient population of interest. Conclusions Researchers must carefully weigh the pros and cons of survey administration modes to ensure a representative sample and high-quality data.

The feasibility of web surveys for obtaining patient-reported outcomes from cancer survivors: a randomized experiment comparing survey modes and brochure enclosures

“…However, we did find that the oldest age group (65 or above) was more likely to respond than the youngest among the paper arm, but we did not observe this for web. This is consistent with prior research finding older individuals overrepresented among responders to a paper survey while web respondents are on average younger [63, 65] and that responders to web surveys are typically younger than those to a paper survey [64]. Due to the continuing relationship between age and web survey response patterns, using web alone to survey cancer survivors may not yet be advisable, especially since the larger population of cancer survivors is on average older than those included in this study, and only 44% of adults age 80 or above use the internet [67].…”

The effects of a unique medium chain triglyceride complex on migraine symptoms: A beta pilot study

“…This novel hybrid instrument was developed to avoid common problems noted with other scales. These issues include being too lengthy, requiring responses too frequently, prolonged study periods leading to recall bias and lowered compliance, as well as proprietary forms that required payment for use [36][37][38][39]. Subject applicants were then reviewed and approved by the Colorado Center for Health and Sports Science Institutional Review Board (CCHSS IRB), with fourteen (N=14) subjects being accepted into and completing the study.…”

18 - Characterizing Psychobehavioral Risks in Survivors of Multiple Primary Cancers

“…Pretesting pilot work determined that the total survey completion time estimate = 30-45 minutes. Prior team research (Hagan et al, 2017) has demonstrated that participants find the estimated time of survey completion to be acceptable. *Likert-scaled items from a multi-item scale are ordinal.…”