Electronic Versus Paper and Pencil Survey Administration Mode Comparison: 2019 Youth Risk Behavior Survey*

Abstract

BACKGROUND:Since the inception of the Youth Risk Behavior Surveillance System in 1991, all surveys have been conducted in schools, using paper and pencil instruments (PAPI). For the 2019 YRBSS, sites were offered the opportunity to conduct their surveys using electronic data collection. This study aimed to determine whether differences in select metrics existed between students who completed the survey electronically versus using PAPI.METHODS: Thirty risk behaviors were examined in this study. Data completeness, response rates and bivariate comparisons of risk behavior prevalence between administration modes were examined. RESULTS:Twenty-nine of 30 questions examined had more complete responses among students using electronic surveys. Small differences were found for student and school response rates between modes. Twenty-five of 30 adolescent risk behaviors showed no mode effect. CONCLUSIONS:Seven of 44 states and DC participated electronically. Because survey data were more complete; school and student response rates were consistent; and minor differences existed in risk behaviors between modes, the acceptability of collecting data electronically was demonstrated.

The Effect of Everyday Moral Sensitivity on Bullying Bystander Behavior: Parallel Mediating Roles of Empathy and Moral Disengagement

“…A recent empirical study found small differences in student and school response rates between surveys conducted by “paper and pencil instruments” and “electronic data collection” (Bryan et al, 2022). Meanwhile, the present study largely takes advantage of online research’s strengths, such as the optimization of research procedures (Bryan et al, 2022). For researchers, the convenience of data collection and collation is improved by issuing questionnaires online.…”

“…First, Wenjuanxing (www.sojump.com), a Chinese professional survey website, was used to upload the questionnaire and generate the answer URL link and quick response (QR) code. As Bryan et al (2022) mentioned, gathering information electronically allows for more complete data and minimizes Bully-Only variations in risky behavior across modes. The following steps were carried out in consideration of the obvious safety concerns during the COVID-19 pandemic, as well as the limitations of electronic conditions in some project schools.…”

Comparison of the responses of cross-sectional web- and paper-based surveys on lifestyle behaviors of Japanese adolescents

“…Non-response may occur for two reasons ( Monseur, 2005 ): a student within a participating school fails to complete the questionnaire (e.g., absence) or lack of parental consent. Systematic reviews showed that effective strategies to increase response rates include monetary incentives, short questionnaires (approximately 10 min), personalized questionnaires and letters, contacting participants before sending the questionnaires (email prenotification/invitation and two reminders), and semi-automatic log-in ( Bryan et al, 2022 , Edwards et al, 2002 ). Although researchers cannot obtain personal/contact information in school-based settings, creating shorter questionnaires may be feasible.…”

“…Government agencies must provide more support and ask schools to cooperate in surveys. Additionally, asking the principal about survey responses in advance and looking for another school if the principal refuses may be useful ( Bryan et al, 2022 ).…”