PCs versus Smartphones in answering web surveys: does the device make a difference?

Revilla, Mélanie; Toninelli, Daniele; Ochoa, Carlos

doi:10.29115/sp-2016-0021

Cited by 11 publications

(8 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Health preference researchers should be cognizant of other issues which may become more or less prominent with different devices in different context. Studies [36,38] have also found PC users are more likely to have potentially distracting 'third parties' which maybe more prevalent and more problematic in some instances where privacy is important. The study also incorporated three attributes whereas reviews of DCEs have shown most studies in health use between four and six [5].…”

Section: Discussionmentioning

confidence: 99%

Mobilising the Next Generation of Stated-Preference Studies: the Association of Access Device with Choice Behaviour and Data Quality

Vass

Boeri²

2020

Patient

View full text Add to dashboard Cite

show abstract

Section: Discussionmentioning

confidence: 99%

Mobilising the Next Generation of Stated-Preference Studies: the Association of Access Device with Choice Behaviour and Data Quality

Vass

Boeri²

2020

Patient

View full text Add to dashboard Cite

show abstract

“…The type of device used to complete data collection may be associated with quality. For example, participants spend more time completing surveys on smartphones (Revilla, Toninelli, and Ochoa 2016), and younger panelists utilize mobile devices for participation (Merle et al 2015). Although limited panel/MTurk comparisons have investigated devices used for survey completion, more should be known about differences.…”

Section: Data Comparisonmentioning

confidence: 99%

Collecting Online Survey Data: A Comparison of Data Quality among a Commercial Panel & MTurk

Zhang¹,

Gearhart²

2020

Surv Pract

View full text Add to dashboard Cite

Scholars seeking online data collection have sought the assistance of professional panels, which are commercial entities that recruit prospective research participants. Although not intended for recruiting participants, Amazon's Mechanical Turk (MTurk) service is a crowdsourcing platform that is being utilized for a lower cost. This study compares data collected from MTurk (N = 760) and a professional panel (N = 1,110) to assess aspects of data quality and respondent features. Results show that MTurk may produce better data quality based on completion rate and success in passing manipulation checks. Participants also differ in terms of educational attainment, age, and preferences of certain devices used for participation. Overall, results provide insight that researchers collecting online data should take into consideration before choosing a data collection platform. Researchers collecting online data increasingly utilize professional panels (Antoun et al. 2016). Opt-in panels allow researchers to cost-effectively recruit respondents compared to offline recruitment (Antoun et al. 2016). Amazon's Mechanical Turk (MTurk) crowdsourcing platform provides an alternate avenue for participant recruitment in exchange for payment (Hitlin 2016). This study compares data collected from MTurk and a professional panel to assess data quality, respondent features, and devices used for responding. Results showcase practical implications for acquiring valid data when recruiting online. Literature Review Data Collection Online participant recruitment has been adopted for their convenience, efficiency, and low cost (Paolacci, Chandler, and Ipeirotis 2010). Two popular means of online recruitment include professional panel companies and crowdsourcing websites, such as MTurk.

show abstract

“…For example, some research investigated the effects on completion rates, finding that mobile respondents had significantly lower completion rates (Mavletova, 2013; Sommer, Diedenhofen, & Musch, 2017), including break-off rates for smartphones that were 2–3 times higher than for personal computers (PCs; Bosnjak et al, 2013; Poggio, Bosnjak, & Weyandt, 2015). A number of studies also studied the effects of mobile devices on response times, finding that participants on mobile devices needed longer to complete a survey (Antoun, Couper, & Conrad, 2017; Gummer & Roßmann, 2015; Revilla, Toninelli, & Ochoa, 2016; Sommer et al, 2017). Schlosser and Mays (2017) also found longer completion times for mobiles, although controlling for the type of Internet connection and hardware minimized those differences.…”

mentioning

confidence: 99%

“…Keusch and Yan (2017) found significantly longer response times both for iPhone users who voluntarily used their device to do a survey and the respondents who were told to switch to their mobile device after starting a survey on their PC. Regarding the length and quality of open answers, Bosnjak et al (2013) found that mobile respondents answered more open questions than PC users when dropping out of a survey, whereas Mavletova (2013) and Revilla, Toninelli, and Ochoa (2016) found the open answers of mobile respondents to be significantly shorter. In addition, Antoun, Couper, and Conrad (2017) found that respondents gave longer answers to open questions on their smartphone, hypothesizing that these respondents may have become more comfortable with writing on their smartphones or using technological support such as voice-to-text typing.…”

mentioning

confidence: 99%

Does Increasing Mobile Device Coverage Reduce Heterogeneity in Completing Web Surveys on Smartphones?

Gummer

Quoß

Roßmann

2018

Social Science Computer Review

View full text Add to dashboard Cite

Mobile coverage recently has reached an all-time high, and in most countries, high-speed Internet connections are widely available. Due to technological development, smartphones and tablets have become increasingly popular. Accordingly, we have observed an increasing use of mobile devices to complete web surveys and, hence, survey methodologists have shifted their attention to the challenges that stem from this development. The present study investigated whether the growing use of smartphones has decreased how systematically this choice of device varies between groups of respondents (i.e., how selective smartphone usage for completing web surveys is). We collected a data set of 18,520 respondents from 18 web surveys that were fielded in Germany between 2012 and 2016. Based on these data, we show that while the use of smartphones to complete web surveys has considerably increased over time, selectivity with respect to using this device has remained stable.

show abstract

PCs versus Smartphones in answering web surveys: does the device make a difference?

Cited by 11 publications

References 14 publications

Mobilising the Next Generation of Stated-Preference Studies: the Association of Access Device with Choice Behaviour and Data Quality

Mobilising the Next Generation of Stated-Preference Studies: the Association of Access Device with Choice Behaviour and Data Quality

Collecting Online Survey Data: A Comparison of Data Quality among a Commercial Panel & MTurk

Does Increasing Mobile Device Coverage Reduce Heterogeneity in Completing Web Surveys on Smartphones?

Contact Info

Product

Resources

About