The Mode Effect in Mixed-Mode Surveys

Börkan, Bengü

doi:10.1177/0894439309350698

Cited by 52 publications

(47 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The finding regarding social desirability confirms Tourangeau et al (2013, 142), who find a very small positive effect of web questionnaires compared to mailed questionnaires regarding the revelation of sensitive information. The item nonresponse rate does not differ significantly between modes, which is in line with the studies by Börkan (2010) and by Lin and Ryzin (2012). Person-reliability does not differ significantly between the modes either, as also found by Fouladi et al (2002).…”

Section: Table 6 About Heresupporting

confidence: 90%

“…Results for scale reliability are also ambivalent, showing higher pairwise correlations between items either in the MAIL mode (Cole 2005;Lin and Ryzin 2012) or in the web based mode (Börkan 2010). Still others detect no systematic differences between modes (Fouladi et al 2002, 208).…”

mentioning

confidence: 97%

“…A number of studies report less item non-response in the web mode (Boyer et al 9 2002; Kiesler and Sproull 1986;Klassen and Jacobs 2001;Kwak and Radler 2002;Schaefer and Dillman 1998;Barrios et al 2010). However, newer studies show no differences in item nonresponse between the two modes (Börkan 2010;Lin and Ryzin 2012). Findings by Miller and Dillman (2012) indicate that mode effects regarding item nonresponse might depend on the content of the questions.…”

mentioning

confidence: 99%

See 2 more Smart Citations

Response Error in a Web Survey and a Mailed Questionnaire: The Role of Cognitive Functioning

et al. 2016

View full text Add to dashboard Cite

Standard-Nutzungsbedingungen:Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Zwecken und zum Privatgebrauch gespeichert und kopiert werden.Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich machen, vertreiben oder anderweitig nutzen.Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, gelten abweichend von diesen Nutzungsbedingungen die in der dort genannten Lizenz gewährten Nutzungsrechte. Web-based interviewing is gradually replacing traditional modes of data collection, in particular telephone and mailed surveys. This global trend takes place despite the fact that established knowledge of its consequences on response error is incomplete. This paper studies differences between a web (CAWI) and a mailed version (MAIL) of a questionnaire in various forms of response error, namely item nonresponse, satisficing, person-reliability, and social desirable responding. We posit 1) that response error depends on respondents cognitive functioning, namely in the domains of global reading abilities, fluid intelligence, as well as working and episodic memory; and 2) that these effects differ across modes of data collection with generally higher prevalence in the CAWI mode since this mode is more demanding. Terms of use: Documents in EconStor may The analysis builds on a randomized mode experiment implemented in the context of the BerlinAging Study II (BASE-II), a survey that primarily focuses on multidimensional processes of physical and mental aging (see Bertram et al. 2014). The analysis reveals a high impact of cognitive functioning at the various stages of the survey response process. While we do found moderate mode-differences in response error, such as higher item nonresponse rates in the CAWI mode, we did not find cognitive functioning to be a better predictor of response error in webbased interviewing.Keywords: Mixed-mode design, CAWI, cognitive functioning, response quality 3 MotivationOngoing technological advancement is reflected in the dominant modes of data collection in surveys. In face-to-face settings, computer-assisted personal interviewing (CAPI) is gradually replacing paper-and-pencil personal interviewing (PAPI), while in self-administered interviews, web-based formats (CAWI) are increasingly replacing mailed questionnaires. In many countries, web-based interviewing has become a critically important mode of data collection in social and market research in only 10 years' time (see Table 1 for the German case). Table 1 With the purpose of analysing this CAWI mode effect, we decided to compare CAWI with another self-administered questionnaire. Although the comparison with the face-to-face mode 4 seems useful given that this mode still represents the mainly used mode in surveys, it nevertheless differs strongly from self-administered questionnaires both in terms of costs and interviewer assistance. Therefore we decided to compare the CA...

show abstract

Section: Table 6 About Heresupporting

confidence: 90%

mentioning

confidence: 97%

mentioning

confidence: 99%

See 1 more Smart Citation

Response Error in a Web Survey and a Mailed Questionnaire: The Role of Cognitive Functioning

et al. 2016

View full text Add to dashboard Cite

show abstract

“…Without considering satisficing explicitly Borkan (2010) found no mode effects between mail and Internet surveys on psychometric quality of rating scales and data quality (measured as item nonresponse). Also comparing with mail, Denscombe (2006) supports this finding and states that ''there is little evidence of a mode effect linked to web-based questionnaires.''…”

Section: Satisficingmentioning

confidence: 80%

Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes

Lindhjem

Navrud

2011

IRERE

127

View full text Add to dashboard Cite

Internet is quickly becoming the survey mode of choice for stated preference (SP) surveys in environmental economics. However, this choice is being made with relatively little consideration of its potential influence on survey results. This paper reviews the theory and emerging evidence of mode effects in the survey methodology and SP literatures, summarizes the findings, and points out implications for Internet SP practice and research. The SP studies that compare Internet with other modes do generally not find substantial difference. The majority of welfare estimates are equal; or somewhat lower for the Internet surveys. Further, there is no clear evidence of substantially lower quality or validity of Internet responses. However, the degree of experimental control is often low in comparative studies across survey modes, and they often confound measurement and sample composition effects. Internet offers a huge potential for experimentation and innovation in SP research, but when used to derive reliable welfare estimates for policy assessment, issues like representation and nonresponse bias for different Internet panels should receive more attention.

show abstract

“…Mixed-mode methods for surveys are increasingly popular (Dillman 2007), and there is some indication that there is a limited "mode effect" for online versus paper surveys (Börkan 2010). Despite this, few studies consider the effectiveness of online survey options specifically for older populations.…”

mentioning

confidence: 99%

Using Online and Paper Surveys

Bernardo

Curtis

2012

Res Aging

View full text Add to dashboard Cite

To examine the effectiveness of mixed-mode methodology, this article draws on a study that used both online and paper surveys to collect data on a sample of the over 50 population in a small New England town. Respondents were offered the option of responding online or with a paper survey, an approach that addresses some of the major concerns about using online surveys among groups with limited Internet access while also reducing costs and simplifying data entry. The authors demonstrate that response mode does not have a significant effect on survey answers once demographic variables (such as employment and income) are added to the analysis. In addition, the results from this survey suggest that the Internet is useful as a tool to collect data from those over 50.

show abstract

The Mode Effect in Mixed-Mode Surveys

Cited by 52 publications

References 22 publications

Response Error in a Web Survey and a Mailed Questionnaire: The Role of Cognitive Functioning

Response Error in a Web Survey and a Mailed Questionnaire: The Role of Cognitive Functioning

Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes

Using Online and Paper Surveys

Contact Info

Product

Resources

About