How does response bias emerge in lengthy sequential preference judgments?

Abstract

Internet surveys are currently used in many academic and marketing research fields. However, the results for these surveys occasionally show traces of response bias. In our study, we analyzed how response bias appears in lengthy preference judgments. 1042 respondents participated in lengthy sequential preference judgments. Three stimuli series were used: scene pictures, Attneave nonsense shapes, and point-symmetric figures. One hundred stimuli were selected for each series and individually displayed on a computer screen, with presentation order randomized for each respondent. Respondents were then asked to rate their degree of preference for each stimulus. Mean preference scores increased over the first 10-20 trials, then, gradually decreased from the middle to the last trial. Furthermore, participants tended to produce the maximum and minimum score during early trials. These results demonstrated that response bias can be a function of presentation order.Communicated by Kazuhisa Takemura.Electronic supplementary material The online version of this article

The Living Space: Psychological Well-Being and Mental Health in Response to Interiors Presented in Virtual Reality

“…But then the effect would drop after “affective habituation” [ 82 ]. As response bias was proposed as a function of presentation order in lengthy sequential preference judgments [ 83 ], we controlled for the stimulus presentation sequence and found no main effects. We also did not find any differences in perceived restorativeness, nor in cognitive performance, while Bayes’ factors showed poor evidence of the alternative hypothesis.…”

“…This might have caused an effect known as the “museum-fatigue effect” [ 85 ], which has been found in many experimental observations and laboratory experiments. Causes were originally attributed to fatigue, but later to other cognitive factors such as satisfaction, information overload, and limitations in attentional capacity [ 83 ]. In terms of momentary affect, we had selected a scale that includes a broad range of negative emotions, to evaluate the threat hypothesis previously proposed [ 31 ].…”

E-perceptions and Business ‘Mating’: The Communication Effects of the Relative Width of Males’ Faces in Business Portraits

“…Including a lot of stimuli has, however, a pitfall as well. Since confronting respondents with a large number of stimuli involves a high cognitive cost for the respondent, lengthy questionnaires can cause exhaustion among respondents which might evoke a response bias (Morii et al, 2017;O'Donovan et al, 2020). This has a negative effect on the reliability of the data.…”

“…This has a negative effect on the reliability of the data. Lengthy questionnaires with a lot of stimuli can also create a habituation effect (Harris, 1943), which reduces the response rate and weakens the statistical power (Morii et al, 2017). Considering the pros and cons of lengthy questionnaires with a lot of stimuli, we consider 24 stimuli to be an adequate amount, specifically since our stimuli were relatively homogeneous.…”

A Systematic Review of Physiological Measurements, Factors, Methods, and Applications in Virtual Reality

“…It refers to the idea that subjects tend to choose a response that they expect to meet social expectations instead of one that reflects their true experience (Corbetta, 2003;Grimm, 2010). Other common examples for response biases are the midpoint bias where people tend to choose neutral answers (Morii et al, 2017) or extreme responding where people tend to choose the extreme choices on a rating scale (Robins et al, 2009). In general, there is a variety of characteristics and circumstances that can negatively influence the human capacity to evaluate oneself.…”