Using ad hoc measures for response styles: a cautionary note

Beuckelaer, Alain De; Weijters, Bert; Rutten, Anouk

doi:10.1007/s11135-009-9225-z

Cited by 48 publications

(63 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Previous research revealed a host of findings relating response styles to demographic variables, personality characteristics, and features of the items (see De Beuckelaer, Weijters, & Rutten, 2010, for an overview). For example, response styles are positively related to age and negatively related to education (Greenleaf, 1992a;Meisenberg & Williams, 2008;Narayan & Krosnick, 1996;Rammstedt, Goldberg, & Borg, 2010;Weijters, Geuens, et al, 2010a;Winkler, Kanouse, & Ware, 1982).…”

Section: Nature Of Response Stylesmentioning

confidence: 99%

Validity of Multiprocess IRT Models for Separating Content and Response Styles

Plieninger

Meiser

2014

Educational and Psychological Measurement

View full text Add to dashboard Cite

Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that allow for separating multiple response processes in rating data. The rationale behind these models is to define process variables that capture psychologically meaningful aspects of the response process like, for example, content-and response style-related processes. The aim of the present research was to test the validity of this approach using two large data sets. In the first study, responses to a 7-point rating scale were disentangled, and it was shown that response style-related and content-related processes were selectively linked to extraneous criteria of response styles and content. The second study, using a 4-point rating scale, focused on a content-related criterion and revealed a substantial suppression effect of response style. The findings have implications for both basic and applied fields, namely, for modeling response styles and for the interpretation of rating data.

show abstract

Section: Nature Of Response Stylesmentioning

confidence: 99%

Validity of Multiprocess IRT Models for Separating Content and Response Styles

Plieninger

Meiser

2014

Educational and Psychological Measurement

View full text Add to dashboard Cite

show abstract

“…From the literature review on the topic it would appear that there is no single 'correct' method to reduce CSRS bias (Beuckelaer, et al, 2010;Van Vaerenbergh & Thomas, 2013). The best that can be done is to select a correction technique based on available theory for the data under review, acknowledge that the new standardised data may bring with it an element of distortion (Dolnicar & Grün, 2007a) and use rigorous analysis to ensure appropriate interpretation.…”

Section: Discussionmentioning

confidence: 99%

Exploring the implications of cultural diversity for environmental learning at an African aquarium

Mann¹

View full text Add to dashboard Cite

Zoos and aquariums, which are visited by over 700 million people each year, can play a vital role in exposing and sensitising visitors about the importance of environmental conservation and encourage them to engage in environmentally responsible behaviours after their visit. To attract visitors, zoos and aquariums offer a range of experiences that focus on the viewing of live animals. These may include animal presentations, personal interactions between staff and visitors, opportunities to physically interact with the animals and, most commonly, the use of interpretive signage. Most zoo and aquarium experiences are aimed at increasing visitors' awareness of, interest in and concern for environmental issues. To improve the design of visitor experiences, research is needed to evaluate the impact of a visit on visitor environmental learning outcomes, which are a major part of the zoo and aquarium raison

show abstract

“…However, a necessary condition is that the v ARS_index is constructed on a large set of items (preferably more than 100), not including the items used for the content analysis. This is important to avoid confounding between the content and the style (De Beuckelaer et al 2010). If this condition is fulfilled, the regression procedure is also acceptable without prior identification of the ARS factor by structural equation modeling (Reynolds & Smith 2010).…”

Section: Discussion and Conclusion 41 Methodological Issuesmentioning

confidence: 99%

“…For instance, methods based on response style indices (e.g. Bachman & O'Malley 1984;Reynolds & Smith 2010) are able to detect multiple types of response style and eliminate bias on an individual level, but fail to distinguish clearly between the response style and the content (Baumgartner & Steenkamp 2001;De Beuckelaer et al 2010). In addition, the convergent validity of methods based on indices and more advanced methods for response style detection are not always secured (De Beuckelaer et al 2010).…”

Section: Introductionmentioning

confidence: 99%

“…Bachman & O'Malley 1984;Reynolds & Smith 2010) are able to detect multiple types of response style and eliminate bias on an individual level, but fail to distinguish clearly between the response style and the content (Baumgartner & Steenkamp 2001;De Beuckelaer et al 2010). In addition, the convergent validity of methods based on indices and more advanced methods for response style detection are not always secured (De Beuckelaer et al 2010). Most response style diagnostics, however, are based on the assumption that if biased behavior exists, it can be identified as a common response style factor that equally loads on all items independent of their content (Billiet & McClendon 2000;Welkenhuysen-Gybels et al 2003).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Ensuring the validity of private forest owner typologies by controlling for response style bias and the robustness of statistical methods

Ficko

Bončina

2013

Scandinavian Journal of Forest Research

View full text Add to dashboard Cite

In survey-based segmentation of forest owners, two threats to the validity of results have largely been ignored: (1) response style bias and (2) the robustness of the statistical methods. This study demonstrates response style bias detection, presents an approach for correcting for acquiescence Á the systematic tendency to agree with survey items, and explores the sensitivity of a probabilistic clustering algorithm to requirements for the validity of the typology. Structural equation modeling and Monte Carlo data generation techniques were employed to detect acquiescence and estimate its effect on construct validity. A survey of the relevance of management information for private forest owners (N 0364) was used as an example. Although acquiescence was confirmed, it had minor effect on the results and no effect on the substantive construct. Uncertainty about the number of forest owner types and membership can be reduced by using probabilistic clustering and observing the number of clusters while changing the requirements for the validity of clusters. The expectation maximization algorithm proved to be robust even to stringent requirements for the validity of clusters. By controlling for response style and the robustness of statistical methods, the validity of private forest owner typologies can be better ensured.

show abstract

Using ad hoc measures for response styles: a cautionary note

Cited by 48 publications

References 30 publications

Validity of Multiprocess IRT Models for Separating Content and Response Styles

Validity of Multiprocess IRT Models for Separating Content and Response Styles

Exploring the implications of cultural diversity for environmental learning at an African aquarium

Ensuring the validity of private forest owner typologies by controlling for response style bias and the robustness of statistical methods

Contact Info

Product

Resources

About