Self-report questionnaires scrutinised: Do eye movements reveal individual differences in cognitive processes while completing a questionnaire?

Chauliac, Margot; Catrysse, Leen; Gijbels, David; Mæyer, Sven De; Donche, Vincent

doi:10.1080/13645579.2022.2052696

Cited by 2 publications

(1 citation statement)

References 55 publications

(84 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Conducting post-questionnaire interviews could be an initial step towards uncovering the reasons behind certain response patterns. Additionally, employing eye-tracking studies could provide an unobtrusive means for investigating the completion process of the questionnaire (Chauliac et al, 2020(Chauliac et al, , 2022. This would enable a better understanding of individual differences in cognitive processing during questionnaire completion, and the findings could then be incorporated into reliability analyses.…”

Section: Discussionmentioning

confidence: 99%

The prevalence of careless response behaviour and its consequences on data quality in self-report questionnaires on student learning

Chauliac,

Willems,

Gijbels

et al. 2023

Front. Educ.

Self Cite

View full text Add to dashboard Cite

IntroductionSelf-report questionnaires are widely used in high schools and universities to gain insights into students’ learning strategies and enhance the quality of their education. However, it is important to acknowledge the possibility of respondents being inattentive when completing these questionnaires. While reliability analyses are typically performed at the group level, when providing individual feedback, it is crucial that each respondent’s results are reliable. This study aimed to evaluate the prevalence of careless response behaviour in a questionnaire concerning student learning.MethodsData analysis encompassed a substantial sample of 12,000+ students in their final two years of secondary education, averaging around 17 years of age. Employing five complementary detection techniques, the study identified instances of careless responding present in the questionnaire data.ResultsOur results underscore a notable prevalence of careless response behaviour among the surveyed students. Application of the five detection techniques revealed a substantial number of instances indicating inattentive responding. Furthermore, the questionnaire’s measurement scales were evaluated for reliability. The study noted the presence of carelessness but observed minimal impact on group-level results.DiscussionThe outcomes of this study hold important implications for using self-report questionnaires in education. The prevalence of careless responding emphasizes the need for scrutinizing individual responses. Despite careless responses, their influence on overall group-level data integrity seems restricted. Nonetheless, the study underscores the importance of cautiously interpreting individual-level outcomes, particularly when using these results for individual feedback.

show abstract

Section: Discussionmentioning

confidence: 99%