Experienced survey participants, biased responses? – The example of cognitive reflection

Abstract

The example of cognitive reflectionThe Cognitive Reflection Test (CRT) is used in behavioral studies to describe individuals as intuitive or reflective. In recent years, behavioral scientists have increasingly recruited participants on online platforms. Besides convenience, apt platform recruitment is believed to increase validity and facilitate more meaningful inferences towards the population of interest compared to studies based on students. But particularly with regard to CRT, there is an oftenunderestimated drawback: "experienced clickers" might systematically distort findings.