Assessing Cognitive Bias in Korean and Indonesian Scientists: Considering Sociocultural Factors in Judgment and Choice

Abstract

There has been the growing concern about excessive numbers of false-positive results published in the scientific literature. Cognitive bias plays a considerable role in triggering false findings that involve indirect and unwitting self-deception by scientists. This study considers the sociocultural differences in cognitive bias between Korean and Indonesian scientists. A cognitive bias assessment (CBA) was developed and administered to 184 professors, lecturer assistants, doctoral students, and master’s students in South Korea and Indonesia. The CBA results revealed some similar response patterns between Korean and Indonesian scientists. Additionally, the detection of 19 potential differential item functionings (DIFs) demonstrates the influence of sociocultural factors on how scientists interpret to each item. Finally, the Indonesian scientists scored significantly higher in optimism and belief bias. This study discusses the importance of awareness of cognitive biases, particularly the role of science education to reduce biases through systematic thinking, reasoning, and judgment by understanding scientific methods.

Overcome the fragmentation in online propaganda literature: the role of cultural and cognitive sociology

“…For instance, scholars developing debiasing treatments that target cognition (e.g., Dai et al, 2021 ; Lewandowsky and van der Linden, 2021 ) would benefit from the inclusion of sociocultural factors in their analyses as this would allow them to develop more effective debiasing stimuli that account for the diversity characterizing online propaganda audience. Indeed, by taking into account that individuals' sociocultural background affects the availability of cultural repertoires and, thus, the cognitive mechanisms underlying information-processing and decision-making, researchers would be able to design tailored debiasing treatments that work best for specific socio-cultural groups (Sya'bandari et al, 2022 ).…”

Development of a Value-Based VCT Learning Model Al-Washliyahan in The Learning Process at Madrasah Aliyah on North Sumatra

“…One of the successes of learning is determined by a support system in the form of a syllabus, learning models, learning media, and appropriate learning resources (Sya'bandari et al, 2022). To apply the values of Al-Washliyah figures to students, a learning program is needed to integrate these values, for example, through learning media, models, methods, and teaching materials (Siregar et al, 2022).…”

Development of Summative Assessment Instruments for the Affective Aspects of Learning History

“…Assessment is therefore an essential component of the learning process (P. Black & Wiliam, 2018;Papadakis et al, 2020). The process of assessment in learning is important, among other things, to determine students' mastery of the material being studied, to know students' potential, to increase students' motivation, to diagnose students' learning difficulties, to provide evidence of competence that students have mastered, and as a benchmark for improving future learning programs(P. Black & Wiliam, 2018;Hansem et al, 2021;Ningsih et al, 2019;Ofianto & Suhartono, 2016;Reisman et al, 2019;Sajjad et al, 2018;Sya'bandari et al, 2022). Teachers must be able to create assessment instruments that can measure cognitive, affective, and skill-related factors (Ofianto et al, 2022;Ofianto & Ningsih, 2021).…”