The impact of linguistic similarity on cross-cultural comparability of students’ perceptions of teaching quality

Abstract

Valid cross-country comparisons of student learning and pivotal factors contributing to it, such as teaching quality, offer the possibility to learn from outstandingly effective educational systems across the world and to improve learning in classrooms by providing policy relevant information. Yet, it often remains unclear whether the instruments used in international large-scale assessments work similarly across different cultural and linguistic groups, and thus can be used for comparing them. Using PISA 2012 data, we investigated data comparability of three teaching quality dimensions, namely student support, classroom management, and cognitive activation using a newly developed psychometric approach, namely alignment. Focusing on 15 countries, grouped into five linguistic clusters, we secondly assessed the impact of linguistic similarity on data comparability. Main findings include that (1) comparability of teaching quality measures is limited when comparing linguistically diverse countries;(2) the level of comparability varies across dimensions; (3) linguistic similarity considerably enhances the degree of comparability, except across the Chinese-speaking countries. Our study illustrates new and more flexible possibilities to test for data comparability and outlines the importance to consider cultural and linguistic differences when comparing teachingrelated measures across groups. We discuss possible sources of lacking data comparability and implications for comparative educational research.

Observed teaching behaviour in secondary education across six countries: measurement invariance and indication of cross-national variations

“…In addition, scientific studies measuring observed teaching quality involving multiple countries are currently not present, especially in the context of secondary education (cf. André et al, 2020;Fischer et al, 2019). This study is among the first to address this gap.…”

Influence of Teaching and the Teacher’s Feedback Perceived on the Didactic Performance of Peruvian Postgraduate Students Attending Virtual Classes During the COVID-19 Pandemic

“…A recent systematic review research effort reported by Aidoo and Shengquan (2021) draws a distinction between the terms "teaching" and "teaching quality." Nevertheless, in order to identify teaching, some of the authors referenced by Aiddo and Shengauan observe actions related to both teacher's behavior during class (teaching), and instruction capacity circumstances (teaching quality) (Klieme et al, 2009;Bell et al, 2012;Hafen et al, 2014;Grosse et al, 2017;Fischer et al, 2019). When referring to teaching quality, characteristics such as emotional support, instructional support, classroom organization, type of cognitive demand, and class organization and management are described, among others (Gitomer et al, 2014;Joyce et al, 2018;Liu and Cohen, 2021).…”

Lp Loss Functions in Invariance Alignment and Haberman Linking with Few or Many Groups

“…As the IA approach is implemented in the popular Mplus software since its inclusion in Version 7.1 (May 2013; see [76]), it was already employed in a broad range of applications [40,75,[77][78][79][80][81][82][83][84][85][86][87][88][89][90][91][92][93][94][95]. The applications are most frequently found in the disciplines of education science, political science, psychology, and sociology.…”