The integrity of educational outcome measures in international assessments

Strietholt, Rolf; Rosén, Monica; Gladushyna, Olesya

doi:10.1007/s11092-021-09354-y

Cited by 1 publication

(1 citation statement)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Causal questions are central in educational research: Why do some students, classes, schools, or countries outperform others? The question of the determinants of student achievement is pertinent when considering the huge variation in student performance both between and within countries (Strietholt et al, 2014a(Strietholt et al, , 2014b.…”

Section: Causalitymentioning

confidence: 99%

Challenges for the Design of International Assessments: Sampling, Measurement, and Causality

Strietholt,

Johansson

2023

On Education. Journal for Research and Debate

View full text Add to dashboard Cite

This paper examines critical design factors that influence data quality in educational research, using international large-scale educational assessments as an example. We will focus on statistical challenges related to sampling, measurement, and causality. While international assessments employ rigorous random sampling techniques, deviations such as exclusions and non-participation can introduce bias and affect representativeness. In terms of measurement, although these assessments excel in core domains, there is a growing call for broader assessment areas, such as environmental literacy and civic education. Additionally, concerns are emerging about the quality of context surveys. Causality remains a central concern, and despite the challenges posed by the cross-sectional design, combining data and applying sophisticated analytical methods can help address causal questions. Recognising the interconnectedness of sampling, measurement, and causality is essential for conducting robust research and informing evidence-based policies and practices.

show abstract

Section: Causalitymentioning

confidence: 99%