The Contribution of International Large-Scale Assessments to Educational Research: Combining Individual and Institutional Data Sources

Abstract

The present paper aims to discuss how data from international large-scale assessments (ILSAs) can be utilized and combined, even with other existing data sources, in order to monitor educational outcomes and study the effectiveness of educational systems. We consider different purposes of linking data, namely, extending outcomes measures, analyzing differences over time or across cohorts, and supplementing context information. These linking strategies are illustrated by a non-exhaustive selection of studies that exploited ILSAs to investigate a wide range of educational topics. We conclude that the main contribution of ILSA to educational research lies in the ways they facilitate analyses of educational policy and policy-related issues at the institutional level by means of crosscountry analyses. However, the scope of these studies also covers high-quality data on lower levels of the educational system.

More isn't always better: The curvilinear relationship between inquiry-based teaching and student achievement in science

“…These studies include representative samples of students from both primary and secondary schools (Grades 4-8 for TIMSS and 15-year-old students for PISA) to measure trends in student performance. Moreover, these data provide unique opportunities for generalizing the findings to a wide population and for analyzing the determinants and consequences of student performance in specific subjects (Strietholt & Scherer, 2018). TIMSS and PISA studies can accommodate the investigation of both aspects of inquiry across assessment cycles (J. O.…”

Equity, Equality and Diversity in the Nordic Countries—Final Thoughts and Looking Ahead

“…Moreover, there lies great potential in combining data from different studies more systematically. Strietholt and Scherer (2018) argued that unlike most other datasets in educational research, ILSA data may be combined across studies, cycles and grade levels in numerous ways. These data can also be combined with data from other national and international sources.…”

“…These data can also be combined with data from other national and international sources. Combining data from different ILSA projects, as well as combining ILSA data with official statistics and register data, could allow for powerful approaches to investigate research questions that cannot be addressed with the data from a single study (Strietholt & Scherer, 2018). The strength of such a combined approach lies in the possibilities for the cross-validation of findings or a contextual specification and consolidation of research results.…”

“…The fact that the results from such analyses have the potential as points of departure for other studies is a somewhat obvious and unconventional claim. Strietholt and Scherer (2018) pointed out that cross-country analyses of ILSA data have great potential to generate knowledge about issues related to educational policy at the institutional level, as well as about phenomena at lower levels, such as the school, classroom and home levels. However, we rarely see this done systematically and in complex studies considering contextual factors systematically.…”

Does schooling actually perpetuate educational inequality in mathematics performance? A validity question on the measures of opportunity to learn in PISA

“…It should be noted that the participation rates in PISA were below 80 percent in 1 out of 4 countries, and some countries, for example, excluded students in special education. Furthermore, the cross-cultural validity of survey data is contentiously an under-researched issue in comparative research (see Johansson 2016;Rutkowski and Rutkowski 2016;Strietholt et al 2013;Strietholt and Scherer 2017).…”