Mapping the TOEFL iBT® Test Scores to China's Standards of English Language Ability: Implications for Score Interpretation and Use

Abstract

The past decade has seen an emerging interest in mapping (aligning or linking) test scores to language proficiency levels of external performance scales or frameworks, such as the Common European Framework of Reference (CEFR), as well as locally developed frameworks, such as China's Standards of English Language Ability (CSE). Such alignment is ultimately a claim about the interpretation of test scores in relation to external levels of language proficiency. To support such a claim, established procedures should be carefully implemented and multiple sources of evidence should be collected. In this research report, we demonstrate the application of a series of steps in building an argument for aligning the scores of the TOEFL iBT® test, an international, large‐scale language proficiency test of English as a foreign language (EFL), to the levels of the CSE. The alignment process comprised the following steps: (a) establishing construct congruence between the TOEFL iBT test and the CSE; (b) establishing recommended minimum test scores (cut scores), set by local experts, to classify language learners into the local proficiency levels; (c) collection of scores by test takers (N = 1,326) and evaluations of the test takers' proficiency levels by their teachers, based on the local framework; and (d) consideration of the results of other alignment studies in the local context as well as the link between the CEFR and the CSE levels. We conclude with a discussion of the contextual issues that should be considered when interpreting test scores in relation to external proficiency levels. These contextual issues are important considerations because they have the potential to impact score‐based decisions on individuals and institutions. We also discuss the implications for similar alignment research.

Researching Academic Reading in Two Contrasting English as a Medium of Instruction Contexts at a University Level

“…This study used a research version of the TOEFL iBT test rather than an operational test. The content of the test predated the enhancements made to the test in August 2019, which resulted in a shorter reading test (see Papageorgiou et al, 2019, for further details of the revisions).…”

Bridging local needs and national standards: Use of standards-based individualized feedback of an in-house EFL listening test in China

“…For internal assessment, the can-do descriptors from national standards can be incorporated in a self-assessment questionnaire by instructors for students to reflect on what they can do with the language (Moeller & Yu, 2015; Summers et al, 2019). For external assessment, the level and level descriptors can be used as a benchmark for a local test to be mapped onto, adding transparency and justification to score-based decisions (Harsch, 2018; Jin et al, 2017; Papageorgiou et al, 2019). When guided by unified national standards, internal assessment and external assessment may generate comparable results between students’ self-assessed and actual ability levels, and thus provide meaningful feedback for students.…”

“…Local language tests hold promise for the enhancement of score reporting if aligned to national and international language standards. A plethora of studies have examined the alignment of large-scale language tests to external standards and frameworks (e.g., Lim et al, 2013;O'Sullivan et al, 2020;Papageorgiou et al, 2015Papageorgiou et al, , 2019Tannenbaum & Wylie, 2008). One recent study has exemplified how test-standards alignment makes test feedback meaningful and illuminating by combining cognitive diagnostic analysis (CDA) and standard setting approaches (Min & He, 2022).…”

The Students’ Ability in Reading Comprehension of TOEFL Test For The EFL Learners

“…Test of English as a Foreign Language or TOEFL is a standard that is used to know the English capability of a person (Papageorgiou et al, 2019), The test is only applicable to students from countries whose native language is not English, but want to study in countries whose native language is English, either through scholarships or self-test. Then, over the times, this test is also used as standardization by several agencies, either government or private companies in recruiting employees.…”