The past decade has seen an emerging interest in mapping (aligning or linking) test scores to language proficiency levels of external performance scales or frameworks, such as the Common European Framework of Reference (CEFR), as well as locally developed frameworks, such as China's Standards of English Language Ability (CSE). Such alignment is ultimately a claim about the interpretation of test scores in relation to external levels of language proficiency. To support such a claim, established procedures should be carefully implemented and multiple sources of evidence should be collected. In this research report, we demonstrate the application of a series of steps in building an argument for aligning the scores of the TOEFL iBT® test, an international, large‐scale language proficiency test of English as a foreign language (EFL), to the levels of the CSE. The alignment process comprised the following steps: (a) establishing construct congruence between the TOEFL iBT test and the CSE; (b) establishing recommended minimum test scores (cut scores), set by local experts, to classify language learners into the local proficiency levels; (c) collection of scores by test takers (N = 1,326) and evaluations of the test takers' proficiency levels by their teachers, based on the local framework; and (d) consideration of the results of other alignment studies in the local context as well as the link between the CEFR and the CSE levels. We conclude with a discussion of the contextual issues that should be considered when interpreting test scores in relation to external proficiency levels. These contextual issues are important considerations because they have the potential to impact score‐based decisions on individuals and institutions. We also discuss the implications for similar alignment research.
在过去的十年中,人们对建立测试分数与外部语言能力等级量表或框架 —— 如欧洲共同语言参考框架 (Common European Framework of Reference, CEFR) —— 之间的对接关系的兴趣日益浓厚。对接本质上是一个验证假设的过程,即对考试分数与外部语言能力等级的对应关系假设进行验证。研究应认真落实和记录既定程序,并应收集多种来源的证据,以支撑关于对应关系的假设。本研究旨在建立一项国际英语能力测试与中国本地化英语能力标准——《中国英语能力等级量表》(China’s Standards of English Language Ability, CSE) —— 之间的对接关系,展示了提出并验证假设的步骤。将国际考试分数对接到本地化标准有助于使考试成绩解释与其预期使用环境的相关性更高。鉴于基于分数的决策对个人和机构的潜在影响,本研究也讨论了用本地化的能力等级来解释考试分数时应考虑的语境问题。文章结尾对同类对接研究的开展提出了一些建议。
The past decade has seen an emerging interest in aligning test scores to language proficiency levels of external performance scales or frameworks, such as the Common European Framework of Reference (CEFR). Such alignment is ultimately a claim about the interpretation of test scores in relation to external levels of language proficiency. To support such a claim, established procedures should be carefully implemented and documented, and multiple sources of evidence should be collected. This paper demonstrates the steps in building an argument for aligning the scores of an international English language proficiency test to the levels of China’s Standards of English Language Ability, or CSE, a localized language proficiency framework for English as a foreign language. Aligning an international examination to a localized framework serves to make the test score more relevant to the intended context of its use. We discuss the contextual issues that should be considered when interpreting test scores in relation to local proficiency levels, given the potential impact of score-based decisions on individuals and institutions. The implications for similar alignment research will also be presented.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.