Embedding Corpora into the Content Validation of the Grammar Test of the National Matriculation English Test (NMET) in China

Pan, Mingwei; Qian, David D.

doi:10.1080/15434303.2017.1303703

Cited by 11 publications

(3 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Much work was conducted on washback research (Jin, 2000;Li, 2005;Qi, 2004aQi, , 2004bQi, , 2005Qi, , 2007Qi, , 2012Zhan & Andrews, 2014;Zou & Xu, 2017). Others were about construct validity (Jin & Yan, 2017;Liu & Yang, 2001), content validity (Pan & Qian, 2017), predictive validity (Fan, 2016) and the validation of self-developed instruments ( Liu, 2007;Zhao, 2012).…”

Section: Research On Seven Categoriesmentioning

confidence: 99%

Language Testing in China: Past and Future

Li¹

2019

ELT

View full text Add to dashboard Cite

Based on the articles written by mainland Chinese scholars published in the most influential Chinese and international journals, the present article analyzed the language testing research, compared the tendencies of seven categories between 2000-2009 and 2010-2019, and put forward future research directions by referring to international hot topics. Of all the seven categories of research topics, validity, performance test and China’s Standards of English Language Ability were three most popular themes, while classroom assessment, technology, rater/test taker differences and professionalization were much less popular. Except for research on performance test and technology, the other five aspects showed an increase in the second decade, with that of China’s Standards of English Language Ability rising the most dramatically. Referring to international research trends, the research predicted that validity, classroom assessment, China’s Standards of English Language Ability and professionalization, especially the ethics and social justice, might be the promising research topics for language testers.

show abstract

Section: Research On Seven Categoriesmentioning

confidence: 99%

Language Testing in China: Past and Future

Li¹

2019

ELT

View full text Add to dashboard Cite

show abstract

“…Since the restoration of Gaokao (the national college entrance examinations), NMET has evolved from a uniform national version to a coexistence of several national and regional versions [8]. The present study concentrates on the most widely used national version entitled "the 2nd version of NMET based on the new curriculum criteria" (NMET-v2), which initiated in 2007 [9] in consequence of the reform of China's "Experimental Curriculum Criteria (ECC)" in 2004 [10].…”

Section: Introductionmentioning

confidence: 99%

From Coverage to Distribution: Exploring Lexical Features of the National Matriculation English Test

Yang,

Liang

2024

AEHSSR

View full text Add to dashboard Cite

Lexical feature has long been a pivotal element of almost all high-stakes language tests. Since the implementation of the “Experimental Curriculum Criteria” in China, few studies have reported investigating lexical features of the ensuing National Matriculation English Test with corpus methodology, and notably none was conducted on word dispersion. To address this problem, Python programming was employed in the present study to perform a corpus-based two-way coverage and visualized distribution analysis between the National Matriculation English Test and Experimental Curriculum Criteria lexicon. It was found that: 1) text coverage of the National Matriculation English Test reached the minimal (95%) threshold yet not the optimal (98%) one for adequate comprehension; 2) word-list coverage of the Experimental Curriculum Criteria was disproportionate and insufficient, suggesting that a large volume (42.905%) of the prescribed lexicon has never been used during the 13 years of implementation; 3) a relatively few (N = 90) high-frequency words, most (74.444%) of which were significantly overused compared with their corresponding BNC frequency, constituted over half (51.403%) of the text coverage; and 4) a vast majority (93.333%) of high-frequency words was homogeneous in dispersion, confirming the overuse with fresh distribution evidence. The results are discussed in terms of implications for test development.

show abstract

“…The NMET as a high-stakes English test has garnered much concern from researchers. Numerous studies have been conducted on the NMET through the analysis of test papers or investigating test stakeholders' views of the NMET to examine its validity (e.g., Dong, 2008;Pan & Qian, 2017). They found that the NMET does have satisfactory validity (Dong, 2020).…”

Section: Introductionmentioning

confidence: 99%

Do school status and classroom English learning practices influence Chinese learners’ perceptions of a high-stakes English test?

Dong

2022

Lang Test Asia

View full text Add to dashboard Cite

Learners’ views of a test have been regarded as a crucial source of evidence of a test’s construct validity as well as a measurement of its impact. This study investigates students’ (N = 3105) perceptions of the National Matriculation English Test (NMET), a high-stakes test in China, and explores the influences of school status and classroom English learning practices on their perceptions. The sample was randomly split in half to conduct cross-validations. Data analysis involved descriptive statistics, exploratory factor analysis, t-test, correlation analysis, standard multiple regression, and structural equation modeling. The survey results demonstrated that students viewed test validity and importance positively and test impact negatively. The results also revealed that school status and classroom English learning practices significantly influenced students’ perceptions of a test. Specifically, those in more prestigious schools held more positive perceptions of NMET validity and importance and more negative perceptions of its impact. Classroom English teaching-related learning practice was more associated with students’ positive perceptions of NMET validity and importance, whereas classroom test preparation was more associated with negative views of NMET impact. This study has important implications for test design, school administration, and learning and teaching.

show abstract

Embedding Corpora into the Content Validation of the Grammar Test of the National Matriculation English Test (NMET) in China

Cited by 11 publications

References 20 publications

Language Testing in China: Past and Future

Language Testing in China: Past and Future

From Coverage to Distribution: Exploring Lexical Features of the National Matriculation English Test

Do school status and classroom English learning practices influence Chinese learners’ perceptions of a high-stakes English test?

Contact Info

Product

Resources

About