Developing and evaluating a computerized adaptive testing version of the Word Part Levels Test

Abstract

The knowledge about affix plays a vital role in the development of word knowledge and vocabulary acquisition. A test for diagnostic information on the level of affix knowledge would be useful in order to inform the test users of what learners have gained or lacked in this integral component of vocabulary knowledge. This paper reports the development and evaluation of a computerized adaptive testing (CAT) version of the Word Part Levels Test (WPLT), created by Sasao and Webb (2017). The CAT-WPLT was developed to maximize further the effectiveness of the WPLT as a diagnostic test. It was administered to 760 Japanese university EFL (English as a foreign language) learners. The evaluation was based on the comparison of measurement accuracy with the fixed-item version of the WPLT. The results show that the CAT-WPLT can provide test users with diagnostic information on test-taker’s strengths and weaknesses in affix knowledge with smaller number of items and with the same or greater precision than the previous versions of the WPLT. Pedagogical implications for using the CAT-WPLT are discussed along with issues in utilizing computer adaptivity.

Implementation of CAT in Indonesia School: Current Challenges & Strategies

“…The evaluation is based on a comparison of the measurement accuracy with the WPLT version of the fixed items. The results show that the CAT-WPLT can provide diagnostic information to test users about the test taker's strengths and weaknesses in additional knowledge with a smaller number of items and with equal or greater precision than the previous WPLT version [26].…”

Mining Text in Online News Reports of COVID-19 Virus: Key Phrase Extractions and Graphic Modeling

“…These pioneering psychometric studies in general suggest the superiority of CAT in terms of its adaptiveness and measurement precision over traditional paper-and-pencil-based tests in assessing learners' vocabulary knowledge. Vocabulary knowledge is multidimensional in nature and is typically conceptualized as consisting of size and depth dimensions [17]. Given the psychometric strengths of CAT, applying text mining techniques such as term frequency-inverse document frequency (TF-IDF) analysis efficiently helps test designers uncover and identify important keywords/key phrases in a specific corpus.…”

Computer Adaptive Language Testing According to Nato Stanag 6001 Requirements

“…Among the modern development of CALT we can emphasise British tests, such as: Key English Test, Preliminary English Test, First Certificate in English, Certificate in Advanced English, Certificate of Proficiency in English, International English Language Testing System meant to define the foreign language proficiency of candidates for studying or employment in English-speaking countries. These tests are developed and based on the researches in language testing (Larson, 1999;Fulcher, 1999Fulcher, , 2017Bachman, 2000;Chapelle & Voss, 2017;Wigglesworth & Frost, 2017;Mizumoto, Sasao & Webb, 2019;Monfils & Manna, 2021) and are supported by the programmes for scientific researches concerning language tests' validity.…”