Automated top-down heuristic assembly of a classification multistage test

Zheng, Yi; Nozawa, Yuki; Zhu, Rongchun; Gao, Xueshan

doi:10.1504/ijqre.2016.082387

Cited by 5 publications

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The bottom‐up approach (Luecht & Nungester, 1998) guided the panel assembly process, which is a flexible and commonly used method (Zheng et al., 2012). The goal was to construct modules that met the statistical specifications and combine the modules into panels.…”

Section: Methodsmentioning

confidence: 99%

Pretest Item Calibration in Computerized Multistage Adaptive Testing

Erşen

Lee

2023

J Educational Measurement

View full text Add to dashboard Cite

The purpose of this study was to compare calibration and linking methods for placing pretest item parameter estimates on the item pool scale in a 1‐3 computerized multistage adaptive testing design in terms of item parameter recovery. Two models were used: embedded‐section, in which pretest items were administered within a separate module, and embedded‐items, in which pretest items were distributed across operational modules. The calibration methods were separate calibration with linking (SC) and fixed calibration (FC) with three parallel approaches under each (FC‐1 and SC‐1; FC‐2 and SC‐2; and FC‐3 and SC‐3). The FC‐1 and SC‐1 used only operational items in the routing module to link pretest items. The FC‐2 and SC‐2 also used only operational items in the routing module for linking, but in addition, the operational items in second stage modules were freely estimated. The FC‐3 and SC‐3 used operational items in all modules to link pretest items. The third calibration approach (i.e., FC‐3 and SC‐3) yielded the best results. For all three approaches, SC outperformed FC in all study conditions which were module length, sample size and examinee distributions.

show abstract

Section: Methodsmentioning

confidence: 99%

Pretest Item Calibration in Computerized Multistage Adaptive Testing

Erşen

Lee

2023

J Educational Measurement

View full text Add to dashboard Cite

show abstract

Heuristic Assembly of a Classification Multistage Test with Testlets

Zhuoran

Liu

Wothke³

2019

Springer Proceedings in Mathematics &Amp; Statistics

View full text Add to dashboard Cite

The Automated Test Assembly and Routing Rule for Multistage Adaptive Testing with Multidimensional Item Response Theory

Wang²,

Cai

et al. 2021

J Educational Measurement

View full text Add to dashboard Cite

Designing a multidimensional adaptive test (M-MST) based on a multidimensional item response theory (MIRT) model is critical to make full use of the advantages of both MST and MIRT in implementing multidimensional assessments. This study proposed two types of automated test assembly (ATA) algorithms and one set of routing rules that can facilitate the development of an M-MST. Different M-MST designswere developed based on the proposed ATA algorithms and routing rules and were evaluated through two sets of simulation studies. Study 1 used simulated item banks and considered a variety of testing factors, and results from which can inform us the theoretical performance of the proposed M-MST designs. Study 2 was designed based on a real multidimensional assessment. In addition, a MCAT was simulated as a baseline design to demonstrate the advantage of the proposed M-MST design in each study. Our simulation results indicate that the proposed ATA algorithms and routing rule can generate M-MSTs with a good-quality control and the same or even better ability estimation results than the MCAT given the same condition. This demonstrates the advantage of using M-MST for multidimensional assessment especially for the one that needs to satisfy many nonstatistical constraints.

show abstract

Automated top-down heuristic assembly of a classification multistage test

Cited by 5 publications

References 0 publications

Pretest Item Calibration in Computerized Multistage Adaptive Testing

Pretest Item Calibration in Computerized Multistage Adaptive Testing

Heuristic Assembly of a Classification Multistage Test with Testlets

The Automated Test Assembly and Routing Rule for Multistage Adaptive Testing with Multidimensional Item Response Theory

Contact Info

Product

Resources

About