Computerized Adaptive Testing for Ipsative Tests with Multidimensional Pairwise-Comparison Items: Algorithm Development and Applications

Abstract

A computerized adaptive testing (CAT) solution for tests with multidimensional pairwise-comparison (MPC) items, aiming to measure career interest, value, and personality, is rare. This paper proposes new item selection and exposure control methods for CAT with dichotomous and polytomous MPC items and present simulation study results. The results show that the procedures are effective in selecting items and controlling within-person statement exposure with no loss of efficiency. Implications are discussed in two applications of the proposed CAT procedures: a work attitude test with dichotomous MPC items and a career interest assessment with polytomous MPC items.

Cultural Challenges of the Portuguese Adaptation of an IPIP English-Based Personality Inventory

“…Nevertheless, we did not investigate its external (or predictive) validity, which pertains to factors such as job performance or job engagement. To enhance the psychometric evidence, particularly in terms of predictive validity, we recommend considering the incorporation of computerized adaptive testing, as suggested by Qiu et al (2022).…”