Assessing Impact, DIF, and DFF in Accommodated Item Scores

Abstract

This pedagogical article is intended to explain the similarities and differences between the parameterizations of two multilevel measurement model (MMM) frameworks. The conventional two-level MMM that includes item indicators and models item scores (Level 1) clustered within examinees (Level 2) and the two-level crossclassified MMM (in which item scores are cross-classified by two Level 2 classifications including item and examinee) are discussed. A small subset of National Assessment of Educational Progress 4th grade mathematics item scores is used to demonstrate use of the MMMs for assessing facets of the validity of accommodated test scores. The models' similarities and distinctions are emphasized as well as the flexibility of the models' extensions.

Assessing Testlet Effect, Impact, Differential Testlet, and Item Functioning Using Cross-Classified Multilevel Measurement Modeling

“…Impact refers to "difference in person abilities as a function of some person-level predictors" (Beretvas, Cawthon, Lockhart, & Kaye, 2012). In the present study, two person predictors were added to the intercept model β 0 j ( ) in Equation 5 to test for impact.…”