“…In the first part of the simulation study, the time limit was set to the actual ASVAB time limit (t tot = 39 minutes). This limit was selected to introduce negligible speededness for examinees (Segall, Moreno, Bloxom, & Hetter, 1997). To investigate the effects of more stringent time limits, the second part of the simulation was a replication of the first part with time limits of 34 and 29 minutes.…”
An item-selection algorithm is proposed for neutralizing the differential effects of time limits on computerized adaptive test scores. The method is based on a statistical model for distributions of examinees’ response times on items in a bank that is updated each time an item is administered. Predictions from the model are used as constraints in a 0-1 linear programming model for constrained adaptive testing that maximizes the accuracy of the trait estimator. The method is demonstrated empirically using an item bank from the Armed Services Vocational Aptitude Battery.
“…In the first part of the simulation study, the time limit was set to the actual ASVAB time limit (t tot = 39 minutes). This limit was selected to introduce negligible speededness for examinees (Segall, Moreno, Bloxom, & Hetter, 1997). To investigate the effects of more stringent time limits, the second part of the simulation was a replication of the first part with time limits of 34 and 29 minutes.…”
An item-selection algorithm is proposed for neutralizing the differential effects of time limits on computerized adaptive test scores. The method is based on a statistical model for distributions of examinees’ response times on items in a bank that is updated each time an item is administered. Predictions from the model are used as constraints in a 0-1 linear programming model for constrained adaptive testing that maximizes the accuracy of the trait estimator. The method is demonstrated empirically using an item bank from the Armed Services Vocational Aptitude Battery.
“…Although multidimensionality analyses were conducted at the time Pools O1 and O2 were assembled, LD diagnostics were not applied, and LD was not controlled for in operational administrations of the pools. More details about the operational administration are given in Segall, Moreno, Bloxom, and Hetter (1997).…”
Section: Diagnosis Of Local Dependencementioning
confidence: 99%
“…The simulated administration conditions matched those currently used in operational CAT administrations for the MK test, with the exception that enemies are not currently controlled for in operational administrations. More details about the operational administration conditions are given in Segall, Moreno, Bloxom, and Hetter (1997).…”
Section: Effect Of Local Dependence On Cat Score Precisionmentioning
confidence: 99%
“… Historically, we have used content specifications for item writing, but not as a constraint for pool assembly or operational administration of our CAT test. These practices and research in support of these practices are described in detail in Segall, Moreno, and Hetter (1997) and Segall, Moreno, Bloxom, and Hetter (1997). We are in the process of re‐evaluating our practices regarding the use of content specifications in building pools and administering tests.…”
The accuracy of CAT scores can be negatively affected by local dependence if the CAT utilizes parameters that are misspecified due to the presence of local dependence and/or fails to control for local dependence in responses during the administration stage. This article evaluates the existence and effect of local dependence in a test of Mathematics Knowledge. Diagnostic tools were first used to evaluate the existence of local dependence in items that were calibrated under a 3PL model. A simulation study was then used to evaluate the effect of local dependence on the precision of examinee CAT scores when the 3PL model was used for selection and scoring. The diagnostic evaluation showed strong evidence for local dependence. The simulation suggested that local dependence in parameters had a minimal effect on CAT score precision, while local dependence in responses had a substantial effect on score precision, depending on the degree of local dependence present.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.