A proof of principle for using adaptive testing in routine Outcome Monitoring: the efficiency of the Mood and Anxiety Symptoms Questionnaire -Anhedonic Depression CAT

Smits, Niels; Zitman, Frans G.; Cuijpers, Pim; Hollander-Gijsman, M.E. den; Carlier, Ingrid V. E.

doi:10.1186/1471-2288-12-4

Cited by 28 publications

(37 citation statements)

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These results were also found in other CAT studies, such as on the Center for Epidemiological Studies-Depression Scale (CES-D), where the total scale of 20 items could be reduced to 7 items [23]. …”

Section: Discussionsupporting

confidence: 71%

Applying Computerized Adaptive Testing to the Four-Dimensional Symptom Questionnaire (4DSQ): A Simulation Study

Magnée¹,

Beurs²,

Terluin³

et al. 2017

JMIR Ment Health

View full text Add to dashboard Cite

BackgroundEfficient screening questionnaires are useful in general practice. Computerized adaptive testing (CAT) is a method to improve the efficiency of questionnaires, as only the items that are particularly informative for a certain responder are dynamically selected.ObjectiveThe objective of this study was to test whether CAT could improve the efficiency of the Four-Dimensional Symptom Questionnaire (4DSQ), a frequently used self-report questionnaire designed to assess common psychosocial problems in general practice.MethodsA simulation study was conducted using a sample of Dutch patients visiting a general practitioner (GP) with psychological problems (n=379). Responders completed a paper-and-pencil version of the 50-item 4DSQ and a psychometric evaluation was performed to check if the data agreed with item response theory (IRT) assumptions. Next, a CAT simulation was performed for each of the four 4DSQ scales (distress, depression, anxiety, and somatization), based on the given responses as if they had been collected through CAT. The following two stopping rules were applied for the administration of items: (1) stop if measurement precision is below a predefined level, or (2) stop if more than half of the items of the subscale are administered.ResultsIn general, the items of each of the four scales agreed with IRT assumptions. Application of the first stopping rule reduced the length of the questionnaire by 38% (from 50 to 31 items on average). When the second stopping rule was also applied, the total number of items could be reduced by 56% (from 50 to 22 items on average).ConclusionsCAT seems useful for improving the efficiency of the 4DSQ by 56% without losing a considerable amount of measurement precision. The CAT version of the 4DSQ may be useful as part of an online assessment to investigate the severity of mental health problems of patients visiting a GP. This simulation study is the first step needed for the development a CAT version of the 4DSQ. A CAT version of the 4DSQ could be of high value for Dutch GPs since increasing numbers of patients with mental health problems are visiting the general practice. In further research, the results of a real-time CAT should be compared with the results of the administration of the full scale.

show abstract

Section: Discussionsupporting

confidence: 71%

Applying Computerized Adaptive Testing to the Four-Dimensional Symptom Questionnaire (4DSQ): A Simulation Study

Magnée¹,

Beurs²,

Terluin³

et al. 2017

JMIR Ment Health

View full text Add to dashboard Cite

show abstract

“…To reduce the burden imposed by lengthy outcome instruments, adaptive testing methodologies should be adopted to focus instruments on ranges of items appropriate for each individual [42]. This process could be guided by an initial assessment of each patient's basic level of activity (eg, sedentary activities; light domestic duties; light recreation and sport; intense exercise and recreation; contact sports) and then progressively refined as more activities are selected from graded subscales.…”

Section: How Do We Get There?mentioning

confidence: 99%

Commonalities, Differences, and Challenges With Patient-derived Outcome Measurement Tools: Function/Activity Scales

Noble

Dwyer

Brekke³

2013

Clinical Orthopaedics &Amp; Related Research

View full text Add to dashboard Cite

show abstract

“…CAT thus allows for an assessment that is tailored to the examinee taking it, with items targeted to provide information about the given examinee's unknown latent trait(s). Numerous studies have found that CAT achieves substantially greater measurement efficiency than traditional paper-and-pencil tests (Gibbons et al, 2008;Moreno, Wetzel, McBride, & Weiss, 1984;Smits, Zitman, Cuijpers, den Hollander-Gijsman, & Carlier, 2012;Weiss, 1982).…”

mentioning

confidence: 99%

Cognitive Diagnostic Models and Computerized Adaptive Testing: Two New Item-Selection Methods That Incorporate Response Times

Finkelman¹,

Kim²,

Weissman³

et al. 2014

JCAT

View full text Add to dashboard Cite

A recent paper proposed an item-selection approach for computerized adaptive testing (CAT) in which the psychometric information per time unit is maximized. The current research extended this methodology to adaptive tests combined with use of a cognitive diagnostic model (CDM). Two new item-selection methods are introduced for the combination of CDMs and CAT: posterior-weighted Kullback-Leibler information per-time-unit, and mutual information per-time-unit. These methods were compared with standard procedures in which the amount of time required to complete an item is not considered. Simulation conditions with and without attribute-balancing constraints indicated that, on average, the new methods required more items but took less time than the standard procedures, while achieving comparable classification accuracy.

show abstract

A proof of principle for using adaptive testing in routine Outcome Monitoring: the efficiency of the Mood and Anxiety Symptoms Questionnaire -Anhedonic Depression CAT

Cited by 28 publications

References 46 publications

Applying Computerized Adaptive Testing to the Four-Dimensional Symptom Questionnaire (4DSQ): A Simulation Study

Applying Computerized Adaptive Testing to the Four-Dimensional Symptom Questionnaire (4DSQ): A Simulation Study

Commonalities, Differences, and Challenges With Patient-derived Outcome Measurement Tools: Function/Activity Scales

Cognitive Diagnostic Models and Computerized Adaptive Testing: Two New Item-Selection Methods That Incorporate Response Times

Contact Info

Product

Resources

About