False-Positive Error Rates for Reliable Digit Span and Auditory Verbal Learning Test Performance Validity Measures in Amnestic Mild Cognitive Impairment and Early Alzheimer Disease

Loring, David W.; Goldstein, Felicia C.; Chen, Chuqing; Drane, Daniel L.; Lah, James J.; Zhao, Liping; Larrabee, Glenn J.

doi:10.1093/arclin/acw014

Cited by 64 publications

(39 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Digit span is not a good predictor of concurrent diagnosis; computing cognitive measure thresholds based on our Cog-PS model and using these thresholds to classify individuals as normal versus CI/MCI/AD would yield many false positives. This lack of specificity of digit span for dementia has been documented previously [64,65]. What our results demonstrate is that changes in digit span are most evident early on in cognitively normal stages.…”

Section: Discussionsupporting

confidence: 68%

Temporal Order of Alzheimer’s Disease-Related Cognitive Marker Changes in BLSA and WRAP Longitudinal Studies

Bilgel

Koscik

et al. 2017

JAD

View full text Add to dashboard Cite

Investigation of the temporal trajectories of currently used neuropsychological tests is critical to identifying earliest changing measures on the path to dementia due to Alzheimer’s disease (AD). We used the Progression Score (PS) method to characterize the temporal trajectories of measures of verbal memory, executive function, attention, processing speed, language, and mental status using data spanning normal cognition, mild cognitive impairment (MCI), and AD from 1661 participants with a total of 7839 visits (age at last visit 77.6 SD 9.2) in the Baltimore Longitudinal Study of Aging and 1510 participants with a total of 3473 visits (age at last visit 59.5 SD 7.4) in the Wisconsin Registry for Alzheimer’s Prevention. This method aligns individuals in time based on the similarity of their longitudinal measurements to reveal temporal trajectories. As a validation of our methodology, we explored the associations between the individualized cognitive progression scores (Cog-PS) computed by our method and clinical diagnosis. Digit span tests were the first to show declines in both data sets, and were detected mainly among cognitively normal individuals. These were followed by tests of verbal memory, which were in turn followed by Trail Making Tests, Boston Naming Test, and Mini-Mental State Examination. Differences in Cog-PS across the clinical diagnosis and APOE ε4 groups were statistically significant, highlighting the potential use of Cog-PS as individualized indicators of disease progression. Identifying cognitive measures that are changing in preclinical AD can lead to the development of novel cognitive tests that are finely tuned to detecting earliest changes.

show abstract

Section: Discussionsupporting

confidence: 68%

Temporal Order of Alzheimer’s Disease-Related Cognitive Marker Changes in BLSA and WRAP Longitudinal Studies

Bilgel

Koscik

et al. 2017

JAD

View full text Add to dashboard Cite

show abstract

“…This lack of specificity of digit span for dementia has been documented previously [63,64]. What our results demonstrate is that changes in digit span are most evident early on in cognitively normal stages.…”

Section: Discussionsupporting

confidence: 68%

Temporal order of Alzheimer’s disease-related cognitive marker changes in BLSA and WRAP longitudinal studies

Bilgel

Koscik

et al. 2016

Preprint

View full text Add to dashboard Cite

Investigation of the temporal trajectories of currently used neuropsychological tests is critical to identifying earliest changing measures on the path to dementia due to Alzheimer's disease (AD). We used the Progression Score (PS) method to characterize the temporal trajectories of measures of verbal memory, executive function, attention, processing speed, language, and mental state using data spanning normal cognition, mild cognitive impairment (MCI), and AD from 1661 participants with a total of 7839 visits (age at last visit 77.6 SD 9.2) in the Baltimore Longitudinal Study of Aging and 1542 participants with a total of 4467 visits (age at last visit 59.9 SD 7.3) in the Wisconsin Registry for Alzheimer's Prevention. This method aligns individuals in time based on the similarity of their longitudinal measurements to reveal temporal trajectories. As a validation of our methodology, we explored the associations between the individualized cognitive progression scores (Cog-PS) computed by our method and clinical diagnosis.Digit span tests were the first to show declines in both data sets, and were detected mainly among cognitively normal individuals. These were followed by tests of verbal memory, which were in turn followed by Trail Making Tests, Boston Naming Test, and Mini-Mental State Examination. Differences in Cog-PS across the clinical diagnosis groups were statistically significant, highlighting the potential use of Cog-PS as individualized indicators of disease progression. Identifying cognitive measures that are changing in preclinical AD can lead to the development of novel cognitive tests that are finely tuned to detecting earliest changes.

show abstract

“…The "two-test failure rule" is based on the chaining of likelihood ratios (Larrabee, 2008) and can be applied only when the different validity measures are independent. Also, the embedded indicators are generally more susceptible to cognitive impairment than the freestanding validity tests (Merten et al, 2007;Loring et al, 2016).…”

Section: Discussionmentioning

confidence: 99%

Performance and Symptom Validity Assessment in Patients with Apathy and Cognitive Impairment

Dandachi-FitzGerald

Duits

Leentjens

et al. 2019

J Int Neuropsychol Soc

View full text Add to dashboard Cite

Objective:Performance and symptom validity tests (PVTs and SVTs) measure the credibility of the assessment results. Cognitive impairment and apathy potentially interfere with validity test performance and may thus lead to an incorrect (i.e., false-positive) classification of the patient’s scores as non-credible. The study aimed at examining the false-positive rate of three validity tests in patients with cognitive impairment and apathy.Methods:A cross-sectional, comparative study was performed in 56 patients with dementia, 41 patients with mild cognitive impairment, and 41 patients with Parkinson’s disease. Two PVTs – the Test of Memory Malingering (TOMM) and the Dot Counting Test (DCT) – and one SVT – the Structured Inventory of Malingered Symptomatology (SIMS) – were administered. Apathy was measured with the Apathy Evaluation Scale, and severity of cognitive impairment with the Mini Mental State Examination.Results:The failure rate was 13.7% for the TOMM, 23.8% for the DCT, and 12.5% for the SIMS. Of the patients with data on all three tests (n = 105), 13.5% failed one test, 2.9% failed two tests, and none failed all three. Failing the PVTs was associated with cognitive impairment, but not with apathy. Failing the SVT was related to apathy, but not to cognitive impairment.Conclusions:In patients with cognitive impairment or apathy, failing one validity test is not uncommon. Validity tests are differentially sensitive to cognitive impairment and apathy. However, the rule that at least two validity tests should be failed to identify non-credibility seemed to ensure a high percentage of correct classification of credibility.

show abstract

False-Positive Error Rates for Reliable Digit Span and Auditory Verbal Learning Test Performance Validity Measures in Amnestic Mild Cognitive Impairment and Early Alzheimer Disease

Abstract: Embedded validity cutoffs derived from mixed clinical groups produce unacceptably high false-positive rates in MCI and early AD. Combining embedded PVT indicators lowers the false-positive rate.

Cited by 64 publications

References 41 publications

Temporal Order of Alzheimer’s Disease-Related Cognitive Marker Changes in BLSA and WRAP Longitudinal Studies

Temporal Order of Alzheimer’s Disease-Related Cognitive Marker Changes in BLSA and WRAP Longitudinal Studies

Temporal order of Alzheimer’s disease-related cognitive marker changes in BLSA and WRAP longitudinal studies

Performance and Symptom Validity Assessment in Patients with Apathy and Cognitive Impairment

Contact Info

Product

Resources

About