Construct Validity of Selected Automated Neuropsychological Assessment Metrics (ANAM) Battery Measures

Kabat, Michael; Kane, Robert L; Jefferson, Angela L.; DiPino, Raymond K.

doi:10.1076/clin.15.4.498.1882

Cited by 93 publications

(51 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…ANAM was designed to be a brief, repeatable, and automated cognitive measure, allowing longitudinal assessment in a time-and cost-efficient manner. The ANAM battery is constructed of a variety of subtests assessing simple and complex reaction time, which have been shown to measure underlying cognitive domains similar to traditional neuropsychological measures (e.g., processing speed, short-term memory, working memory, and resistance to interference; Bleiberg, Kane, Reeves, Garmoe, & Halpern, 2000;Kabat, Kane, Jefferson, & DiPino, 2000Wilken et al, 2003).…”

Section: Introductionmentioning

confidence: 99%

Influence of Demographics on Computerized Cognitive Testing in a Military Sample

Roebuck-Spencer

Reeves

Bleiberg

et al. 2008

Military Psychology

View full text Add to dashboard Cite

Computerized cognitive testing with software programs such as the Automated Neuropsychological Assessment Metrics (ANAM) have long been used to assess cognition in military samples. This study describes demographic influences on computerized testing performance in a large active duty military sample (n = 2366). Performance differences between men and women were minimal on most ANAM subtests, but there was a clear speed/accuracy trade-off, with men favoring speed and women favoring accuracy on the Continuous Performance Test (CPT) subtest. As expected, reaction time increased with age on most subtests, with the exception of Mathematical Processing Test (MTH). Higher education resulted in significant but minimal performance increases on Code Substitution (CDS), Matching to Sample (MSP), and Memory Search (STN) subtests. In contrast, substantial performance differences were seen between education groups on the MTH subtest. These data reveal that it is important to consider demographic factors, particularly age, when using ANAM to draw conclusions about military samples. These results also point to the importance of exploring demographic influences for all reaction time-based computerized assessment batteries.

show abstract

Section: Introductionmentioning

confidence: 99%

Influence of Demographics on Computerized Cognitive Testing in a Military Sample

Roebuck-Spencer

Reeves

Bleiberg

et al. 2008

Military Psychology

View full text Add to dashboard Cite

show abstract

“…It has good construct validity with traditional tests of attention, processing speed, and working memory. 6,7 Test-retest reliability for the individual tests varies between 0.4 and 0.8, with tests requiring higher cognitive processing showing better reliability and simple reaction time showing lower reliability, most likely due to the restricted response range. For this analysis, we used an ANAM composite score, which has been shown to have test-retest reliability coefficients ranging from 0.62 to 0.74.…”

Section: Measurementioning

confidence: 99%

Evidence for Added Value of Baseline Testing in Computer-Based Cognitive Assessment

Roebuck-Spencer

Vincent

Schlegel

et al. 2013

Journal of Athletic Training

View full text Add to dashboard Cite

Context: Large-scale baseline cognitive assessment for individuals at risk for concussion is a common part of the protocol for concussion-surveillance programs, particularly in sports. Baseline cognitive testing is also being conducted in US military service members before deployment. Recently, the incremental validity of large-scale baseline cognitive assessment has been questioned.Objective: To examine the added value of baseline cognitive testing in computer-based neuropsychological assessment by comparing 2 methods of classifying atypical performance in a presumed healthy sample.Design: Cross-sectional study. Main Outcome Measure(s): Rates of atypical performance in this healthy, active-duty sample were determined first by comparing postdeployment scores with a military normative database and then with each individual's personal baseline performance using a reliable change index.Results: Overall rates of atypical performance were comparable across these 2 methods. However, these methods were highly discordant in terms of which individuals were classified as atypical. When norm-referenced methods were used, 2.6% of individuals classified as normal actually demonstrated declines from baseline. Further, 65.7% of individuals classified as atypical using norm-referenced scores showed no change from baseline (ie, potential false-positive findings).Conclusions: Knowing an individual's baseline performance is important for minimizing potential false-positive errors and reducing the risks and stresses of misdiagnosis.Key Words: Automated Neuropsychological Assessment Metrics, computerized neuropsychological testing, concussions, mild traumatic brain injuries, military athletes Key PointsWhen service members' predeployment and postdeployment performances on the Automated Neuropsychological Assessment Metrics test were compared using norm-referenced scores and their personal baselines, the absolute rates of atypical performance were similar. However, for those individuals whose performance was classified as atypical, a high degree of discordance was noted between the methods. Using norms alone resulted in a high level of false-positive errors. Mistakenly classifying an individual as cognitively impaired should be avoided whenever possible because it can lead to overuse of medical resources and undue emotional stress. C omputer-based cognitive testing is fast becoming standard practice in the assessment and management of mild traumatic brain injury (mTBI) in sports and military concussion-management programs. Recommended sport-concussion protocols typically include baseline assessment of cognitive performance for individuals at high risk for concussion, against which postconcussion performance is compared.

show abstract

“…In addition, Match to Sample is significantly correlated (construct validity) with Digit Span backward, which is one of the most commonly used measures of working memory (Kabat et al, 2001). Using fifty-six participants from the larger study, test-retest stability coefficient was determined.…”

Section: Matching To Sample Testmentioning

confidence: 99%

“…In general, computerized assessment tools are used in conjunction with traditional neuropsychological assessment tasks to complement weaknesses of traditional assessments. For example, computerized tests such as the Spaceflight Cognitive Assessment Tools battery (S-CAT; Reeves et al, 1992) allow recording of reaction times, accuracy, and performance efficiency (Kabat, Kane, Jefferson, & DiPino, 2001). …”

Section: Neurocognitive Assessmentsmentioning

confidence: 99%

"Neurocognitive features of Attention Deficit Hyperactivity Disorder in a Non-clinical Adult Sample"

Kim¹

2004

PsycEXTRA Dataset

View full text Add to dashboard Cite

Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. The author hereby certifies that the use of any copyrighted material in the thesis manuscript entitled: (1) individuals with high total ADHD scores had a difficulty in sustaining attention on a repeated trial task; (2) hyperactive/impulsive scores had a significant positive correlation with impulsivity but not with disinhibition; (3) inattentive scores had a negative trend correlation only with a simple auditory/verbal working memory task. The present study revealed that even the individuals with sub-clinical ADHD symptoms had similar difficulties associated with sustained attention, impulsivity, and simple verbal working memory in neurocognitive tests. REPORT DATEiii

show abstract

Construct Validity of Selected Automated Neuropsychological Assessment Metrics (ANAM) Battery Measures

Cited by 93 publications

References 9 publications

Influence of Demographics on Computerized Cognitive Testing in a Military Sample

Influence of Demographics on Computerized Cognitive Testing in a Military Sample

Evidence for Added Value of Baseline Testing in Computer-Based Cognitive Assessment

"Neurocognitive features of Attention Deficit Hyperactivity Disorder in a Non-clinical Adult Sample"

Contact Info

Product

Resources

About