Sources of error in computerized neuropsychological assessment

Cernich, Alison N.; Brennana, David M.; Barker, Linsey M.; Bleiberg, Joseph

doi:10.1016/j.acn.2006.10.004

Cited by 104 publications

(77 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Electronic data capture and automatic results scoring have minimized human errors in scoring and data entry and increased the accuracy of timing and response latencies. (Cernich et al, 2007;Parsey & Schmitter-Edgecombe, 2013). Other advantages of computerized technology -particularly for the measurement of attention, motor, and memory functioning -are the availability of almost unlimited alternate forms and an increased number of trials.…”

Section: Discussionmentioning

confidence: 99%

Internal consistency and stability of the CANTAB neuropsychological test battery in children.

Syväoja¹,

Tammelin²,

Ahonen³

et al. 2015

Psychological Assessment

View full text Add to dashboard Cite

The Cambridge Neuropsychological Test Automated Battery (CANTAB) is a computer-assessed test battery widely use in different populations. The internal consistency and 1-year stability of CANTAB tests were examined in school-age children. Two hundred-thirty children (57% girls) from five schools in the Jyväskylä school district in Finland participated in the study in spring 2011. The children completed the following CANTAB tests: (a) visual memory (pattern recognition memory [PRM] and spatial recognition memory [SRM]), (b) executive function (spatial span [SSP], Stockings of Cambridge [SOC], and intra-extra dimensional set shift [IED]), and (c) attention (reaction time [RTI] and rapid visual information processing [RVP]). Seventy-four children participated in the follow-up measurements (64% girls) in spring 2012. Cronbach’s alpha reliability coefficient was used to estimate the internal consistency of the nonhampering test, and structural equation models were applied to examine the stability of these tests. The reliability and the stability could not be determined for IED or SSP because of the nature of these tests. The internal consistency was acceptable only in the RTI task. The 1-year stability was moderate-to-good for the PRM, RTI, and RVP. The SSP and IED showed a moderate correlation between the two measurement points. The SRM and the SOC tasks were not reliable or stable measures in this study population. For research purposes, we recommend using structural equation modeling to improve reliability. The results suggest that the reliability and the stability of computer-based test batteries should be confirmed in the target population before using them for clinical or research purposes.

show abstract

Section: Discussionmentioning

confidence: 99%

Internal consistency and stability of the CANTAB neuropsychological test battery in children.

Syväoja¹,

Tammelin²,

Ahonen³

et al. 2015

Psychological Assessment

View full text Add to dashboard Cite

show abstract

“…Although we accounted for sources of random error, systematic error may have influenced our results through hardware and software applications. 22 All computers were equipped with the Windows XP operating system (Microsoft Corporation, Redmond, WA) and the most current version of Adobe Flash (Adobe Systems Inc, San Jose, CA), with only 2 programs running concurrently: the ImPACT and the Green WMT (group 2). We also controlled for suboptimal effort in 2 groups using a freestanding effort test, although the results were highly consistent across groups.…”

Section: Discussionmentioning

confidence: 99%

ImPact Test-Retest Reliability: Reliably Unreliable?

Resch

Driscoll

McCaffrey

et al. 2013

Journal of Athletic Training

119

View full text Add to dashboard Cite

Context: Computerized neuropsychological testing is commonly used in the assessment and management of sport-related concussion. Even though computerized testing is widespread, psychometric evidence for test-retest reliability is somewhat limited. Additional evidence for test-retest reliability is needed to optimize clinical decision making after concussion.Objective: To document test-retest reliability for a commercially available computerized neuropsychological test battery (ImPACT) using 2 different clinically relevant time intervals.Design: Cross-sectional study. Setting: Two research laboratories.Patients or Other Participants: Group 1 (n ¼ 46) consisted of 25 men and 21 women (age ¼ 22.4 6 1.89 years). Group 2 (n ¼ 45) consisted of 17 men and 28 women (age ¼ 20.9 6 1.72 years).Intervention(s): Both groups completed ImPACT forms 1, 2, and 3, which were delivered sequentially either at 1-week intervals (group 1) or at baseline, day 45, and day 50 (group 2). Group 2 also completed the Green Word Memory Test (WMT) as a measure of effort.Main Outcome Measures: Intraclass correlation coefficients (ICCs) were calculated for the composite scores of ImPACT between time points. Repeated-measures analysis of variance was used to evaluate changes in ImPACT and WMT results over time.Results: The ICC values for group 1 ranged from 0.26 to 0.88 for the 4 ImPACT composite scores. The ICC values for group 2 ranged from 0.37 to 0.76. In group 1, ImPACT classified 37.0% and 46.0% of healthy participants as impaired at time points 2 and 3, respectively. In group 2, ImPACT classified 22.2% and 28.9% of healthy participants as impaired at time points 2 and 3, respectively.Conclusions: We found variable test-retest reliability for ImPACT metrics. Visual motor speed and reaction time demonstrated greater reliability than verbal and visual memory. Our current data support a multifaceted approach to concussion assessment using clinical examinations, symptom reports, cognitive testing, and balance assessment.Key Words: intraclass correlation, concussions, mild traumatic brain injuries, neuropsychological testing, athletes Key PointsImPACT had strong to weak test-retest reliability over time, consistent with the results of previous studies. Reliability was greater for the visual motor speed and reaction time subscores than for the verbal and visual memory subscores. Computerized neuropsychological testing is only 1 component of a multifaceted concussion-management program that uses all appropriate tools in clinical decision making.

show abstract

“…Potential errors in computerized neuropsychological testing could arise because of hardware and software interactions (e.g., resolution of the display and presentation of stimuli affected by the monitor type and size; Cernich, Brennana, Barker, & Bleiberg, 2007). Computers are helpful in the calculations of scores or conversion from raw to standard scores, but automated scoring has limited usefulness in neuropsychological practice if other variables are not controlled.…”

Section: Introductionmentioning

confidence: 99%

The use of the Cambridge Neuropsychological Test Automated Battery (CANTAB) in neuropsychological assessment: Application in Brazilian research with control children and adults with neurological disorders.

Roque

Teixeira

Zachi

et al. 2011

Psychology & Neuroscience

View full text Add to dashboard Cite

Computerized neuropsychological tests can be effective and have many benefits. This paper addresses these issues using the computer-based Cambridge Neuropsychological Test Automated Battery (CANTAB) to assess Brazilian children and adults. Preliminary normative data for Brazilian children obtained in a series of CANTAB subtests are presented together with data from adults (controls) and samples of patients with multiple sclerosis and Duchenne muscular dystrophy. The results obtained in children confirmed the normative values reported for American children (Luciana & Nelson, 2002), indicating high applicability of the CANTAB battery for children in the evaluation of visual memory, working memory, planning, and set shifting. For multiple sclerosis patients, CANTAB revealed differences between the control and multiple sclerosis groups for all subtests employed, including visual memory, working memory, spatial memory, decision making, inhibitory control, and sustained attention. In children with Duchenne muscular dystrophy, the CANTAB tests revealed specific detriments in attention and memory. These results of the application of CANTAB in different patient groups indicate that the battery is appropriate for assessing several central nervous system diseases.

show abstract

Sources of error in computerized neuropsychological assessment

Cited by 104 publications

References 8 publications

Internal consistency and stability of the CANTAB neuropsychological test battery in children.

Internal consistency and stability of the CANTAB neuropsychological test battery in children.

ImPact Test-Retest Reliability: Reliably Unreliable?

The use of the Cambridge Neuropsychological Test Automated Battery (CANTAB) in neuropsychological assessment: Application in Brazilian research with control children and adults with neurological disorders.

Contact Info

Product

Resources

About