Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive Battery

Abstract

Background As evidenced by the further reduction in access to testing during the COVID-19 pandemic, there is an urgent, growing need for remote cognitive assessment for individuals with cognitive impairment. The Neurotrack Cognitive Battery (NCB), our response to this need, was evaluated for its temporal reliability and stability as part of ongoing validation testing. Objective The aim of this study is to assess the temporal reliability of the NCB tests (5 total) across a 1-week period and to determine the temporal stability of these measures across 3 consecutive administrations in a single day. Methods For test-retest reliability, a range of 29-66 cognitively healthy participants (ages 18-68 years) completed each cognitive assessment twice, 1 week apart. In a separate study, temporal stability was assessed using data collected from 31 different cognitively healthy participants at 3 consecutive timepoints in a single day. Results Correlations for the assessments were between 0.72 and 0.83, exceeding the standard acceptable threshold of 0.70 for temporal reliability. Intraclass correlations ranged from 0.60 to 0.84, indicating moderate to good temporal stability. Conclusions These results highlight the NCB as a brief, easy-to-administer, and reliable assessment for remote cognitive testing. Additional validation research is underway to determine the full magnitude of the clinical utility of the NCB.

A Novel Digital Digit-Symbol Substitution Test Measuring Processing Speed in Adults At Risk for Alzheimer Disease: Validation Study

“…Future studies should include individuals with cognitive impairments to assess validity in a broader population segment, as well as assess the ability of the DDSST to discriminate between levels of cognition. Although the test-retest reliability of the DDSST has been verified in a different sample [ 20 ], additional psychometric testing with a representative population is warranted to ensure the full utility of the measure.…”

Time-restricted feeding and cognitive function in sedentary and physically active elderly individuals: Ramadan diurnal intermittent fasting as a model

“…Cognitive function was assessed using the Neurotrack digital cognitive battery. Neurotrack’s cognitive assessments are brief, reliable measures that are based on paradigms previously shown to be sensitive to fluctuations in cognitive function ( 51 – 53 ). Given the assessments are designed in American English, the battery was adapted to fit our sample population.…”

Digital 2-year multidomain health interventions improve cognition and stabilize Alzheimer’s disease risk in at-risk adults (DC-MARVEL): A randomized controlled trial

“…For all measured domains aside from executive function and task-inhibition, higher scores indicate better performance. The NCB is a valid and reliable assessment of neuropsychological status [32][33][34][35][36][37] with excellent ability to discriminate individuals with likely cognitive impairment from healthy controls 33,37 .…”

“…The NCB is an entirely self-administered cognitive battery which was presented to participants on a laptop computer. The battery incorporates tests evaluating and returning continuous scores for six cognitive domains: processing speed, attention, task-inhibition, executive function, associative learning, and associative memory 32,33 . Full descriptions of the six tests in the battery are provided elsewhere 32,33 .…”

“…The battery incorporates tests evaluating and returning continuous scores for six cognitive domains: processing speed, attention, task-inhibition, executive function, associative learning, and associative memory 32,33 . Full descriptions of the six tests in the battery are provided elsewhere 32,33 . Importantly, the NCB platform attempts to address shortcomings present in other digital cognitive batteries through real-time webcam integration to capture additional information outside of test response choice (eye tracking), objective scoring via algorithm, and selfadministration independent of a trained healthcare professional 32 .…”