Testing a Novel Web-Based Neurocognitive Battery in the General Community: Validation and Usability Study

Abstract

Background In recent years, there has been increased interest in the development of remote psychological assessments. These platforms increase accessibility and allow clinicians to monitor important health metrics, thereby informing patient-centered treatment. Objective In this study, we report the properties and usability of a new web-based neurocognitive assessment battery and present a normative data set for future use. Methods A total of 781 participants completed a portion of 8 tasks that captured performance in auditory processing, visual-spatial working memory, visual-spatial learning, cognitive flexibility, and emotional processing. A subset of individuals (n=195) completed a 5-question survey measuring the acceptability of the tasks. Results Between 252 and 426 participants completed each task. Younger individuals outperformed their older counterparts in 6 of the 8 tasks. Therefore, central tendency data metrics were presented using 7 different age bins. The broad majority of participants found the tasks interesting and enjoyable and endorsed some interest in playing them at home. Only 1 of 195 individuals endorsed not at all for the statement, “I understood the instructions.” Older individuals were less likely to understand the instructions; however, 72% (49/68) of individuals over the age of 60 years still felt that they mostly or very much understood the instructions. Conclusions Overall, the tasks were found to be widely acceptable to the participants. The use of web-based neurocognitive tasks such as these may increase the ability to deploy precise data-informed interventions to a wider population.

Web-based cognitive assessment in older adults: Where do we stand?

“…Due to the unsupervised nature of such tests, it is especially critical to assess and report measures of user experience. User experience studies find that most older adults successfully understand and complete online tasks [24,[39][40][41], even though they subjectively report greater anxiety and difficulty than younger adults [28]. Studies have indicated relatively positive user experiences and comparable scores across variations in familiarity or attitudes to technology use [24,27 & ,41].…”

“…Rigorous data examination and cleaning are imperative when handling large online datasets [36 ▪ ]. Furthermore, test developers should pay attention to task adaptations for older adults, such as clear task instructions, more practice trials, video tutorials, or a lower/adaptive starting difficulty [39,45].…”

Visualization and Interaction Technologies in Serious and Exergames for Cognitive Assessment and Training: A Survey on Available Solutions and Their Validation

“…Consoles with monitor and projectors [8], [9], [15], [23], [145]- [159] 19 PC and mobile [3], [21], [32], [33], [48], [144], [160]- [168] 15 Not specified [49], [169] 2…”

“…Mouse and keyboard [1], [3], [9]- [11], [18], [21], [28], [32]- [34], [38], [45], [48], [51], [54], [56], [61], [64], [68], [69], [73], [76], [80]- [85], [90], [91], [96], [98]- [100], [102]- [108],…”

“…[77] EEG [2], [53], [75], [93], [110] Treadmill/pressure plate/cycle ergometer [22], [88], [94] [13], [19], [26], [31], [36], [37], [39], [41], [43], [44], [122]- [124], [126], [127], [3], [21], [32], [33], [48], [144], [160], [162]- [168] Touchful and body tracking [38], [40] VR Semi-Immersive Driving simulator Driving tool [170], [171]…”