Test–Retest Reliability and Reliable Change Estimates for Four Mobile Cognitive Tests Administered Virtually in Community-Dwelling Adults

Abstract

Objective: Remote mobile cognitive testing (MCT) is an expanding area of research, but psychometric data supporting these measures are limited. We provide preliminary data on test–retest reliability and reliable change estimates in four MCTs from SWAY Medical, Inc.Methods: Fifty-five adults from the U.S. Midwest completed the MCTs remotely on their personal mobile devices once per week for 3 consecutive weeks, while being supervised with a video-based virtual connection. The cognitive assessment measured simple reaction time (“Reaction Time”), go/no-go response inhibition (“Impulse Control”), timed visual processing (“Inspection Time”), and working memory (“Working Memory”). For each cognitive test except Working Memory, we analyzed both millisecond (ms) responses and an overall SWAY composite score.Results: The mean age of the sample was 26.69years (SD=9.89; range=18–58). Of the 55 adults, 38 (69.1%) were women and 49 (89.1%) used an iPhone. Friedman’s ANOVAs examining differences across testing sessions were nonsignificant (ps>0.31). Intraclass correlations for Weeks 1–3 were: Reaction Time (ms): 0.83, Reaction Time (SWAY): 0.83, Impulse Control (ms): 0.68, Impulse Control (SWAY): 0.80, Inspection Time (ms): 0.75, Inspection Time (SWAY): 0.75, and Working Memory (SWAY): 0.88. Intraclass correlations for Weeks 1–2 were: Reaction Time (ms): 0.75, Reaction Time (SWAY): 0.74, Impulse Control (ms): 0.60, Impulse Control (SWAY): 0.76, Inspection Time (ms): 0.79, Inspection Time (SWAY): 0.79, and Working Memory (SWAY): 0.83. Natural distributions of difference scores were calculated and reliable change estimates are presented for 70, 80, and 90% CIs.Conclusion: Test–retest reliability was adequate or better for the MCTs in this virtual remote testing study. Reliable change estimates allow for the determination of whether a particular level of improvement or decline in performance is within the range of probable measurement error. Additional reliability and validity data are needed in other age groups.

Students Attitude and Behavior towards Circular Economy to Achieve Sustainable Development Goals

“…Test-half and test-retest can also be used to measure consistency (Van Patten et al, 2021). However, in this article the researcher did not implement the mentioned steps.…”

Pupillometry as a new window to player fatigue? A glimpse inside the eyes of a Euro Cup Women’s Basketball team

“…To verify whether any pupillometrics could detect a significant change in game-induced fatigue and recovery, participants were instructed to go through a comprehensive fatigue test battery at each allocated timepoint (i.e., baseline, GD-1, GD+1, GD+2). The fatigue test battery consisted of the pupil test in combination with four other fatigue tests: cognitive fatigue test (i.e., visuomotor reaction time) [ 35 , 36 ], lower-extremity muscle fatigue test (standing postural sway) [ 37 , 38 ], perceptual fatigue test (self-perceived exertion) [ 38 ], and ANS fatigue test (heart rate variability indices) [ 40 – 44 ]. More specifically, upon arrival to the clinical testing room, the player was instructed to wear the Polar H10 heart rate chest strap (Polar…”

Test-Retest reliability and preliminary reliable change estimates for Sway Balance tests administered remotely in community-dwelling adults

“…Participants were recruited and enrolled as part of a study examining the test-retest reliability of the Sway Balance and Cognitive tests. We report findings relevant to Sway Balance tests herein; outcomes from Sway Cognitive tests, including reaction time measures are reported elsewhere ( 43 ). There were 61 adults, aged 18 and older, who were recruited and enrolled in the study.…”

“…Participants were also excluded if they could not use the Sway Balance Mobile Application (i.e., if they did not have a mobile device capable of downloading the application) or if they could not maintain video conferences on a second device during the testing session for video monitoring. As noted in our prior work, of the 61 participants who enrolled in the study, one withdrew from the study due to unforeseen medical issues, one withdrew due a time commitment, and four were removed due to equipment failure that prevented their data from being recorded ( 43 ). All participants provided written informed consent and the study procedures were approved by the university's Institutional Review Board.…”