Background: Clinical measures in multiple sclerosis (MS) face limitations that may be overcome by utilising smartphone keyboard interactions acquired continuously and remotely during regular typing. Objective: The aim of this study was to determine the reliability and validity of keystroke dynamics to assess clinical aspects of MS. Methods: In total, 102 MS patients and 24 controls were included in this observational study. Keyboard interactions were obtained with the Neurokeys keyboard app. Eight timing-related keystroke features were assessed for reliability with intraclass correlation coefficients (ICCs); construct validity by analysing group differences (in fatigue, gadolinium-enhancing lesions on magnetic resonance imaging (MRI), and patients vs controls); and concurrent validity by correlating with disability measures. Results: Reliability was moderate in two (ICC = 0.601 and 0.742) and good to excellent in the remaining six features (ICC = 0.760–0.965). Patients had significantly higher keystroke latencies than controls. Latency between key presses correlated the highest with Expanded Disability Status Scale ( r = 0.407) and latency between key releases with Nine-Hole Peg Test and Symbol Digit Modalities Test (ρ = 0.503 and r = −0.553, respectively), ps < 0.001. Conclusion: Keystroke dynamics were reliable, distinguished patients and controls, and were associated with clinical disability measures. Consequently, keystroke dynamics are a promising valid surrogate marker for clinical disability in MS.
Background To investigate smartphone keystroke dynamics (KD), derived from regular typing, on sensitivity to relevant change in disease activity, fatigue, and clinical disability in multiple sclerosis (MS). Methods Preplanned interim analysis of a cohort study with 102 MS patients assessed at baseline and 3‐month follow‐up for gadolinium‐enhancing lesions on magnetic resonance imaging, relapses, fatigue and clinical disability outcomes. Keyboard interactions were unobtrusively collected during typing using the Neurokeys App. From these interactions 15 keystroke features were derived and aggregated using 16 summary and time series statistics. Responsiveness of KD to clinical anchor‐based change was assessed by calculating the area under the receiver operating characteristic curve (AUC). The optimal cut‐point was used to determine the minimal clinically important difference (MCID) and compared to the smallest real change (SRC). Commonly used clinical measures were analyzed for comparison. Results A total of 94 patients completed the follow‐up. The five best performing keystroke features had AUC‐values in the range 0.72–0.78 for change in gadolinium‐enhancing lesions, 0.67–0.70 for the Checklist Individual Strength Fatigue subscale, 0.66–0.79 for the Expanded Disability Status Scale, 0.69–0.73 for the Ambulation Functional System, and 0.72–0.75 for Arm function in MS Questionnaire. The MCID of these features exceeded the SRC on group level. KD had higher AUC‐values than comparative clinical measures for the study outcomes, aside from ambulatory function. Conclusions Keystroke dynamics demonstrated good responsiveness to changes in disease activity, fatigue, and clinical disability in MS, and detected important change beyond measurement error on group level. Responsiveness of KD was better than commonly used clinical measures.
Background Typing on smartphones, which has become a near daily activity, requires both upper limb and cognitive function. Analysis of keyboard interactions during regular typing, that is, keystroke dynamics, could therefore potentially be utilized for passive and continuous monitoring of function in patients with multiple sclerosis. Objective To determine whether passively acquired smartphone keystroke dynamics correspond to multiple sclerosis outcomes, we investigated the association between keystroke dynamics and clinical outcomes (upper limb and cognitive function). This association was investigated longitudinally in order to study within-patient changes independently of between-patient differences. Methods During a 1-year follow-up, arm function and information processing speed were assessed every 3 months in 102 patients with multiple sclerosis with the Nine-Hole Peg Test and Symbol Digit Modalities Test, respectively. Keystroke-dynamics data were continuously obtained from regular typing on the participants’ own smartphones. Press-and-release latency of the alphanumeric keys constituted the fine motor score cluster, while latency of the punctuation and backspace keys constituted the cognition score cluster. The association over time between keystroke clusters and the corresponding clinical outcomes was assessed with linear mixed models with subjects as random intercepts. By centering around the mean and calculating deviation scores within subjects, between-subject and within-subject effects were distinguished. Results Mean (SD) scores for the fine motor score cluster and cognition score cluster were 0.43 (0.16) and 0.94 (0.41) seconds, respectively. The fine motor score cluster was significantly associated with the Nine-Hole Peg Test: between-subject β was 15.9 (95% CI 12.2-19.6) and within-subject β was 6.9 (95% CI 2.0-11.9). The cognition score cluster was significantly associated with the Symbol Digit Modalities Test between subjects (between-subject β –11.2, 95% CI –17.3 to –5.2) but not within subjects (within-subject β –0.4, 95% CI –5.6 to 4.9). Conclusions Smartphone keystroke dynamics were longitudinally associated with multiple sclerosis outcomes. Worse arm function corresponded with longer latency in typing both across and within patients. Worse processing speed corresponded with higher latency in using punctuation and backspace keys across subjects. Hence, keystroke dynamics are a potential digital biomarker for remote monitoring and predicting clinical outcomes in patients with multiple sclerosis. Trial Registration Netherlands Trial Register NTR7268; https://trialsearch.who.int/Trial2.aspx?TrialID=NTR7268
Within data gathered through passive monitoring of patients with Multiple Sclerosis (MS), there is a clear necessity for improved methodological approaches to match the emergence of continuous, objective, measuring technologies. As most gold standards measure infrequently and require clinician presence, fluctuations in the daily progression are not accounted for. Due to the underlying conditions of homogeneity and stationarity (the main tenets of ergodicity) not being met for the majority of the statistical methods employed in the clinical setting, alternative approaches should be investigated. A solution is to use a non-linear time series analysis approach. Here, Early-Warning Signals (EWS) in the form of critical fluctuations in Keystroke Dynamics (KD), collected using participant’s smartphones, are investigated as indicators for a clinical change in three groups. These are patients with MS and changes in Magnetic Resonance Imaging (MRI), patients with MS but without changes in MRI, and healthy controls (HCs). Here, we report examples of EWS and changes in KD coinciding with clinically relevant changes in outcome measures in both patients with and without differences in the amount of MRI enhancing lesions. We also report no clinically relevant changes in EWS in the HC population. This study is a first promising step toward using EWS to identify periods of instability as measured by a continuous objective measure as a proxy for outcome measures in the field of MS.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2025 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.