Detecting Freezing of Gait with Earables Trained from VR Motion Capture Data

Abstract

Freezing of Gait (FoG) is a common disabling motor symptom in Parkinson's Disease (PD). Auditory cueing provided when FoG is detected can help mitigate the condition, for which earables are potentially well suited as they are capable of motion sensing and audio feedback. However, there are no studies so far on FoG detection at the ear. Immersive Virtual Reality (VR) combined with video-based full-body motion capture has been increasingly used to run FoG studies in the medical community. While there are motion capture datasets collected in such an environment, there are no datasets collected from IMU placed at the ear. In this paper, we show how to transfer such motion capture datasets to IMU domain and evaluate the capability of FoG detection from ear position in an immersive VR environment. Using a dataset of 6 PD patients, we compare machine learning-based FoG detection applied to the motion capture data and the virtual IMU. We have achieved an average sensitivity of 80.3% and an average specificity of 87.6% on FoG detection using the virtual earable IMU, which indicates the potential of FoG detection at the ear. This study is a step toward user-studies with earables in the VR setup, prior to conducting research in over-ground walking and everyday life. CCS CONCEPTS• Applied computing → Consumer health.

Technological support for people with Parkinson’s disease: a narrative review

“…In several studies, it has been shown that VR systems are often composed of physiological and motion acquisition sensors. These technologies can be extended to detection and intervention on FoG episodes 89 . In 2021, Chen et al 90 studied the effects of a week training with VR device.…”