Real-time ECG-monitoring in virtual reality

Abstract

Virtual reality (VR) enables new perspectives and approaches for interaction with a computer-generated environment, thus enhancing data science and a variety of applications. An electrocardiogram (ECG) records the heart's electrical activity, allowing insights into its behavior and identifying potential problems. Novel textile shirts with integrated ECG sensors offer convenient and continuous ECG recording. We investigate the feasibility of using such a shirt with textile sensors for real-time monitoring of an ECG signal in VR. We developed an application that wirelessly records and analyzes the ECG from a subject in real-time, visualizing both the ECG itself and the heartbeat in VR. The heartbeat is visualized on an animated, three-dimensional heart model, while the ECG signal is displayed as a time series graph. For analysis, we employ a real-time heartbeat detection algorithm. The recorded signal can be monitored live in the VR environment with a delay of less than 10 ms. Thus, the combination of smart wearables and VR demonstrates how immersive analytics facilitates real-time heart monitoring. Eventually, similar approaches can open new possibilities for training medical personnel as well as educating a broader interested audience.