Real-Time EEG-Based Cognitive Workload Monitoring on Wearable Devices

Abstract

Cognitive workload monitoring (CWM) can enhance human-machine interaction by supporting task execution assistance considering the operator's cognitive state. Therefore, we propose a machine learning design methodology and a data processing strategy to enable CWM on resourceconstrained wearable devices. Methods: Our CWM solution is built upon edge computing on a simple wearable system, with only four peripheral channels of electroencephalography (EEG). We assess our solution on experimental data from 24 volunteers. Moreover, to overcome the system's memory constraints, we adopt an optimization strategy for model size reduction and a multi-batch data processing scheme for optimizing RAM memory footprint. Finally, we implement our data processing strategy on a state-of-the-art wearable platform and assess its execution and system battery life. Results: We achieve an accuracy of 74.5% and a 74.0% geometric mean between sensitivity and specificity for CWM classification on unseen data. Besides, the proposed model optimization strategy generates a 27.5x smaller model compared to the one generated with default parameters, and the multibatch data processing scheme reduces RAM memory footprint by 14x compared to a single batch data processing. Finally, our algorithm uses only 1.28% of the available processing time, thus, allowing our system to achieve 28.5 hours of battery life. Conclusion: We provide a reliable and optimized CWM solution using wearable devices, enabling more than a day of operation on a single battery charge. Significance: The proposed methodology enables real-time data processing on resource-constrained devices and supports real-time wearable monitoring based on EEG for applications as CWM in human-machine interaction.

Real-time affect detection in virtual reality: a technique based on a three-dimensional model of affect and EEG signals

“…Therefore, RFE might not be suitable for building user-dependent models. This challenge can be solved using Recursive Feature Elimination with Cross Validation (RFECV) (Yin et al, 2017;Akbar et al, 2021;Zanetti et al, 2022), a method similar to RFE that automatically detects the optimal number of features that are required for training a model.…”

An Overview of Approaches and Methods for the Cognitive Workload Estimation in Human–Machine Interaction Scenarios through Wearables Sensors

“…The study of Zanetti et al [90] proposed a ML design methodology and data processing strategy for real-time CW monitoring on resource-constrained wearable devices. The proposed CW monitoring solution achieved an accuracy of 74.5% and a geometric mean of 74.0% between sensitivity and specificity for classification on unseen data.…”

Model-Based ISO 14971 Risk Management of EEG-Based Medical Devices

“…A. e-Glass System Overview e-Glass is a wearable system for real-time monitoring of brain activity, with several biomedical applications including epilepsy [18], cognitive workload [21], and stress monitoring. Figure 5 presents (a) the e-Glass prototype, (b) its system block diagram, and a table that relates the e-Glass subsystems with the interfaces (c).…”