A Hybrid Deep Neural Network Approach to Recognize Driving Fatigue Based on EEG Signals

Abstract

Electroencephalography (EEG) data serve as a reliable method for fatigue detection due to their intuitive representation of drivers’ mental processes. However, existing research on feature generation has overlooked the effective and automated aspects of this process. The challenge of extracting features from unpredictable and complex EEG signals has led to the frequent use of deep learning models for signal classification. Unfortunately, these models often neglect generalizability to novel subjects. To address these concerns, this study proposes the utilization of a modified deep convolutional neural network, specifically the Inception‐dilated ResNet architecture. Trained on spectrograms derived from segmented EEG data, the network undergoes analysis in both temporal and spatial‐frequency dimensions. The primary focus is on accurately detecting and classifying fatigue. The inherent variability of EEG signals between individuals, coupled with limited samples during fatigue states, presents challenges in fatigue detection through brain signals. Therefore, a detailed structural analysis of fatigue episodes is crucial. Experimental results demonstrate the proposed methodology’s ability to distinguish between alertness and sleepiness, achieving average accuracy rates of 98.87% and 82.73% on Figshare and SEED‐VIG datasets, respectively, surpassing contemporary methodologies. Additionally, the study examines frequency bands’ relative significance to further explore participants’ inclinations in states of alertness and fatigue. This research paves the way for deeper exploration into the underlying factors contributing to mental fatigue.