Physiological signals, such as electroencephalogram (EEG), are used to observe a driver’s brain activities. A portable EEG system provides several advantages, including ease of operation, cost-effectiveness, portability, and few physical restrictions. However, it can be challenging to analyse EEG signals as they often contain various artefacts, including muscle activities, eye blinking, and unwanted noises. This study utilised an independent component analysis (ICA) approach to eliminate such unwanted signals from the unprocessed EEG data of 12 young, physically fit male participants between the ages of 19 and 24 who took part in a driving simulation. Furthermore, driver fatigue state detection was carried out using multichannel EEG signals obtained from O1, O2, Fp1, Fp2, P3, P4, F3, and F4. An enhanced modified z-score was utilised with features extracted from a time-frequency domain continuous wavelet transform (CWT) to elevate the reliability of driver fatigue classification. The proposed methodology offers several advantages. First, multichannel EEG analysis improves the accuracy of sleep stage detection, which is vital for accurate driver fatigue detection. Second, an enhanced modified z-score in feature extraction is more robust than conventional z-score techniques, making it more effective for removing outlier values and improving classification accuracy. Third, the proposed approach for detecting driver fatigue employs multiple machine learning classifiers, such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Artificial Neural Networks (ANNs) that utilise Long Short-Term Memory (LSTM), and also machine learning techniques like Support Vector Machines (SVM). The evaluation of five classifiers was performed through 5-fold cross-validation. The outcomes indicate that the suggested framework attains exceptional precision in identifying driver fatigue, with an average accuracy rate of 96.07%. Among the classifiers, the ANN classifier achieved the most significant precision of 99.65%, and the SVM classifier ranked second with an accuracy of 97.89%. Based on the results of the receiver operating characteristic (ROC) and area under the curve (AUC) analysis, it was observed that all the classifiers had an outstanding performance, with an average AUC value of 0.95. This study’s contribution lies in presenting a comprehensive and effective framework that can accurately detect driver fatigue from EEG signals. ABSTRAK:  Isyarat fisiologi, seperti elektroencefalogram (EEG), digunakan bagi memerhati aktiviti otak pemandu. Sistem EEG mudah alih menyediakan beberapa kelebihan, termasuk kemudahan operasi, keberkesanan kos, mudah alih dan sedikit sekatan fizikal. Namun, isyarat EEG mungkin sukar dianalisis kerana ia sering mengandungi pelbagai artifak, termasuk aktiviti otot, mata berkedip dan bunyi yang tidak diingini. Kajian ini menggunakan pendekatan analisis komponen bebas (ICA) bagi membuang isyarat tidak diperlukan daripada data EEG yang belum diproses daripada 12 peserta lelaki muda, cergas fizikal berumur 19 hingga 24 tahun yang mengambil bahagian dalam simulasi pemanduan. Tambahan, pengesanan keadaan lesu pemandu telah dijalankan menggunakan isyarat EEG berbilang saluran yang diperoleh dari O1, O2, Fp1, Fp2, P3, P4, F3, dan F4. Penambah baik skor z digunakan dengan ciri diekstrak daripada transformasi wavelet berterusan (CWT) domain frekuensi masa bagi meningkatkan kebolehpercayaan klasifikasi keletihan pemandu. Metodologi yang dicadangkan menawarkan beberapa kelebihan. Pertama, analisis EEG berbilang saluran meningkatkan ketepatan pengesanan peringkat tidur, penting bagi pengesanan keletihan pemandu secara tepat. Kedua, penambah baik skor z dalam pengekstrak ciri adalah lebih teguh daripada teknik skor z konvensional, menjadikannya lebih berkesan bagi membuang unsur luaran dan meningkatkan ketepatan pengelasan. Ketiga, pendekatan yang dicadangkan bagi mengesan keletihan pemandu menggunakan pelbagai pengelas pembelajaran mesin, seperti Rangkaian Neural Konvolusi (CNN), Rangkaian Neural Berulang (RNN), Rangkaian Neural Buatan (ANN) yang menggunakan Memori Jangka Pendek Panjang (LSTM), dan juga teknik pembelajaran mesin seperti Mesin Vektor Sokongan (SVM). Penilaian lima pengelas dilakukan melalui pengesahan silang 5 kali ganda. Dapatan kajian menunjukkan cadangan rangka kerja ini mencapai ketepatan yang luar biasa dalam mengenal pasti keletihan pemandu, dengan kadar ketepatan purata 96.07%. Antara kesemua pengelas, pengelas ANN mencapai ketepatan paling ketara sebanyak 99.65%, dan pengelas SVM menduduki tempat kedua dengan ketepatan 97.89%. Berdasarkan keputusan analisis ciri operasi penerima (ROC) dan kawasan di bawah lengkung (AUC), didapati semua pengelas mempunyai prestasi cemerlang, dengan purata nilai AUC 0.95. Sumbangan kajian ini adalah terletak pada rangka kerja yang komprehensif dan berkesan mengesan keletihan pemandu secara tepat melalui isyarat EEG.

No abstract

The prolonged stress needs to be determined and controlled before it harms the physical and mental conditions. This research used questionnaire and physiological approaches in determine stress. EEG signal is an electrophysiological signal to analyze the signal features. The standard features used are peak-to-peak values, mean, standard deviation and root means square (RMS). The unique features in this research are Matthew Correlation Coefficient Advanced (MCCA) and multimodal capabilities in the area of frequency and time-frequency analysis are proposed. In the frequency domain, Power Spectral Density (PSD) techniques were applied while Short Time Fourier Transform (STFT) and Continuous Wavelet Transform (CWT) were utilized to extract seven features based on time-frequency domain. Various methods applied from previous works are still limited by the stress indices. The merged works between quantities score and physiological measurements were enhanced the stress level from three-levels to six stress levels based on music application will be the second contribution. To validate the proposed method and enhance performance between electroencephalogram (EEG) signals and stress score, support vector machine (SVM), random forest (RF), K- nearest neighbor (KNN) classifier is needed. From the finding, RF gained the best performance average accuracy 85% ±10% in Ten-fold and K-fold techniques compared with SVM and KNN.

Blinding of modality has been influenced decision of multimodal in several circumstances. Sometimes, certain electroencephalogram (EEG) signal is omitted to achieve the highest accuracy of performance. Therefore, the aim for this paper is to enhance the multimodal parameters of EEG signals based on music applications. The structure of multimodal is evaluated with performance measure to ensure the implementation of parameter value is valid to apply in the multimodal equation. The modalities’ parameters proposed in this multimodal are weighted stress condition, signal features extraction, and music class. The weighted stress condition was obtained from stress classes. The EEG signal produces signal features extracted from the frequency domain and time-frequency domain via techniques such as power spectrum density (PSD), short-time Fourier transform (STFT), and continuous wavelet transform (CWT). Power value is evaluated in PSD. The energy distribution is derived from STFT and CWT techniques. Two types of music were used in this experiment. The multimodal fusion is tested using a six-performance measurement method. The purposed multimodal parameter shows the highest accuracy is 97.68%. The sensitivity of this study presents over 95% and the high value for specificity is 89.5%. The area under the curve (AUC) value is 1 and the F1 score is 0.986. The informedness values range from 0.793 to 0.812 found in this paper.

The connection between music and human are very synonyms because music could reduce stress. The state of stress could be measured using EEG signal, an electroencephalogram (EEG) measurement which contains an arousal and valence index value. In previous studies, it is found that the Matthew Correlation Coefficient (MCC) performance accuracy is of 85±5%. The arousal indicates strong emotion, and valence indicates positive and negative degree of emotion. Arousal and valence values could be used to measure the accuracy performance. This research focuses on the enhance MCC parameter equation based on arousal and valence values to perform the maximum accuracy percentage in the frequency domain and time-frequency domain analysis. Twenty-one features were used to improve the significance of feature extraction results and the investigated arousal and valence value. The substantial feature extraction involved alpha, beta, delta and theta frequency bands in measuring the arousal and valence index formula. Based on the results, the arousal and valance index is accepted to be applied as parameters in the MCC equations. However, in certain cases, the improvement of the MCC parameter is required to achieve a high accuracy percentage and this research proposed Matthew correlation coefficient advanced (MCCA) in order to improve the performance result by using a six sigma method. In conclusion, the MCCA equation is established to enhance the existing MCC parameter to improve the accuracy percentage up to 99.9% for the arousal and valence index.