Cross-Task Mental Workload Recognition Based on EEG Tensor Representation and Transfer Learning

Abstract

The accurate evaluation of mental workload of operators in human machine systems is of great significance in ensuring the safety of operators and the correct execution of tasks. However, the effectiveness of EEG based cross-task mental workload evaluation are still unsatisfactory because of the different EEG response patterns in different tasks, which hindered its generalization in real scenario severely. To solve this problem, this paper proposed a feature construction method based on EEG tensor representation and transfer learning, which was verified in various task conditions. Specifically, four working memory load tasks with different types of information were designed firstly. The EEG signals of participants were collected synchronously during task execution. Then, the wavelet transform method was used to perform time-frequency analysis of multichannel EEG signals, and three-way EEG tensor (timefrequency-channel) features were constructed. EEG tensor features from different tasks were transferred based on the criteria of feature distribution alignment and classwise discrimination criteria. Finally, the support vector machine was used to construct a 3-class mental workload recognition model. Results showed that compared with the classical feature extraction methods, the proposed method can achieve higher accuracy in both within-task and crosstask mental workload evaluation (91.1% for within-task and 81.3% for cross-task). These results demonstrated that the EEG tensor representation and transfer learning method is feasible and effective for cross-task mental workload evaluation, which can provide theoretical basis and application reference for future researches.

Mental Workload Analysis of Workers Using the Swedish Occupational Fatigue Index (SOFI) Method at A Job Shop, Sheet Metal, And Pipe Metal Manufacturing Company in Surabaya

“…Because the effect is the effect on the intensity of human error and performance, the mental workload is a major emergency and an important problem in a complex work system to find a solution [33]; [34]. Mental workload is a complex construction, and multidimensional [35]; [36]; [37]. The idea of "what is mental workload" has been discussed by many researchers, but there is no definite definition because of its multidimensional and complex nature.…”