Situational awareness is the ability of pilots to master flight status, which is of great significance to aviation flight safety and flight effect. According to the information processing model, the pilot’s main steps of processing information are feeling, perception and execution. There are many problems in situation awareness analysis guided by visual gaze, such as large analysis deviation and high delay due to various influencing factors and complex characteristics. In order to solve this problem, this paper proposes a situation awareness assessment method based on artificial intelligence neural network and integrating visual gaze and flight control. First, this paper carries out simulated flight training experiments for flight cadets, and collects the data of eye movement, line of sight tracking, flight control and flight parameters of pilot cadets. Then, aiming at the flight subjects, a situation awareness analysis method based on events is established, and the situation awareness state in the experiment is evaluated and analyzed through the flight parameter data. Then, the visual gaze and flight control data are sliced in the unit of situational awareness events, and the data set is constructed. Finally, this paper designs a multi-channel sequence data classification and analysis model based on transformer, in which the situation awareness characteristics of visual gaze and operation behavior are analyzed through the attention mechanism. The experimental results show that the accuracy of situation awareness classification of the designed neural network model to the experimental data set is 96%, and can classify and evaluate the pilot’s situation awareness state in 5[Formula: see text]s.

No abstract

EEG has been proved to be an effective tool for researchers’ cognition and mental workload by detecting the changes of brain activity potential. The mental workload of pilots in aviation flight is closely related to the characteristics of flight tasks. The previous methods have problems such as lack of objectivity, low EEG analysis ability and lack of real-time analysis ability. In order to solve these problems, this paper proposes a multi-dimensional data fusion brain workload calculation method based on flight effect evaluation, which integrates vision, operational behavior and visual gaze, and classifies and analyzes them in combination with EEG data. This method evaluates the mental workload of pilots from three aspects: visual gaze behavior, control behavior and flight effect in the simulated flight experimental environment, and realizes a more objective mental workload analysis. Then, the synchronously collected EEG data are segmented and sampled to form a dataset, and an LSTM neural network model integrating attention mechanism is established, in which the attention mechanism is used to improve the feature processing ability of the network model for the classification of complex EEG data. After machine learning training, the final model can achieve 94% detection accuracy for 2-s EEG data, and has the ability of real-time analysis in the application environment. Compared with the previous similar LSTM model, the accuracy is improved by 6%, which also shows the effectiveness of the model.

Situational awareness is the ability of pilots to master flight status, which is of great significance to aviation flight safety and flight effect. According to the information processing model, the pilot's main steps of processing information are feeling, perception and execution. There are many problems in situation awareness analysis guided by visual gaze, such as large analysis deviation and high delay due to various influencing factors and complex characteristics. In order to solve this problem, this paper proposes a situation awareness assessment method based on artificial intelligence neural network and integrating visual gaze and flight control. Firstly, this paper carries out simulated flight training experiments for flight cadets, and collects the data of eye movement, line of sight tracking, flight control and flight parameters of pilot cadets. Then, aiming at the flight subjects, a situation awareness analysis method based on events is established, and the situation awareness state in the experiment is evaluated and analyzed through the flight parameter data. Then, the visual gaze and flight control data are sliced in the unit of situational awareness events, and the data set is constructed. Finally, this paper designs a multi-channel sequence data classification and analysis model integrating transformer, in which the situation awareness characteristics of visual gaze and operation behavior are analyzed through the attention mechanism. The experimental results show that the accuracy of situation awareness classification of the designed neural network model to the experimental data set is 96%, and can classify and evaluate the pilot's situation awareness state in 5 seconds.