MIFAD-Net: Multi-Layer Interactive Feature Fusion Network With Angular Distance Loss for Face Emotion Recognition

Abstract

Understanding human emotions and psychology is a critical step toward realizing artificial intelligence, and correct recognition of facial expressions is essential for judging emotions. However, the differences caused by changes in facial expression are very subtle, and different expression features are less distinguishable, making it difficult for computers to recognize human facial emotions accurately. Therefore, this paper proposes a novel multi-layer interactive feature fusion network model with angular distance loss. To begin, a multi-layer and multi-scale module is designed to extract global and local features of facial emotions in order to capture part of the feature relationships between different scales, thereby improving the model's ability to discriminate subtle features of facial emotions. Second, a hierarchical interactive feature fusion module is designed to address the issue of loss of useful feature information caused by layer-by-layer convolution and pooling of convolutional neural networks. In addition, the attention mechanism is also used between convolutional layers at different levels. Improve the neural network's discriminative ability by increasing the saliency of information about different features on the layers and suppressing irrelevant information. Finally, we use the angular distance loss function to improve the proposed model's inter-class feature separation and intra-class feature clustering capabilities, addressing the issues of large intra-class differences and high inter-class similarity in facial emotion recognition. We conducted comparison and ablation experiments on the FER2013 dataset. The results illustrate that the performance of the proposed MIFAD-Net is 1.02–4.53% better than the compared methods, and it has strong competitiveness.

Algorithm Composition and Emotion Recognition Based on Machine Learning

“…These levels encompass not only specific technical methods of theoretical techniques and mathematical operations, but also a deeper expression of human thought. Music comes from life and reflects the creators' emotions [ 4 ]. Music is a psychological process that includes a variety of human emotional factors that are produced when people interact with music.…”

Emotional Analysis Model for Social Hot Topics of Professional Migrant Workers

“…Through human-computer interaction and fuzzy cognitive evaluation, the quantitative relationship among personality characteristics, mood state, and emotional state is described. On this basis, a virtual human integrating sensibility and rationality is proposed, and then a multiobjective decision-making problem-solving method based on hierarchical emotional cognitive model [ 8 ] is given. The visual signals are linearly fused with four physiological signals to obtain four groups of multimodal information [ 9 ].…”

Emotional Experience and Psychological Intervention of Depression Patients Based on SOM

“…Currently, the rate of depression recognition is low, and the proportion of patients who can be identified and treated in a timely, sufficient, and adequate manner is even lower [ 2 ]. Depression is a complex negative emotional [ 3 , 4 ] experience characterised by subjective distress. The most recent findings from the China Mental Health Survey are as follows.…”