A spatiotemporal network using a local spatial difference stack block for facial micro-expression recognition

Liang, Yan; Yan, Hao; Liao, Jia-Cheng; Deng, Zhuoran; Wen, Xiaoqing; Zheng, Zefeng; Pan, Jiahui

doi:10.1007/s11042-023-16033-1

Cited by 1 publication

(1 citation statement)

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Micro-expression is a unique facial muscle movement that is spontaneous and not under human control, which better reflects a person's inner real emotion and has wide application in education, interrogation, psychological counselling, and other fields [5]. Micro-expressions are short and subtle in movement, which is difficult for people to perceive through the eye [6]. Therefore, this paper proposes a micro-expression recognition method based on EVM and 3D ResNet.…”

Section: Introductionmentioning

confidence: 99%

Micro-expression recognition based on euler video magnification and 3D residual network under imbalanced sample

Zhu,

He,

Yang

et al. 2024

Eng. Res. Express

View full text Add to dashboard Cite

A student's verbal behavior plays a crucial role in education, while nonverbal behavior, such as micro-expressions, significantly improves teaching quality. To address the problem of small facial expression movements, imbalanced data categories, and lack of temporal information in static expressions, a micro-expression recognition method is proposed based on Eulerian Video Magnification (EVM) and a 3D Residual Network (3D ResNet) under imbalanced samples. Firstly, face detection in the Dlib library is used to locate the face in the micro-expression video sample and crop it. Secondly, the EVM is used to magnify the motion features in micro-expressions. Then, the 3D ResNet is used to extract spatio-temporal information from micro-expression video samples, and the Cyclical Focal Loss (CFL) function is introduced in the network training process to solve the class imbalance problem in micro-expression datasets. Finally, the roles of the EVM and the CFL function in recognizing micro-expressions by the 3D ResNet are analyzed. The experimental results on the Spontaneous Micro-expression Database (SMIC) and Chinese Academy of Sciences Micro-expression Database II (CASME II) demonstrate the effectiveness and superiority of this method. The proposed method can assist in teaching evaluation and promote the development of smart classrooms, and further research is needed on the storage and computing of the proposed method on devices.

show abstract

Section: Introductionmentioning

confidence: 99%