Deep Spatio-Temporal Decision Fusion Network for Facial Expression Recognition

Chen, Xuanchi; Yang, Heng; Zhang, Xia; Zheng, Xiangwei; Li, Wei

doi:10.1007/978-3-031-20102-8_9

Cited by 1 publication

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The RRN is composed of surface and semantic representation reinforcement modules. In [11], a spatio-temporal decision fusion network is addressed for AFER. In order to extract temporal information, the FE sequences are first split into four sub-sequences according to facial areas.…”

Section: Related Workmentioning

confidence: 99%

Modelling appearance variations in expressive and neutral face image for automatic facial expression recognition

Kumar H N,

M S,

Asif Shah

et al. 2024

IET Image Processing

View full text Add to dashboard Cite

In automatic facial expression recognition (AFER) systems, modelling the spatio‐temporal feature information in a specific manner, coalescing, and its effective utilization is challenging. The state‐of‐the‐art studies have examined integrating multiple features to enhance the recognition rate of AFER systems. However, the feature variations between expressive and neutral face images are not fully explored to identify the expression class. The proposed research presents an innovative approach to AFER by modelling appearance variations in both expressive and neutral face images. The prominent contributions of the work are developing a novel and hybrid feature space by integrating the discriminative feature distribution derived from expressive and neutral face images; preserving the highly discriminative latent feature distribution using autoencoders. Local binary pattern (LBP) and histogram of oriented gradients (HOG) are the feature descriptors employed to derive the discriminative texture and shape information, respectively. The component‐based approach is employed, wherein the features are derived from the salient facial regions instead of the whole face. The three‐stage stacked deep convolutional autoencoder (SDCA) and multi‐class support vector machine (MSVM) are employed to address dimensionality reduction and classification, respectively. The efficacy of the proposed model is substantiated by empirical findings, which establish its superiority in terms of accuracy in AFER tasks on widely recognized benchmark datasets.

show abstract

Section: Related Workmentioning

confidence: 99%