Stacked deep convolutional auto-encoders for emotion recognition from facial expressions

Abstract

Emotion recognition is critical for everyday living and is essential for meaningful interaction. If we are to progress towards human and machine interaction that is engaging the human user, the machine should be able to recognise the emotional state of the user. Deep Convolutional Neural Networks (CNN) have proven to be efficient in emotion recognition problems. The good degree of performance achieved by these classifiers can be attributed to their ability to self-learn a down-sampled feature vector that retains spatial information through filter kernels in Convolutional layers. Given the view that randomized initialization of weights can lead to convergence in non-optimal local minima, in this paper we explore the impact of training the initial weights in an unsupervised manner. We study the effect of pre-training a Deep CNN as a Stacked Convolutional Auto-Encoder (SCAE) in a greedy layer-wise unsupervised fashion for emotion recognition using facial expression images. When trained with randomly initialized weights, our CNN emotion recognition model achieves a performance rate of 91.16% on the Karolinska Directed Emotional Faces (KDEF) dataset. In contrast, when each layer of the model, including the hidden layer, is pre-trained as an Auto-Encoder, the performance increases to 92.52%. Pre-training our CNN as a SCAE also reduces training time marginally. The emotion recognition model developed in this work will form the basis of real-time empathic robot system.

Local Feature Hashing With Binary Auto-Encoder for Face Recognition

“…Then, they introduce the similarity preservation term into the supervised auto-encoder to extract robust representations for single sample per person face recognition. The work [23] employs the stacked auto-encoder to pre-train the weights of the deep CNN and improves the performance of the facial emotion recognition. Xu et al [24] use two shallow neural networks to connect two auto-encoders to deal with the age-invariant face recognition and retrieval problems.…”

Facial Expressions Recognition in Thermal Images based on Deep Learning Techniques

“…At the fully connected layer, the output unit activation of the network made by softmax function which calculates the probability distribution of K different possible outcomes. After training, the network uses the cross entropy to indicate the distance between the experimental output and the expected output [20].…”

Customer Satisfaction Measuring Based on the Most Significant Facial Emotion

“…The most popular supervised machine learning algorithms [17] are: Support vector machine (SVM) [18], knearest neighbors (KNN) [19], Convolutional Neural Networks (CNN) [20]. However, generally these methods could require a large number of attempts to move towards the best possible recognition performance [21].…”