Emotion recognition based on facial components

Abstract

Machine analysis of facial emotion recognition is a challenging and an innovative research topic in human-computer interaction. Though a face displays different facial expressions, which can be immediately recognized by human eyes, it is very hard for a computer to extract and use the information content from these expressions. This paper proposes an approach for emotion recognition based on facial components. The local features are extracted in each frame using Gabor wavelets with selected scales and orientations. These features are passed on to an ensemble classifier for detecting the location of face region. From the signature of each pixel on the face, the eye and the mouth regions are detected using the ensemble classifier. The eye and the mouth features are extracted using normalized semi-local binary patterns. The multiclass Adaboost algorithm is used to select and classify these discriminative features for recognizing the emotion of the face. The developed methods are deployed on the RML, CK and CMU-MIT databases, and they exhibit significant performance improvement owing to their novel features when compared with the existing techniques.

Real‐time regional seismic damage assessment framework based on long short‐term memory neural network

“…Ensemble learning is an effective approach for improving the prediction performance. It has been adopted in many relevant studies (e.g., Gu, Ding, & Zhang, 2015; Y. Liu, Lin, & Chen, 2008; Rani & Muneeswaran, 2018). The basic steps of ensemble learning are as follows: (a) select several LSTM models with good performances; (b) predict the seismic damage of the designated structures by each model separately; (c) integrate all the prediction results (i.e., damage states); and (d) make final decisions using the occurrence probability (noting here that the damage state that has the highest probability of occurrence is regarded as the final prediction result; and if several different damage states have the same occurrence probability, then their median is selected).…”

Time-Frequency Feature-Based Seismic Response Prediction Neural Network Model for Building Structures

“…The method of ensemble learning [87] is used for testing. Specifically, it is done in four steps: (a) Select the five best models from the M 3 model with complex networks; (b) predictions are made for each model on the test dataset; (c) counting all the predictions; (d) the final prediction is determined by the probability of happening (note that, the highest probability of damage state is selected if there are different probabilities of damage states.…”

Employing Video-based Motion Data with Emotion Expression for Retail Product Recognition

“…A study described in [30] suggests a way for emotion recognition-based facial components. It is complete in extracting the local features of the mouth and eye from each frame using GW with selected orientations and scales.…”