Modified classification and regression tree for facial expression recognition with using difference expression images

Abstract

This study presents a modified classification and regression tree (M‐CRT) framework based on difference expression images, to address the facial expression recognition (FER) problem. The authors firstly obtain facial expressional details by calculating the difference between the images of basic expressions and images of neutral expression, which reflect the information irrelevant to identities. Local binary patterns and supervised descent method are, respectively, used to obtain the global and local features from difference expression images. M‐CRT model is developed for FER, which uses recursive segmentation to find the best classification decision according to the attributes of the global and local features, respectively. Compared with traditional methods, M‐CRT can simultaneously maximise intra‐class purity and distance between classes, which improves the discriminating power for classification. Experimental results on Japanese Female Facial Expression and CK+ database verify the effectiveness of their method.

Facial expression recognition techniques: a comprehensive survey

“…Du and Hu [51] proposed a modified classification and regression tree (M-CRT) to identify the unpredictable changes in expression. The proposed method was modelled with a regressive segmental threshold which minimises both intra-class impurity and inter-class difference to attain better feature representation and classification.…”

Multiple Instance Learning for Human Emotion Analysis Using Gabor Features

“…The classification and regression of different facial expression is discussed in [13]. The local binary pattern with global features and six distance vector are extracted for expression analysis using SVM classifier.…”