Mastering Occlusions by Using Intelligent Facial Frameworks Based on the Propagation of Movement

Poux, Delphine; Allaert, Benjamin; Mennesson, José; Ihaddadene, Nacim; Bilasco, Loan Marius; Dieraba, Chabane

doi:10.1109/cbmi.2018.8516503

Cited by 5 publications

(2 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Hence, if a region is occluded then it is possible to focus on the movement information that has been propagated to neighbouring regions. This paper is an extension of our previous work [21] where specific facial frameworks (i.e., specific sets of facial regions) are constructed per expression, according to the importance of each facial region to recognize the underlying expression in presence of specific occlusions. Only the most relevant regions are selected in order to be robust to both small and large occlusions.…”

Section: Introductionmentioning

confidence: 99%

Facial expressions analysis under occlusions based on specificities of facial motion propagation

Poux

Allaert

Mennesson

et al. 2020

Multimed Tools Appl

Self Cite

View full text Add to dashboard Cite

Although much progress has been made in the facial expression analysis field, facial occlusions are still challenging. The main innovation brought by this contribution consists in exploiting the specificities of facial movement propagation for recognizing expressions in presence of important occlusions. The movement induced by an expression extends beyond the movement epicenter. Thus, the movement occurring in an occluded region propagates towards neighboring visible regions. In presence of occlusions, per expression, we compute the importance of each unoccluded facial region and we construct adapted facial frameworks that boost the performance of per expression binary classifier. The output of each expression-dependant binary classifier is then aggregated and fed into a fusion process that aims constructing, per occlusion, a unique model that recognizes all the facial expressions considered. The evaluations highlight the robustness of this approach in presence of significant facial occlusions.

show abstract

Section: Introductionmentioning

confidence: 99%

Facial expressions analysis under occlusions based on specificities of facial motion propagation

Poux

Allaert

Mennesson

et al. 2020

Multimed Tools Appl

Self Cite

View full text Add to dashboard Cite

show abstract

“…The analysis of the facial movement through optical flow seems to offer a promising avenue of research for expression analysis. It is mainly used for its ability to characterize both intense and subtle movements [1], as well as being able to correct head pose variations [2], or to deal with partial facial occlusions [3].…”

Section: Introductionmentioning

confidence: 99%

Optical Flow Techniques for Facial Expression Analysis -- a Practical Evaluation Study

Allaert¹,

Ward²,

Bilasco³

et al. 2019

Preprint

View full text Add to dashboard Cite

Optical flow techniques are becoming increasingly performant and robust when estimating motion in a scene, but their performance has yet to be proven in the area of facial expression recognition. In this work, a variety of optical flow approaches are evaluated across multiple facial expression datasets, so as to provide a consistent performance evaluation. Additionally, the strengths of multiple optical flow approaches are combined in a novel data augmentation scheme. Under this scheme, increases in average accuracy of up to 6% (depending on the choice of optical flow approaches and dataset) have been achieved.

show abstract

A Study on Facial Expression Recognition in Assessing Teaching Skills: Datasets and Methods

Utami

Hartanto

Soesanti

2019

Procedia Computer Science

View full text Add to dashboard Cite

Mastering Occlusions by Using Intelligent Facial Frameworks Based on the Propagation of Movement

Cited by 5 publications

References 9 publications

Facial expressions analysis under occlusions based on specificities of facial motion propagation

Facial expressions analysis under occlusions based on specificities of facial motion propagation

Optical Flow Techniques for Facial Expression Analysis -- a Practical Evaluation Study

A Study on Facial Expression Recognition in Assessing Teaching Skills: Datasets and Methods

Contact Info

Product

Resources

About