Dilated Skip Convolution for Facial Landmark Detection

Abstract

Facial landmark detection has gained enormous interest for face-related applications due to its success in facial analysis tasks such as facial recognition, cartoon generation, face tracking and facial expression analysis. Many studies have been proposed and implemented to deal with the challenging problems of localizing facial landmarks from given images, including large appearance variations and partial occlusion. Studies have differed in the way they use the facial appearances and shape information of input images. In our work, we consider facial information within both global and local contexts. We aim to obtain local pixel-level accuracy for local-context information in the first stage and integrate this with knowledge of spatial relationships between each key point in a whole image for global-context information in the second stage. Thus, the pipeline of our architecture consists of two main components: (1) a deep network for local-context subnet that generates detection heatmaps via fully convolutional DenseNets with additional kernel convolution filters and (2) a dilated skip convolution subnet—a combination of dilated convolutions and skip-connections networks—that are in charge of robustly refining the local appearance heatmaps. Through this proposed architecture, we demonstrate that our approach achieves state-of-the-art performance on challenging datasets—including LFPW, HELEN, 300W and AFLW2000-3D—by leveraging fully convolutional DenseNets, skip-connections and dilated convolution architecture without further post-processing.

Reading recognition of pointer meters based on an improved UNet++ network

“…It does this by inserting gaps or holes in the convolutional kernel with different expansion rates. Unlike regular convolutional layers, which have a fixed kernel size and receptive field, dilated convolution has an additional parameter known as the expansion rate [29], which determines the number of intervals between points in the convolution kernel. For instance, a regular 3 × 3 convolution has an expansion rate of 1, with a receptive field of 3 (figure 6(a)).…”

Emotion and Stress Recognition Related Sensors and Machine Learning Technologies

“…Facial-landmark detection was revisited in [ 21 ] in a multistage architecture. At the first stage, the goal was to obtain local pixel-level accuracy for local-context information.…”

Automatic Anthropological Landmarks Recognition and Measurements

“…Wide variety of methods for facial landmarks detection was developed recently, the most effective being related with deep learning techniques (Keustermans et al, 2011, He et al, 2017, Chim et al, 2019. The comprehensive survey of facial landmark extraction (Bodini, 2019) gives an analysis of many state-of-the-art approaches, along with performance comparing and datasets review.…”