Facial Landmark Detection Using Generative Adversarial Network Combined with Autoencoder for Occlusion

Abstract

The performance of the facial landmark detection model will be in trouble when it is under occlusion condition. In this paper, we present an effective framework with the objective of addressing the occlusion problem for facial landmark detection, which includes a generative adversarial network with improved autoencoders (GAN-IAs) and deep regression networks. In this model, GAN-IA can restore the occluded face region by utilizing skip concatenation among feature maps to keep more details. Meanwhile, self-attention mechanism that is effective in modeling long-range dependencies is employed to recover harmonious images for occluded faces. Deep regression networks are used to learn a nonlinear mapping from facial appearance to facial shape. Benefited from the mutual cooperation of GAN-IA and deep regression networks, a robust facial landmark detection model is achieved for the occlusion problem and the performance of the model achieves obviously improvement on challenging datasets.

Design and Implementation of Group Animation Based on Multimedia Intelligent Algorithm

“…Liu et al extended "Xiaoyuan's fish" and independently modeled each character by using cognitive model, vividly and realistically simulating the crowd of people coming and going from the station. The characters in the system have cognitive and behavioral abilities, such as queuing to buy tickets before entering the station, sitting on a chair when tired, queuing to buy drinks when thirsty, and watching street performances [12]. Zhu studied the part design of the role model and its specific implementation technology, combined with the idea of animation design, applied the behavior theory of steering to the group animation design, and designed the group animation design method based on intelligent roles.…”

Application Research on Face Image Evaluation Algorithm of Deep Learning Mobile Terminal for Student Check-In Management

“…In face detection, overfitting is one of the main reasons for the low accuracy of face detection. When the model is overfitted, the classification cannot be carried out when new samples appear because there is more noise in the training set, resulting in insufficient adaptability of the model [ 21 ]. There are many image choices in face detection, and the problem of detection ability will appear when the details or noise are received in the learning of sample data.…”