Contour-based 3D Face Modeling from a Monocular Video

Abstract

Constructing 3D models from video is one of the most important problems in computer vision. We propose a novel 3D face modeling approach from monocular video captured by a conventional camera. An algorithm is proposed to estimate the head pose by comparing the edges of video frame, and the contours extracted from a generic face model. A generic 3D face model is assumed to be the initial estimate of the true 3D model. The generic face model is adapted to the actual 3D face model by global and local deformations. An affine model is used for global deformation. The 3D model is locally deformed by computing the v 4.1 Subject A: Video frames used for 3D model reconstruction. .. . 4.2 (a): Generic mesh after global affine deformation (b): Optimal perturbations applied to each control point to obtain the final adapted model. Green: Perturbation along X-axis (width), Red: Perturbation along Y-axis (height), Blue: Perturbation along Zaxis (depth).

Fast texture-based tracking and delineation using texture entropy

“…The contours used for most tracking applications are extracted either based on local gradient information [2,3] or edge distance transform [4,5,6,7]. These methods are appealing due to their simplicity and speed, but their application is restricted to the cases where the contrast is sufficient.…”

LiveMail

“…Also, there have been methods that included use of two cameras placed at certain angle and algorithms for picture processing to create 3D model [8]. Some other methods, like in [9], use three perspective images taken from a different angles to adjust deformable contours on a generic head model.…”

Image normalization for face recognition using 3D model

“…However some rely on the contour based approach. Different contour define the shape of the object for outlining it along with covering the feature inside an object [23]. Landmark based models however provide the exact location of the features inside the object.…”