Real-time 3D surface modeling for image based relighting

Ryu, Sae-Woon; Lee, Sang Hwa; Park, Jong-Il

doi:10.1109/tce.2009.5373820

Cited by 3 publications

(2 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is like the deformation ofŜ. The deformation function based on radial basis functions (RBF) has the form (6) where p j is the j-th vertex ofŜ, p …”

Section: D Face Deformationmentioning

confidence: 99%

“…Some efforts have been made to solve this problem, such as using high resolution inputs taken under an ideal illumination condition [3], or adopting a 3D generic face as a constraint [5]. Ryu et al [6] used stereo lights to generate 3D faces, while the setup is likely to limit its applications. Statistical morphable models have been widely used in virtual face synthesizing and face recognition.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Pose-Free Face Swapping Based on a Deformable 3D Shape Morphable Model

Lin

Wang

2014

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYTraditional face swapping technologies require that the faces of source images and target images have similar pose and appearance (usually frontal). For overcoming this limit in applications this paper presents a pose-free face swapping method based on personalized 3D face modeling. By using a deformable 3D shape morphable model, a photorealistic 3D face is reconstructed from a single frontal view image. With the aid of the generated 3D face, a virtual source image of the person with the same pose as the target face can be rendered, which is used as a source image for face swapping. To solve the problem of illumination difference between the target face and the source face, a color transfer merging method is proposed. It outperforms the original color transfer method in dealing with the illumination gap problem. An experiment shows that the proposed face reconstruction method is fast and efficient. In addition, we have conducted experiments of face swapping in a variety of scenarios such as children's story book, role play, and face de-identification stripping facial information used for identification, and promising results have been obtained.

show abstract

“…It is like the deformation ofŜ. The deformation function based on radial basis functions (RBF) has the form (6) where p j is the j-th vertex ofŜ, p …”

Section: D Face Deformationmentioning

confidence: 99%