Closed-loop dialog model of face-to-face communication with a photo-real virtual human

Kiss, Bernadette; Benedek, Balázs; Szijártó, Gábor; Takács, Barnabás

doi:10.1117/12.526211

Cited by 5 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our research is related to emotional appearance and multiple levels of emotion generation in affective computing [3]. The challenging aspects in realistic facial expression synthesis are capturing details of facial expression including small nuances [4] in different persons and generating new stylized expressions with the control of expressiveness. We learn nonlinear mapping of facial motions in order to capture nonlinear deformations in facial expressions.…”

Section: Introductionmentioning

confidence: 99%

Synthesis and Control of High Resolution Facial Expressions for Visual Interactions

Lee

Elgammal

Metaxas

2006

2006 IEEE International Conference on Multimedia and Expo

View full text Add to dashboard Cite

The synthesis of facial expression with control of intensity and personal styles is important in intelligent and affective human-computer interaction, especially in face-to-face interaction between human and intelligent agent. We present a facial expression animation system that facilitates control of expressiveness and style. We learn a decomposable generative model for the nonlinear deformation of facial expressions by analyzing the mapping space between low dimensional embedded representation and high resolution tracking data. Bilinear analysis of the mapping space provides a compact representation of the nonlinear generative model for facial expressions. The decomposition allows synthesis of new facial expressions by control of geometry and expression style. The generative model provides control of expressiveness preserving nonlinear deformation in the expressions with simple parameters and allows synthesis of stylized facial geometry. In addition, we can directly extract the MPEG-4 Facial Animation Parameters (FAPs) from the synthesized data, which allows using any animation engine that supports FAPs to animate new synthesized expressions.

show abstract

Section: Introductionmentioning

confidence: 99%