Towards a high quality Finnish talking head

Olives, Jean-Luc; Sams, Mikko; Kulju, J.; Seppälä, Otto; Karjalainen, Matti; Altosaar, Toomas; Lemmetty, S.; Toyra, K.; Vainio, Martti

doi:10.1109/mmsp.1999.793886

Cited by 5 publications

(4 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…These talking faces are mostly driven by English phonetics (or visemes). Recently we also see talking faces driven by Finnish [4], Italian [5], Chinese Mandarin (Putonghua) and Cantonese [6]. A related problem is how to animate a talking face designed based on phonetics in one language, with input audio speech in another (target) language.…”

Section: Fig 1 Block Diagram Of the Cantonese Talking Face Systemmentioning

confidence: 99%

A Cantonese Speech-Driven Talking Face Using Translingual Audio-to-Visual Conversion

Xie

Meng

Liu

2006

Chinese Spoken Language Processing

View full text Add to dashboard Cite

Abstract. This paper proposes a novel approach towards a videorealistic, speech-driven talking face for Cantonese. We present a technique that realizes a talking face for a target language (Cantonese) using only audio-visual facial recordings for a base language (English). Given a Cantonese speech input, we first use a Cantonese speech recognizer to generate a Cantonese syllable transcription. Then we map it to an English phoneme transcription via a translingual mapping scheme that involves symbol mapping and time alignment from Cantonese syllables to English phonemes. With the phoneme transcription, the input speech, and the audio-visual models for English, an EM-based conversion algorithm is adopted to generate mouth animation parameters associated with the input Cantonese audio. We have carried out audio-visual syllable recognition experiments to objectively evaluate the proposed talking face. Results show that the visual speech synthesized by the Cantonese talking face can effectively increase the accuracy of Cantonese syllable recognition under noisy acoustic conditions.

show abstract

Section: Fig 1 Block Diagram Of the Cantonese Talking Face Systemmentioning

confidence: 99%

A Cantonese Speech-Driven Talking Face Using Translingual Audio-to-Visual Conversion

Xie

Meng

Liu

2006

Chinese Spoken Language Processing

View full text Add to dashboard Cite

show abstract

“…The screen-based 'talking-head' is a powerful device for mediating interaction between humans and machines, enabling a form of interaction that mimics direct communication between humans [2,5,8,[16][17][18][19]22]. The experience of realism is further enhanced when the computer is equipped with visual and auditory senses with which to perceive the user [1,3,6,9,10,12,20,21,23,[26][27][28].…”

Section: Introductionmentioning

confidence: 99%

Reactive memories: an interactive talking-head

Devin

Hogg

2003

Image and Vision Computing

View full text Add to dashboard Cite

“…The screen-based 'talking head' is a powerful device for mediating interaction between humans and machines, enabling a form of interaction that mimics direct communication between humans [10,1,11]. The experience of realism is further enhanced when the computer is equipped with visual and auditory senses with which to perceive the user [6,2,13,4].…”

Section: Introductionmentioning

confidence: 99%

Reactive Memories: An Interactive Talking-Head

Devin

Hogg

2001

Procedings of the British Machine Vision Conference 2001

View full text Add to dashboard Cite

We demonstrate a novel method for producing a synthetic talking head. The method is based on earlier work in which the behaviour of a synthetic individual is generated by reference to a probabilistic model of interactive behaviour within the visual domain -such models are learnt automatically from typical interactions. We extend this work into a combined visual and auditory domain and employ a state-of-the-art facial appearance model. The result is a synthetic talking head that responds appropriately and with correct timing to simple forms of greeting with variations in facial expression and intonation.keywords : interactive head, face tracking, speech reconstitution, virtual partner, behaviour modelling.

show abstract

Towards a high quality Finnish talking head

Cited by 5 publications

References 9 publications

A Cantonese Speech-Driven Talking Face Using Translingual Audio-to-Visual Conversion

A Cantonese Speech-Driven Talking Face Using Translingual Audio-to-Visual Conversion

Reactive memories: an interactive talking-head

Reactive Memories: An Interactive Talking-Head

Contact Info

Product

Resources

About