Realtime synthesis of moving human-like agent in response to user's moving image

Hasegawa, Osamu; Lee, C.-W.; Wongwarawipat, Wiwat; Ishizuka, M.

doi:10.1109/icpr.1992.202126

Cited by 7 publications

(2 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The experience of realism is further enhanced when the computer is equipped with visual and auditory senses with which to perceive the user [1,3,6,9,10,12,20,21,23,[26][27][28]. In this symmetric situation, both the human and synthetic head can see and be seen, and can hear and be heard.…”

Section: Introductionmentioning

confidence: 99%

Reactive memories: an interactive talking-head

Devin

Hogg

2003

Image and Vision Computing

View full text Add to dashboard Cite

Section: Introductionmentioning

confidence: 99%

Reactive memories: an interactive talking-head

Devin

Hogg

2003

Image and Vision Computing

View full text Add to dashboard Cite

“…The screen-based 'talking head' is a powerful device for mediating interaction between humans and machines, enabling a form of interaction that mimics direct communication between humans [10,1,11]. The experience of realism is further enhanced when the computer is equipped with visual and auditory senses with which to perceive the user [6,2,13,4]. In this symmetric situation, both the human and synthetic head can see and be seen, and can hear and be heard.…”

Section: Introductionmentioning

confidence: 99%

Reactive Memories: An Interactive Talking-Head

Devin

Hogg

2001

Procedings of the British Machine Vision Conference 2001

View full text Add to dashboard Cite

We demonstrate a novel method for producing a synthetic talking head. The method is based on earlier work in which the behaviour of a synthetic individual is generated by reference to a probabilistic model of interactive behaviour within the visual domain -such models are learnt automatically from typical interactions. We extend this work into a combined visual and auditory domain and employ a state-of-the-art facial appearance model. The result is a synthetic talking head that responds appropriately and with correct timing to simple forms of greeting with variations in facial expression and intonation.keywords : interactive head, face tracking, speech reconstitution, virtual partner, behaviour modelling.

show abstract

Realtime parallel and cooperative recognition of human face for a naturalistic visual human interface

Hasegawa

Ishizuka

Yokosawa

1994

Systems & Computers in Japan

View full text Add to dashboard Cite

SUMMARYimage recognition and synthesis processes were implemented on a newly designed parallel computer. The concept of a Visual Software Agent (VSA), i.e., an anthropomorphic agent possessing a realistic human form and communication functions that create an interface with the user, is proposed. Research is proceeding on its implementation on a parallel computer. In this paper, we describe a method that is effective as the visual input function of the anthropomorphic agent. This method recognizes and extracts only one person (user) directly facing the camera in a moving image in which several people occasionally enter and leave. The recognition method can be executed in real time in a typical indoor environment. The background and the lighting do not have to be restricted and recognition can be achieved in real time by a parallel computer. In addition, this technique simulates the initial stage of human visual functions and is based on the parallel extraction and integration of multiple image features. The movements of visual attention of cognitive psychology can also be simulated. An anthropomorphic agent derived from this approach successively looks at multiple human faces, fixes its gaze only on a specific person, and synthesizes agent behavior that approximate that of humans. These moving *Currently with the Electrotechnical Lab.

show abstract

Realtime synthesis of moving human-like agent in response to user's moving image

Cited by 7 publications

References 3 publications

Reactive memories: an interactive talking-head

Reactive memories: an interactive talking-head

Reactive Memories: An Interactive Talking-Head

Realtime parallel and cooperative recognition of human face for a naturalistic visual human interface

Contact Info

Product

Resources

About