InterActor: Speech-Driven Embodied Interactive Actor

Speech-driven embodied entrainment character system with pupillary response

“…A listener's interaction model includes a nodding reaction model, which estimates the timing involved during nodding from a speech ON-OFF pattern and is linked to a bodily reaction model (Watanabe et al, 2004). The timing of nodding is predicted using a hierarchy model consisting of two stages we label as macro and micro (Fig.…”

“…In addition, studies of entrainment using robot systems have been conducted (Itai and Miwa, 2007). In our previous research, we analyzed the entrainment between a speaker's speech and listener's nodding movements during face-to-face communication and developed InterRobot Technology (iRT), which generates a variety of communicative actions and movements such as nodding, blinking, and movements of the head, arms, and waist that relate to speech input (Watanabe et al, 2004). In addition, we developed an interactive CG character called "InterActor," which has functions of both speaker and listener, and demonstrated that InterActor can effectively support human interaction and communication.…”

Development of a Virtual Group Walking Support System

“…Fig.8 shows the example of the virtual space in which the car across the road and unknown people are walking the street randomly. On the other hand, for encouraging communication with the partner, speech driven avatar named InterActor will be applied (Watanabe et al, 2004). Moreover, there is a limitation in a diversity of computer graphics.…”

Interpersonal Coevolution of Body Movements in Daily Face-to-Face Communication

“…The time series of body movements on a second scale is usually much less stable or uniform in the real world than in a laboratory setting [11]. That is, in daily situation, it would be difficult to evaluate the quality of people's communication and to support the communication from the viewpoint of second-scale coevolution like many previous studies [13]- [16], [22]- [29], [37]- [39]. Therefore, if the over-second-scale coevolution between people can be seen in daily situation, the evaluation and support of people's communication would be developed.…”

“…Riek et al developed a robot that can mimic facial gestures of people [37]. Watanabe et al constructed a system to entrain the body movements including speech between people and robots/characters [38], [39]. These studies suggest that the interpersonal coevolution can be applied to support communication between people and between people and robots/characters.…”