What Does the Face-Turning Action Imply in Consensus Building Communication?

Abstract

Abstract. When talking with someone, we convey intention to each other by verbal and non-verbal behaviors. In consensus building dialogue, the participants need to understand whether they agree or disagree. They reiterate confirmation of partner's internal state (agreement/disagreement) and reaction for it. In this study, we considered that the timing of listener's reaction for the confirmation by a speaker reflects listener's internal state, therefore analyzed the multimodal timing structures between the confirmation and the reaction by utterance and body motion. Especially, we focused on an action that the speaker turns his face toward the listener as the confirming action and analyzed how it influences the timing structures. As the results, we confirmed that the timing structures relate to the internal state and the relations are controlled by face-turning action.

Estimates of User Interest Using Timing Structures between Proactive Content-Display Updates and Eye Movements

“…analyzed the timing structure of proactive face-turning behavior in human-human communication [10]. It would be worth checking if the results were similar to those in humanmachine communication.…”

Estimation of user interest using time delay features between proactive content presentation and eye movements

“…But these researches were based on the passive sensing. Later, Onishi et al analyzed the timing structures of proactive face turning behavior in human-human consensus building communication [10]. It would be worth checking if the results are similar in human-machine communication.…”