Motion and Attention in a Kinetic Videoconferencing Proxy

Abstract

Abstract. Compared to collocated interaction, videoconferencing disrupts the ability to use gaze and gestures to mediate interaction, direct reactions to specific people, and provide a sense of presence for the satellite (i.e., remote) participant. We developed a kinetic videoconferencing proxy with a swiveling display screen to indicate which direction that the satellite participant was looking. Our goal was to compare two alternative motion control conditions, in which the satellite participant directed the display screen's motion either explicitly (aiming the direction of the display with a mouse) or implicitly (with the screen following the satellite participant's head turns). We then explored the effectiveness of this prototype compared to a typical stationary video display in a lab study. We found that both motion conditions resulted in communication patterns that indicate higher engagement in conversation, more accurate responses to the satellite participant's deictic questions (i.e., "What do you think?"), and higher user rankings. We also discovered tradeoffs in attention and clarity between explicit versus implicit control, a tension in how motion toward one person can exclude other people, and ways that swiveling motion provides attention awareness, even without direct eye contact.

Study on Gaze Direction Perception of Face Image Displayed on Rotatable Flat Display

“…In the initial stage of this study, we assume one-to-one communication, thus aiming to contribute to the design of telepresence robots in order to support accurate joint attention between one remote participant and one local participant. Therefore, our findings might not be directly applicable to the design of a telepresence robot for assisting smooth turn-taking during remote multi-party meetings [25,26]. However, we believe that our findings can be part of a fundamental knowledge to understand various gaze-related phenomena that can be observed during such meetings.…”

A Review of Mobile Robotic Telepresence

“…"Attention is fundamental to the flow of face-to-face conversation, " page 1 [92]. Each participant in an interaction project cues where their attention is directed.…”

“…For example, a turnable display resulted in a higher level of activity, perceived excitement of the speakers, level of attentiveness and engagement, and amount of turns per second during satellite-hub interaction when compared to interaction through a video conferencing system with a static display [92]. The study included sociometric measures, feedback from the pilot of the system, semi-structured, and several individually filled questionnaires.…”

“…Also culture, gender, and prior experience to robots were found to influence the NARS score and participants being generally positive to robots were more positive to the MRP systems. Similarly to [92], the authors emphasized the need to complement questionnaires with other methods. They used ethnographic methods such as observations and interviews while claiming that numbers alone can only highlight issues but not explain the reason for them.…”

Advances in Shader Lamps Avatars for telepresence

“…In particular, they showed that the 3D model resulted in an accurate perception of gaze direction, unlike the Mona Lisa gaze effect typically seen when using a 2D surface to display 3D face imagery. Sirkin et al developed a videoconferencing system that used a 2D display for the user's face, but the display could swivel to indicate gaze direction [13].…”