Communication Behavior in Embodied Virtual Reality

Abstract

Embodied virtual reality faithfully renders users' movements onto an avatar in a virtual 3D environment, supporting nuanced nonverbal behavior alongside verbal communication. To investigate communication behavior within this medium, we had 30 dyads complete two tasks using a shared visual workspace: negotiating an apartment layout and placing model furniture on an apartment floor plan. Dyads completed both tasks under three different conditions: face-to-face, embodied VR with visible full-body avatars, and no embodiment VR, where the participants shared a virtual space, but had no visible avatars. Both subjective measures of users' experiences and detailed annotations of verbal and nonverbal behavior are used to understand how the media impact communication behavior. Embodied VR provides a high level of social presence with conversation patterns that are very similar to face-to-face interaction. In contrast, providing only the shared environment was generally found to be lonely and appears to lead to degraded communication.

Exploring the Use of a Robust Depth-sensor-based Avatar Control System and its Effects on Communication Behaviors

“…The non-verbal communication behavior is usually presented in the mutual conversion through face-to-face, video conferencing [Whittaker 2003] or embodied avatar in VR [Dodds et al 2011;Fabri et al 2002;Roth et al 2018;Smith and Neff 2018]. The non-verbal cues delivered by the virtual characters in the collaborative virtual environment influence the efficiency of task performance [Roth et al 2018;Smith and Neff 2018]. The mirror is usually used in the singleuser scenario [Collingwoode-Williams et al 2017;Kilteni et al 2013;Maister et al 2015] to evaluate the communication behavior such as non-verbal cue.…”

“…With modern tracking technology, NVC is generally implemented for the player through a virtual character whose behavior is captured by peripheral devices. The user can view the virtual world through the avatar's eyes, and avatar movement reflects their own body movement [Smith and Neff 2018].…”

Technologies for Social Augmentations in User-Embodied Virtual Reality

“…Multiple previous studies have explored the adaptation of a virtual body [Slater et al 2010], and argued for the human flexibility to adapt non-human avatars [Won et al 2015]. User embodiment, in turn, can lead to higher social presence ratings, comparable to face-to-face interactions [Smith and Neff 2018]. With regard to augmented communication in virtual environments, Gerhard et al [2001] explored hybrid human/agent communication models to allow for continuous presence in educational virtual environments.…”

Tele-Guidance System to Support Anticipation during Communication

“…Smith and Neff evaluated participants' communication behavior in VR, and found that using full-body avatars provided a high level of social presence and that the participants' conversation patterns were very similar to those shown in face-to-face conditions [13]. The results indicate that our AR tele-guidance system has similar capabilities.…”