A Review of Eye Gaze in Virtual Agents, Social Robotics and HCI: Behaviour Generation, User Interaction and Perception

Ruhland, Kerstin; Peters, Christopher; Andrist, Sean; Badler, Jeremy B.; Badler, Norman I.; Gleicher, Michael; Mutlu, Bilge; McDonnell, Rachel

doi:10.1111/cgf.12603

Cited by 186 publications

(92 citation statements)

References 229 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Just below humans on the spectrum are virtual agents, which have the potential for extremely high levels of behavioral realism. By nature of being animated, virtual agents can mimic human eye capabilities with greater precision than physical robots, though computationally encoding biologically realistic gaze behavior is an active area of research (Ruhland et al, 2015). While some virtual agents are implemented with complex, biologically faithful models of muscle movement that control eye motion, others use motion generators that are less consistent with the underlying biology (Ruhland et al, 2015), so there is a range of possible realism within the virtual agent literature.…”

Section: Robot Appearancementioning

confidence: 99%

Social Eye Gaze in Human-Robot Interaction: A Review

Admoni

Scassellati

2017

Journal of Human-Robot Interaction

434

192

View full text Add to dashboard Cite

This article reviews the state of the art in social eye gaze for human-robot interaction (HRI). It establishes three categories of gaze research in HRI, defined by differences in goals and methods: a human-centered approach, which focuses on people's responses to gaze; a design-centered approach, which addresses the features of robot gaze behavior and appearance that improve interaction; and a technology-centered approach, which is concentrated on the computational tools for implementing social eye gaze in robots. This paper begins with background information about gaze research in HRI and ends with a set of open questions.

show abstract

Section: Robot Appearancementioning

confidence: 99%

Social Eye Gaze in Human-Robot Interaction: A Review

Admoni

Scassellati

2017

Journal of Human-Robot Interaction

434

192

View full text Add to dashboard Cite

show abstract

“…The research in virtual agents has shown a significant need for embodiment in virtual social interactions (Ruhland et al, 2015). Many studies supplement qualitative interviews and observer notes with quantitative data (Biocca and Nowak, 2001;Smith and Harrison, 2001;Dautenhahn, 2001), such as toward understanding ownership of sub-components of embodiment (Kilteni et al, 2012) and administering POMS questionnaire before and after completing an activity (Garau et al, 2005).…”

Section: Virtual Artificial Agentsmentioning

confidence: 99%

Embodiment in Socially Interactive Robots

2019

View full text Add to dashboard Cite

Physical embodiment is a required component for robots that are structurally coupled with their real-world environments. However, most socially interactive robots do not need to physically interact with their environments in order to perform their tasks. When and why should embodied robots be used instead of simpler and cheaper virtual agents?This paper reviews the existing work that explores the role of physical embodiment in socially interactive robots. This class consists of robots that are not only capable of engaging in social interaction with humans, but are using primarily their social capabilities to perform their desired functions. Socially interactive robots provide entertainment, information, and/or assistance; this last category is typically encompassed by socially assistive robotics. In all cases, such robots can achieve their primary functions without performing functional physical work.To comprehensively evaluate the existing body of work on embodiment, we first review work from established related fields including psychology, philosophy, and sociology. We then systematically review 65 studies evaluating aspects of embodiment published from 2003 to 2017 in major peer-reviewed robotics publication venues. We examine relevant aspects of the selected studies, focusing on the embodiments compared, tasks evaluated, social roles of robots, and measurements. We introduce three taxonomies for the types of robot embodiment, robot social roles, and human-robot tasks. These taxonomies are used to deconstruct the design and interaction spaces of socially interactive robots and facilitate analysis and discussion of the reviewed studies. We use this newly-defined methodology to critically discuss existing works, revealing topics within embodiment research for social interaction, assistive robotics, and service robotics, in which more extensive exploration would greatly improve the current understanding of the impact of embodiment on human perception and evaluation of human-robot interactions.The introduced taxonomy for embodiment design is used as a starting point for outlining our characterization of the design space of robot embodiments. The presented arXiv:1912.00312v1 [cs.RO] 1 Dec 2019 characterization can be used to discuss how the physical embodiment of socially interactive robots relates to social capabilities and affordances. By introducing a general model of the design space, existing research findings can better advise robot designers and we discuss how these findings can inform researchers through design decisions in the development of future socially interactive robots.

show abstract

“…A NPC is a kind of social robots used to manage learners' communication practices and thus helps to simulate social contexts similar to those in the real world. Contrary to the importance of NPC as demonstrated in prior studies [2,3], defining how NPCs in VR-based social l skill training need to be applied is still elusive. Moreover, there is no clear overview of which design aspects should be addressed specifically for autistic children.…”

Section: Introductionmentioning

confidence: 87%

Reviews of Social Embodiment for Design of Non-Player Characters in Virtual Reality-Based Social Skill Training for Autistic Children

Moon

2018

MTI

View full text Add to dashboard Cite

Abstract:The purpose of this paper is to review the scholarly works regarding social embodiment aligned with the design of non-player characters in virtual reality (VR)-based social skill training for autistic children. VR-based social skill training for autistic children has been a naturalistic environment, which allows autistic children themselves to shape socially-appropriate behaviors in real world. To build up the training environment for autistic children, it is necessary to identify how to simulate social components in the training. In particular, designing non-player characters (NPCs) in the training is essential to determining the quality of the simulated social interactions during the training. Through this literature review, this study proposes multiple design themes that underline the nature of social embodiment in which interactions with NPCs in VR-based social skill training take place.

show abstract

A Review of Eye Gaze in Virtual Agents, Social Robotics and HCI: Behaviour Generation, User Interaction and Perception

Abstract: Abstract

Cited by 186 publications

References 229 publications

Social Eye Gaze in Human-Robot Interaction: A Review

Social Eye Gaze in Human-Robot Interaction: A Review

Embodiment in Socially Interactive Robots

Reviews of Social Embodiment for Design of Non-Player Characters in Virtual Reality-Based Social Skill Training for Autistic Children

Contact Info

Product

Resources

About