Examining joint attention with the use of humanoid robots-A new approach to study fundamental mechanisms of social cognition

Abstract

This article reviews methods to investigate joint attention and highlights the benefits of new methodological approaches that make use of the most recent technological developments, such as humanoid robots for studying social cognition. After reviewing classical approaches that address joint attention mechanisms with the use of controlled screen-based stimuli, we describe recent accounts that have proposed the need for more natural and interactive experimental protocols. Although the recent approaches allow for more ecological validity, they often face the challenges of experimental control in more natural social interaction protocols. In this context, we propose that the use of humanoid robots in interactive protocols is a particularly promising avenue for targeting the mechanisms of joint attention. Using humanoid robots to interact with humans in naturalistic experimental setups has the advantage of both excellent experimental control and ecological validity. In clinical applications, it offers new techniques for both diagnosis and therapy, especially for children with autism spectrum disorder. The review concludes with indications for future research, in the domains of healthcare applications and human-robot interaction in general.

What Makes a Robot Social? A Review of Social Robots from Science Fiction to a Home or Hospital Near You

“…Previous research in cognitive neuroscience has used social robots to address questions regarding attention (e.g. [34][35][36][37]), theory of mind (e.g. [38][39][40][41]), mind perception (e.g.…”

Gaze aversion in conversational settings: An investigation based on mock job interview

“…A major application of this research is to design robots that show a natural gaze-aversion behavior when interacting with a human. This topic is gaining importance in Human Robot Interaction (HRI) research (see Chevalier, Kompatsiari, Ciardo, & Wykowska, 2020, for a review). The methodology of designing a robot's gaze movement based on human-to-human gaze contact studies has been followed in the past (Andrist, 2013(Andrist, , 2014Lehmann, 2017;Zhang, 2017).…”

“…Recent studies show that a robots' gaze behavior significantly impacts the interaction quality, as specified in terms of a set of dimensions, such as engagement (Pitsch, et al 2009) and persuasiveness (Fischer, et al, 2020). In the context of our research, the issues related to HRI during social interaction are important, including the use of humanoid robots (which ensures reasonable experimental control) for targeting the mechanisms of joint attention (Chevalier, Kompatsiari, Ciardo, & Wykowska, 2020). We believe that the findings of the present study and the implemented methodology can contribute to the domain of HRI and Social Robotics in multiple ways, including designing gaze aversion sequences and their timings during interactions (Jensen, et al, 2017).…”

Social Robots to Test Flexibility of Human Social Cognition

“…Interestingly, however, there was also no clear indication of reflexive orienting towards human gaze. This might be due to insufficient statistical power in the experimental design (for a similar argument, see [76]).…”