Emotion Modelling for Social Robotics Applications: A Review

Abstract

Robots of today are eager to leave constrained industrial environments and embrace unexplored and unstructured areas, for extensive applications in the real world as service and social robots. Hence, in addition to these new physical frontiers, they must face human ones, too. This implies the need to consider a human-robot interaction from the beginning of the design; the possibility for a robot to recognize users' emotions and, in a certain way, to properly react and "behave". This could play a fundamental role in their integration in society. However, this capability is still far from being achieved. Over the past decade, several attempts to implement automata for different applications, outside of the industry, have been pursued. But very few applications have tried to consider the emotional state of users in the behavioural model of the robot, since it raises questions such as: how should human emotions be modelled for a correct representation of their state of mind? Which sensing modalities and which classification methods could be the most feasible to obtain this desired knowledge? Furthermore, which applications are the most suitable for the robot to have such sensitivity? In this context, this paper aims to provide a general overview of recent attempts to enable robots to recognize human emotions and interact properly.

The FaceChannel: A Fast and Furious Deep Neural Network for Facial Expression Recognition

“…We also demonstrate, using different FER datasets with specific data characteristics, how our model can be quickly adapted and fine-tuned for specific affective perception scenarios. To guarantee the reproducibility and dissemination of our model, we have made it fully available on GitHub 2 .…”

Dating a Synthetic Character is Like Dating a Man

“…If implemented in a robot as is, Silicon Coppélia does not have a detection system that analyzes the user's affective state [8] like, for instance, Kismet does [7]. It uses simple textual input for that.…”

A Survey of Behavioral Models for Social Robots

“…The first attempts to solve this challenge have been performed by developing intelligent systems able to detect user's emotions [20] and by identifying the key factors that should be adjusted to make the interaction smoother (i.e., interpersonal distance, mental state, user's feedback, and user's profile) [21]. More advanced steps should be performed so that robots are endowed with cognitive and affective capabilities that could provide them with tools to establish empathetic relationships with users and to gain social cognitive mechanisms that are necessary to be perceived as a teammate [22,23].…”