Sound emblems for affective multimodal output of a robotic tutor: a perception study

Hastie, Helen; Dente, Pasquale; Küster, Dennis; Kappas, Arvid

doi:10.1145/2993148.2993169

Cited by 9 publications

(3 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Future work may focus on studying inferred a↵ect in combination with separate components, such as empathic behaviors, or robot sound emblems, and combinations thereof. For the sound emblems, we speculate that the presence of an appropriate type of social robot may be necessary, as simply adding synthetic beeps to speech may result in reduced perceived naturalness 34 . More subtle expressions informed by a↵ect sensing, such as the robot adapting its tone of voice to the emotional state of the child, could also be investigated.…”

Section: Discussionmentioning

confidence: 99%

“…As NAO lacks the capacity for facial emotional expressions, the empathic condition further included specifically designed emotional sound emblems consisting of sequences of "bleeps and beeps". These synthetic sounds were selected from a large toolkit of validated robot sounds 46 that can be used for multimodal backchannelling 34 . In this study, we aimed to use the emotional sounds to help create a subtle sense of empathic concern expressed by the robot.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Endowing a Robotic Tutor with Empathic Qualities: Design and Pilot Evaluation

Obaid

Aylett

Barendregt

et al. 2018

Int. J. Human. Robot.

Self Cite

View full text Add to dashboard Cite

As increasingly more research efforts are geared towards creating robots that can teach and interact with children in educational contexts, it has been speculated that endowing robots with artificial empathy may facilitate learning. In this paper, we provide a background to the concept of empathy, and how it factors into learning. We then present our approach to equipping a robotic tutor with several empathic qualities, describing the technical architecture and its components, a map-reading learning scenario developed for an interactive multitouch table, as well as the pedagogical and empathic strategies devised for the robot. We also describe the results of a pilot study comparing the robotic tutor with these empathic qualities against a version of the tutor without them. The pilot study was performed with 26 school children aged 10–11 at their school. Results revealed that children in the test condition indeed rated the robot as more empathic than children in the control condition. Moreover, we explored several related measures, such as relational status and learning effect, yet no other significant differences were found. We further discuss these results and provide insights into future directions.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Endowing a Robotic Tutor with Empathic Qualities: Design and Pilot Evaluation

Obaid

Aylett

Barendregt

et al. 2018

Int. J. Human. Robot.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Indeed, it was demonstrated that a robot with different gestures and voices at a different intensities affects users' subjective reactions to the robot [61]. For example, Deshmukh, Foster and Mazel [62] integrated a finer-grained method of gesture control based on sentiment, as well as a set of effectively generated artificial sounds [63], intending to enhance the expressiveness of a humanoid robot.…”

Section: Body Gesturesmentioning

confidence: 99%

Personalization and Localization in Human-Robot Interaction: A Review of Technical Methods

et al. 2021

View full text Add to dashboard Cite

Personalization and localization are important when developing social robots for different sectors, including education, industry, healthcare or restaurants. This allows for an adjustment of robot behaviors according to the needs, preferences or personality of an individual when referring to personalization or to the social conventions or the culture of a country when referring to localization. However, there are different models that enable personalization and localization presented in the current literature, each with their advantages and drawbacks. This work aims to help researchers in the field of social robotics by reviewing and analyzing different papers in this domain. We specifically focus our review by exploring different robots that employ distinct models for the adaptation of the robot to its environment. Additionally, we study an array of methods used to adapt the nonverbal and verbal skills of social robots, including state-of-the-art techniques in artificial intelligence.

show abstract

Semiotic Analysis of Robot Sounds in Films: Implications for Sound Design in Social Robotics

Latupeirissa,

Murdeshwar,

Bresin

2024

Int J of Soc Robotics

View full text Add to dashboard Cite

This paper investigates the sound design of robots in films and their potential influence on the field of social robotics. Cinematic robot portrayals have inspired researchers and practitioners in Human-Robot Interaction (HRI). While the non-verbal sounds of iconic film robots like R2-D2 and Wall-E have been explored, this study takes a more comprehensive approach. We explore a broader selection of 15 films featuring humanoid robots across decades through a semiotic analysis of their non-verbal communication sounds, including those related to movements and internal mechanisms . Informed by Bateman and Schmidt’s multimodal film analysis framework, which draws on Saussure’s organization of signs through paradigmatic and syntagmatic relations, our analysis interprets the paradigmatic axis as an examination of the sound and the syntagmatic axis as an exploration of the events surrounding the sound. The findings uncover two primary film robot sound materials: mechanical and synthetic. Furthermore, the analysis revealed several narrative themes, categorized into two groups based on the syntagmatic focus: sounds associated with the robots’ visual appearances and sounds linked to the broader elements within the scene. The discussion section explores the implications of these findings for social robotics, including the importance of sound materials, the role of movement sounds in communication and emotional expression, and the significance of narrative and context in human-robot interaction. The paper also acknowledges the challenges in translating film sound design into practical applications in social robotics. This study provides valuable insights for HRI researchers, practitioners, and sound designers seeking to enhance non-verbal auditory expressions in social robots.

show abstract

Sound emblems for affective multimodal output of a robotic tutor: a perception study

Cited by 9 publications

References 26 publications

Endowing a Robotic Tutor with Empathic Qualities: Design and Pilot Evaluation

Endowing a Robotic Tutor with Empathic Qualities: Design and Pilot Evaluation

Personalization and Localization in Human-Robot Interaction: A Review of Technical Methods

Semiotic Analysis of Robot Sounds in Films: Implications for Sound Design in Social Robotics

Contact Info

Product

Resources

About