Evaluation Metrics Regarding Human Well-Being and System Performance in Human-Robot Interaction – A Literature Review

Nelles, Jochen; Kwee-Meier, Sonja Theresa; Mertens, Alexander

doi:10.1007/978-3-319-96068-5_14

Cited by 14 publications

(10 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Due to the diverse taxonomies in HRI and a broad array of evaluation metrics, there is no universal method for the assessment of HRI [31]. ISO 9241-11:2018 [32] seems to be let the robot return to a known base position to avoid becoming a dangerous obstacle after handover [26] 1.3.…”

Section: Methods For Evaluating Robot-to-human Handovermentioning

confidence: 99%

Got It? Comparative Ergonomic Evaluation of Robotic Object Handover for Visually Impaired and Sighted Users

Langer,

Legler,

Diekmann

et al. 2024

Robotics

View full text Add to dashboard Cite

The rapidly growing research on the accessibility of digital technologies has focused on blind or visually impaired (BVI) users. However, the field of human–robot interaction has largely neglected the needs of BVI users despite the increasing integration of assistive robots into daily life and their potential benefits for our aging societies. One basic robotic capability is object handover. Robots assisting BVI users should be able to coordinate handovers without eye contact. This study gathered insights on the usability of human–robot handovers, including 20 BVI and 20 sighted participants. In a standardized experiment with a mixed design, a handover robot prototype equipped with a voice user interface and haptic feedback was evaluated. The robot handed over everyday objects (i) by placing them on a table and (ii) by allowing for midair grasping. The usability target was met, and all user groups reported a positive user experience. In total, 97.3% of all handovers were successful. The qualitative feedback showed an appreciation for the clear communication of the robot’s actions and the handover reliability. However, the duration of the handover was seen as a critical issue. According to all subjective criteria, the BVI participants showed higher variances compared to the sighted participants. Design recommendations for improving robotic handovers equally supporting both user groups are given.

show abstract

Section: Methods For Evaluating Robot-to-human Handovermentioning

confidence: 99%

Got It? Comparative Ergonomic Evaluation of Robotic Object Handover for Visually Impaired and Sighted Users

Langer,

Legler,

Diekmann

et al. 2024

Robotics

View full text Add to dashboard Cite

show abstract

“…Since eye contact over a live video can also induce physiological effects, it is plausible to find this in the current experiment, which makes use of a mock live video connection (Hietanen et al, 2020). Surveys of all kinds, including questionnaires, interviews and rating scales have long been used in HRI research to overtly probe a user's impression of the interaction with an artificial agent (Nelles et al, 2018). Our use of a questionnaire here has a similar goal.…”

Section: State Of the Artmentioning

confidence: 99%

Robot Gaze Behavior Affects Honesty in Human-Robot Interaction

Schellen¹,

Bossi²,

Wykowska³

2021

Preprint

View full text Add to dashboard Cite

As the use of humanoid robots proliferates, an increasing amount of people may find themselves face-to-“face” with a robot in everyday life. Although there is a plethora of information available on facial social cues and how we interpret them in the field of human-human social interaction, we cannot assume that these findings flawlessly transfer to human-robot interaction. Therefore, more research on facial cues in human-robot interaction is required. This study investigated deception in human-robot interaction context, focusing on the effect that eye contact with a robot has on honesty towards this robot. In an iterative task, participants could assist a humanoid robot by providing it with correct information, or potentially secure a reward for themselves by providing it with incorrect information. Results show that participants are increasingly honest after the robot establishes eye contact with them, but only if this is in response to deceptive behavior. Behavior is not influenced by the establishment of eye contact if the participant is actively engaging in honest behavior. These findings support the notion that humanoid robots can be perceived as, and treated like, social agents, since the herein described effect mirrors one present in human-human social interaction.

show abstract

“…It is worth mentioning that prior to conducting the systematic literature review, authors assessed its novelty. Authors acknowledge the existence of several systematic literature reviews in the broad field of robotics [52][53][54][55][56], some of them in the field of human-robot interaction [57][58][59][60]. However, in the specific field of social robots, there are two works worth mention, one on the interaction with sexbots [61] and another on specific design guidelines for social robots for the elderly [62].…”

Section: Systematic Literature Review Using Prisma Guidelinesmentioning

confidence: 99%

User Experience in Social Robots

Shourmasti

Colomo‐Palacios

Holone

et al. 2021

Sensors

View full text Add to dashboard Cite

Social robots are increasingly penetrating our daily lives. They are used in various domains, such as healthcare, education, business, industry, and culture. However, introducing this technology for use in conventional environments is not trivial. For users to accept social robots, a positive user experience is vital, and it should be considered as a critical part of the robots’ development process. This may potentially lead to excessive use of social robots and strengthen their diffusion in society. The goal of this study is to summarize the extant literature that is focused on user experience in social robots, and to identify the challenges and benefits of UX evaluation in social robots. To achieve this goal, the authors carried out a systematic literature review that relies on PRISMA guidelines. Our findings revealed that the most common methods to evaluate UX in social robots are questionnaires and interviews. UX evaluations were found out to be beneficial in providing early feedback and consequently in handling errors at an early stage. However, despite the importance of UX in social robots, robot developers often neglect to set UX goals due to lack of knowledge or lack of time. This study emphasizes the need for robot developers to acquire the required theoretical and practical knowledge on how to perform a successful UX evaluation.

show abstract

Evaluation Metrics Regarding Human Well-Being and System Performance in Human-Robot Interaction – A Literature Review

Cited by 14 publications

References 29 publications

Got It? Comparative Ergonomic Evaluation of Robotic Object Handover for Visually Impaired and Sighted Users

Got It? Comparative Ergonomic Evaluation of Robotic Object Handover for Visually Impaired and Sighted Users

Robot Gaze Behavior Affects Honesty in Human-Robot Interaction

User Experience in Social Robots

Contact Info

Product

Resources

About