Comparing Strategies for Robot Communication of Role-Grounded Moral Norms

Wen, Ruchen; Kim, Boyoung; Phillips, Elizabeth; Zhu, Qin; Williams, Tom

doi:10.1145/3434074.3447185

Cited by 9 publications

(3 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The above findings raise critical questions for moral communication. That is, when robots espouse moral beliefs (whether in the context of remonstration, correction, or inculpation [1,32]), these beliefs may be grounded in at least two possible sources: (1) in the norms (or other moral principles [31,32]) that the robots are expected to follow; or (2) in the norms that their interlocutors are expected to follow. Critically, not only may these norms differ depending on the differences in roles for the advisor and the advisee (e.g., whether they serve in the roles of supervisors, peers, teammates, tutors, etc.)…”

Section: Introductionmentioning

confidence: 99%

I Need Your Advice... Human Perceptions of Robot Moral Advising Behaviors

D.¹,

Malle²,

Williams³

2021

Preprint

Self Cite

View full text Add to dashboard Cite

Due to their unique persuasive power, language-capable robots must be able to both act in line with human moral norms and clearly and appropriately communicate those norms. These requirements are complicated by the possibility that humans may ascribe blame differently to humans and robots. In this work, we explore how robots should communicate in moral advising scenarios, in which the norms they are expected to follow (in a moral dilemma scenario) may be different from those their advisees are expected to follow. Our results suggest that, in fact, both humans and robots are judged more positively when they provide the advice that favors the common good over an individual's life. These results raise critical new questions regarding people's moral responses to robots and the design of autonomous moral agents.

show abstract

Section: Introductionmentioning

confidence: 99%

I Need Your Advice... Human Perceptions of Robot Moral Advising Behaviors

D.¹,

Malle²,

Williams³

2021

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…However, the proposed principles should be useful beyond just the study of norm conflict, by striking a balance between specific recommendations and general recommendations applicable to other topics within moral HRI. For instance, it will be important to also understand human responses to robots that refuse to engage in norm violating commands [13], that attempt to address or rebuke human norm violation [91], or that engage in moral communications to encourage norm compliance (see [46,88]), to name a few. One or more of the principles in the present framework should apply to conducting experimental studies of human responses to these topics.…”

Section: General Discussion and Future Workmentioning

confidence: 99%

Systematic methods for Moral HRI: Studying human responses to robot norm conflicts

Phillips¹,

Malle²,

Kim

2023

Preprint

View full text Add to dashboard Cite

Robots are increasingly taking on roles in contexts in which ethical decision making is necessary. In this paper, we offer a set of tools to study one central capacity of future moral robots: to have norm competence and, in particular, to make acceptable decisions when moral norms conflict with one another. Our efforts are in line with growing trends in the community to create and share systematic and replicable methods as well as validated testbeds, measures, and open datasets. Specifically, we propose four principal requirements for systematic research on human responses to robots’ choices to resolve norm conflicts and on their sequelae---human moral judgments, potential loss of trust, and robot mitigations to regain that trust. We also share a series of validated testbeds in the form of moral dilemmas. We detail our procedures and results of a human-subjects experiment (N=1,573) to validate these moral dilemmas as demonstrating high levels of norm conflict and thus well suited to study human-robot interaction in light of such norm conflicts. From these efforts we provide for the community an integrated framework of methodological tools for Moral HRI.

show abstract

“…However, describing precisely when and how robots will exert moral influence is challenging. To illustrate, some research showed evidence that robots can influence humans in both morally positive and morally negative ways [1,2,9], but other research where robots were explicitly designed to exert moral influence on people failed to do so at all [4].…”

Section: Introductionmentioning

confidence: 99%

Perspectives on Moral Agency in Human-Robot Interaction

Kim

Phillips

Williams

et al. 2023

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

Self Cite

View full text Add to dashboard Cite

Establishing when, how, and why robots should be considered moral agents is key for advancing human-robot interaction. For instance, whether a robot is considered a moral agent has significant implications for how researchers, designers, and users can, should, and do make sense of robots and whether their agency in turn triggers social and moral cognitive and behavioral processes in humans. Robotic moral agency also has significant implications for how people should and do hold robots morally accountable, ascribe blame to them, develop trust in their actions, and determine when these robots wield moral influence. In this workshop on Perspectives on Moral Agency in Human-Robot Interaction, we plan to bring together participants who are interested in or have studied the topics concerning a robot's moral agency and its impact on human behavior. We intend to provide a platform for holding interdisciplinary discussions about (1) which elements should be considered to determine the moral agency of a robot, (2) how these elements can be measured, (3) how they can be realized computationally and applied to the robotic system, and (4) what societal impact is anticipated when moral agency is assigned to a robot. We encourage participants from diverse research fields, such as computer science, psychology, cognitive science, and philosophy, as well as participants from social groups marginalized in terms of gender, ethnicity, and culture. CCS CONCEPTS• Human-centered computing → HCI theory, concepts and models.

show abstract

Comparing Strategies for Robot Communication of Role-Grounded Moral Norms

Cited by 9 publications

References 20 publications

I Need Your Advice... Human Perceptions of Robot Moral Advising Behaviors

I Need Your Advice... Human Perceptions of Robot Moral Advising Behaviors

Systematic methods for Moral HRI: Studying human responses to robot norm conflicts

Perspectives on Moral Agency in Human-Robot Interaction

Contact Info

Product

Resources

About