Crowdsourcing moral machines

Awad, Edmond; Dsouza, Sohan; Bonnefon, Jean‐François; Rahwan, Iyad

doi:10.1145/3339904

Cited by 51 publications

(37 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The ethical challenges facing AVs—especially the trolley-type dilemmas of protecting the passengers versus pedestrians—has been a topic of intense investigation as well as of debate. The highly publicized MME (Awad et al, 2018 ) and other prominent works (Rahwan, 2018 ; Awad et al, 2020a , b ) are based on the premise that EDs are a critical challenge to address for the consumer adoption of AVs. Not adequately addressing this issue could lead consumers to shun AVs, and thus nullify all their promised benefits (Bonnefon et al, 2020a ).…”

Section: Discussionmentioning

confidence: 99%

“…Several scholars and manufacturers point out the near impossibility and frivolousness of solving this issue (De Frietas et al, 2020 ; 2021 ). On the other hand, behavioral science researchers consider public opinion as a necessary input in deciding about the ethical principles for AVs (Awad et al, 2018 , 2020a , b ). Many policy makers, such as the European Commission’s CAV2020 report have suggested that EDs can be adequately solved if AVs follow a continuous risk management process in its operation.…”

Section: Discussionmentioning

confidence: 99%

“…The second issue of whether public opinion is the best way to offer a solution to EDs, or it should be left in the hands of experts, is not the emphasis of the current research. This issue has been discussed extensively in other avenues (e.g., Rahwan, 2018 ; Awad et al, 2020a , b ). As such, most behavioral studies on EDs have assumed that these dilemmas are important for consumers and thus appropriate solutions should be found.…”

Section: Research and Debate On The Relevance Of Edsmentioning

confidence: 98%

“…Several large-scale behavioral studies using such EDs—modelled after the classic trolley problem (Foot, 1967 ; Thomson, 1985 ) in moral psychology—have been published in prestigious academic outlets (e.g., Awad et al, 2018 ; Bonnefon et al, 2016 ). These studies are based on the premise that EDs are extremely important to address for consumer acceptance of AVs, and the solution to these dilemmas is best determined by seeking public opinion on this matter (Awad et al, 2020a , b ; Rahwan, 2018 ). Moreover, not addressing this issue could lead to an ethical opt-out problem (Bonnefon et al, 2020a ).…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Ethical dilemmas are really important to potential adopters of autonomous vehicles

Gill

2021

Ethics Inf Technol

View full text Add to dashboard Cite

The ethical dilemma (ED) of whether autonomous vehicles (AVs) should protect the passengers or pedestrians when harm is unavoidable has been widely researched and debated. Several behavioral scientists have sought public opinion on this issue, based on the premise that EDs are critical to resolve for AV adoption. However, many scholars and industry participants have downplayed the importance of these edge cases. Policy makers also advocate a focus on higher level ethical principles rather than on a specific solution to EDs. But conspicuously absent from this debate is the view of the consumers or potential adopters, who will be instrumental to the success of AVs. The current research investigated this issue both from a theoretical standpoint and through empirical research. The literature on innovation adoption and risk perception suggests that EDs will be heavily weighted by potential adopters of AVs. Two studies conducted with a broad sample of consumers verified this assertion. The results from these studies showed that people associated EDs with the highest risk and considered EDs as the most important issue to address as compared to the other technical, legal and ethical issues facing AVs. As such, EDs need to be addressed to ensure robustness in the design of AVs and to assure consumers of the safety of this promising technology. Some preliminary evidence is provided about interventions to resolve the social dilemma in EDs and about the ethical preferences of prospective early adopters of AVs.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Research and Debate On The Relevance Of Edsmentioning

confidence: 98%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Ethical dilemmas are really important to potential adopters of autonomous vehicles

Gill

2021

Ethics Inf Technol

View full text Add to dashboard Cite

show abstract

“…Despite these technological advancements, AV accidents cannot be entirely eliminated ( Goodall, 2014b ; Bonnefon et al, 2016 ; Guo et al, 2018 ; Nyholm and Smids, 2018 ). In this regard, AVs are among the first autonomous agents that make decisions with potential life-and-death consequences ( Awad et al, 2020 ). While vehicle accidents have existed, the introduction of AVs has shifted ethical implications during accidents Danielson (2015) , Shariff et al (2017) , Awad et al (2018a) , Taddeo & Floridi (2018) because humans and AVs make intrinsically different ethical decisions.…”

Section: Introductionmentioning

confidence: 99%

A Deeper Look at Autonomous Vehicle Ethics: An Integrative Ethical Decision-Making Framework to Explain Moral Pluralism

et al. 2021

View full text Add to dashboard Cite

The autonomous vehicle (AV) is one of the first commercialized AI-embedded robots to make autonomous decisions. Despite technological advancements, unavoidable AV accidents that result in life-and-death consequences cannot be completely eliminated. The emerging social concern of how an AV should make ethical decisions during unavoidable accidents is referred to as the moral dilemma of AV, which has promoted heated discussions among various stakeholders. However, there are research gaps in explainable AV ethical decision-making processes that predict how AVs’ moral behaviors are made that are acceptable from the AV users’ perspectives. This study addresses the key question: What factors affect ethical behavioral intentions in the AV moral dilemma? To answer this question, this study draws theories from multidisciplinary research fields to propose the “Integrative ethical decision-making framework for the AV moral dilemma.” The framework includes four interdependent ethical decision-making stages: AV moral dilemma issue framing, intuitive moral reasoning, rational moral reasoning, and ethical behavioral intention making. Further, the framework includes variables (e.g., perceived moral intensity, individual factors, and personal moral philosophies) that influence the ethical decision-making process. For instance, the framework explains that AV users from Eastern cultures will tend to endorse a situationist ethics position (high idealism and high relativism), which views that ethical decisions are relative to context, compared to AV users from Western cultures. This proposition is derived from the link between individual factors and personal moral philosophy. Moreover, the framework proposes a dual-process theory, which explains that both intuitive and rational moral reasoning are integral processes of ethical decision-making during the AV moral dilemma. Further, this framework describes that ethical behavioral intentions that lead to decisions in the AV moral dilemma are not fixed, but are based on how an individual perceives the seriousness of the situation, which is shaped by their personal moral philosophy. This framework provides a step-by-step explanation of how pluralistic ethical decision-making occurs, reducing the abstractness of AV moral reasoning processes.

show abstract

Crowdsourcing a Moral Machine in a Pluralistic World

Firenze

2023

Philosophy of Engineering and Technology

View full text Add to dashboard Cite

Crowdsourcing moral machines

Abstract: A platform for creating a crowdsourced picture of human opinions on how machines should handle moral dilemmas.

Cited by 51 publications

References 21 publications

Ethical dilemmas are really important to potential adopters of autonomous vehicles

Ethical dilemmas are really important to potential adopters of autonomous vehicles

A Deeper Look at Autonomous Vehicle Ethics: An Integrative Ethical Decision-Making Framework to Explain Moral Pluralism

Crowdsourcing a Moral Machine in a Pluralistic World

Contact Info

Product

Resources

About