2018
DOI: 10.1609/aaai.v32i1.11498
|View full text |Cite
|
Sign up to set email alerts
|

A Low-Cost Ethics Shaping Approach for Designing Reinforcement Learning Agents

Abstract: This paper proposes a low-cost, easily realizable strategy to equip a reinforcement learning (RL) agent the capability of behaving ethically. Our model allows the designers of RL agents to solely focus on the task to achieve, without having to worry about the implementation of multiple trivial ethical patterns to follow. Based on the assumption that the majority of human behavior, regardless which goals they are achieving, is ethical, our design integrates human policy with the RL policy to achieve the target … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
9
0
3

Year Published

2020
2020
2023
2023

Publication Types

Select...
5
2

Relationship

0
7

Authors

Journals

citations
Cited by 29 publications
(12 citation statements)
references
References 24 publications
0
9
0
3
Order By: Relevance
“…The second response is that using AI to perform the driving changes the scenario, in an ethically relevant sense. With image recognition systems and state-of-the-art cameras, it is possible 42 for cars to detect objects in the road earlier, and make decisions 43 such as braking or dodging quickly, thus making it possible to dramatically reduce the number of animals hit. This may not be possible yet, but we believe that it will be in future.…”
Section: The Ai Industry's Moral Responsibility (To All Sentient Beings)mentioning
confidence: 99%
See 2 more Smart Citations
“…The second response is that using AI to perform the driving changes the scenario, in an ethically relevant sense. With image recognition systems and state-of-the-art cameras, it is possible 42 for cars to detect objects in the road earlier, and make decisions 43 such as braking or dodging quickly, thus making it possible to dramatically reduce the number of animals hit. This may not be possible yet, but we believe that it will be in future.…”
Section: The Ai Industry's Moral Responsibility (To All Sentient Beings)mentioning
confidence: 99%
“…com/ en-ca/ suppo rt/ topics/ use-your-car/ carfunct ions/ large-animal-detec tion https:// twitt er. com/ waymo/ status/ 13219 59096 37174 8868 43 We speculate that, in the future, such decisions could be done by the AI system making calculations about probabilities of different situations and outcomes, and assign weights to come up with good deci- 44 If hitting an animal is unavoidable, should a self-driving car's system prefer to instantly kill the animal instead of fatally injuring it? We think it should.…”
Section: Algorithmic Bias Against Animalsmentioning
confidence: 99%
See 1 more Smart Citation
“…According to Table 2, the correlation coefficient is 1.60. Firstly, the probability of the straight being protector is calculated by formula (12).…”
Section: Decision Mechanismmentioning
confidence: 99%
“…When a decision made by a machine is an action that mankind thinks should not be done, the machine is punished to minimize the occurrence of such action. Otherwise, the action taken by the machine is encouraged to increase occurrence of such action [12]. Maximilian Geisslinger et al studied how unmanned vehicles make router planning and control decisions in ethical dilemmas from risk ethics theory.…”
Section: Introductionmentioning
confidence: 99%