Safety and Ethical Concerns in Mixed Human-Robot Control of Vehicles

Kádár, Endre E.; Köszeghy, A; Virk, G.S.

doi:10.1007/978-3-319-46667-5_10

Cited by 3 publications

(2 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another option for engineers is to design the AI to behave as a person would behave. This second option is the one reported by, for example, Kadar et al (2017). After analyzing some accidents in recent years in which poor interaction between human agents and intelligent automated agents can be identified (the Alvia train crash on the route from Madrid to Santiago de Compostela, the Air France Flight 447 crash and the Asiana Airlines Flight 214 crash), the authors concluded that these accidents occurred largely because the artificial intelligence control strategies for the automated vehicle control were not the same as or similar to those used by human controllers and/or were not used in a similar way.…”

Section: Improving Collaboration So That It Is Ethically Correct (Act...mentioning

confidence: 99%

AI and Ethics When Human Beings Collaborate With AI Agents

Cañas

2022

Front. Psychol.

View full text Add to dashboard Cite

The relationship between a human being and an AI system has to be considered as a collaborative process between two agents during the performance of an activity. When there is a collaboration between two people, a fundamental characteristic of that collaboration is that there is co-supervision, with each agent supervising the actions of the other. Such supervision ensures that the activity achieves its objectives, but it also means that responsibility for the consequences of the activity is shared. If there is no co-supervision, neither collaborator can be held co-responsible for the actions of the other. When the collaboration is between a person and an AI system, co-supervision is also necessary to ensure that the objectives of the activity are achieved, but this also means that there is co-responsibility for the consequences of the activities. Therefore, if each agent's responsibility for the consequences of the activity depends on the effectiveness and efficiency of the supervision that that agent performs over the other agent's actions, it will be necessary to take into account the way in which that supervision is carried out and the factors on which it depends. In the case of the human supervision of the actions of an AI system, there is a wealth of psychological research that can help us to establish cognitive and non-cognitive boundaries and their relationship to the responsibility of humans collaborating with AI systems. There is also psychological research on how an external observer supervises and evaluates human actions. This research can be used to programme AI systems in such a way that the boundaries of responsibility for AI systems can be established. In this article, we will describe some examples of how such research on the task of supervising the actions of another agent can be used to establish lines of shared responsibility between a human being and an AI system. The article will conclude by proposing that we should develop a methodology for assessing responsibility based on the results of the collaboration between a human being and an AI agent during the performance of one common activity.

show abstract

Section: Improving Collaboration So That It Is Ethically Correct (Act...mentioning

confidence: 99%

AI and Ethics When Human Beings Collaborate With AI Agents

Cañas

2022

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…Perhaps a simple comparison against human performance would suffice (but human performance is also an issue [9]). Who is to say that humans in a split of a second can judge the number of lives of option A versus option B?…”

Section: Reflectionmentioning

confidence: 99%

Game Theory Formulation for Ethical Decision Making

Estivill‐Castro

2019

Robotics and Well-Being

View full text Add to dashboard Cite

The inclusion of autonomous robots among everyday human environments has suggested that these robots will be facing ethical decisions regarding trade-offs where machines will choose some human attributes over the attributes of other humans. We argue in this paper that on a regular instance, algorithms for such decisions should not only be deterministic but instead, the decision will be better framed as an optimal mixed strategy in the sense of Nash equilibria in game theory.

show abstract

Human Action Segmentation Based on a Streaming Uniform Entropy Slice Method

Peng

Huang

et al. 2018

IEEE Access

View full text Add to dashboard Cite

Safety and Ethical Concerns in Mixed Human-Robot Control of Vehicles

Cited by 3 publications

References 5 publications

AI and Ethics When Human Beings Collaborate With AI Agents

AI and Ethics When Human Beings Collaborate With AI Agents

Game Theory Formulation for Ethical Decision Making

Human Action Segmentation Based on a Streaming Uniform Entropy Slice Method

Contact Info

Product

Resources

About