Negotiating autonomy and responsibility in military robots

Noorman, Merel; Johnson, Deborah G.

doi:10.1007/s10676-013-9335-0

Cited by 50 publications

(28 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…What would happen if, in the future, autonomous robots were given full responsibility for their actions and outcomes [21,24]? Some researchers including Deborah Johnson believe that it is dangerous to give robots full responsibility for their actions because they might go beyond the programmers' control [17].…”

Section: Can Robots Be Responsible?mentioning

confidence: 99%

Ethical Decision Making in Robots: Autonomy, Trust and Responsibility

Alaieri

Vellino

2016

Social Robotics

View full text Add to dashboard Cite

Abstract. Autonomous robots such as self-driving cars are already able to make decisions that have ethical consequences. As such machines make increasingly complex and important decisions, we will need to know that their decisions are trustworthy and ethically justified. Hence we will need them to be able to explain the reasons for these decisions: ethical decision-making requires that decisions be explainable with reasons. We argue that for people to trust autonomous robots we need to know which ethical principles they are applying and that their application is deterministic and predictable. If a robot is a self-improving, self-learning type of robot whose choices and decisions are based on past experience, which decision it makes in any given situation may not be entirely predictable ahead of time or explainable after the fact. This combination of non-predictability and autonomy may confer a greater degree of responsibility to the machine but it also makes them harder to trust.

show abstract

Section: Can Robots Be Responsible?mentioning

confidence: 99%

Ethical Decision Making in Robots: Autonomy, Trust and Responsibility

Alaieri

Vellino

2016

Social Robotics

View full text Add to dashboard Cite

show abstract

“…При этом авторы, вводя понятие автономность для систем различного на-значения, исходят из тех целей, которые ставят в своем исследовании [14], -на-пример, для систем электроснабжения [15], компьютерных систем [16], роботов [17] и пр. Опыт, обобщенный в работе [18], позволил сформулировать определе-ние автономной системы как системы, способной функционировать в реальной среде без внешнего управления достаточно продолжительное время.…”

Section: рациональность автономность и степень интеллектуальностиunclassified

Autonomy and the Intelligence Degree of the Complex Technical Systems

Shcherbatov¹

2016

Inform.sist.upr.

View full text Add to dashboard Cite

“…Once the system is built, it is expected to perform the specified task repeatedly and no decisions, other than that specified at design time, are made by the system itself. Noorman and Johnson [11] refer to automatic systems as 'autonomous systems'. We however want to differentiate systems that are truly AI-based from systems that merely 'automate' the required process.…”

Section: A Automatic Systemsmentioning

confidence: 99%

“…This enables us to take the very first steps towards formulating guidelines and policies in order to fill the "policy vacuum" as defined by Moor [6]. The idea of ethical "responsibility" ("accountability") of software agents is strongly criticized and refuted by many [11]. Critics argue that the designers and developers can still influence the decisions of the software, as they develop and deploy its first version, which then is allowed to "learn" from its interactions with the environment.…”

Section: The Ethical Challenge Of Embedded and Cyber-physical Sysmentioning

confidence: 99%

Ethics Aspects of Embedded and Cyber-Physical Systems

Thekkilakattil

Dodig-Crnković

2015

2015 IEEE 39th Annual Computer Software and Applications Conference

View full text Add to dashboard Cite

Abstract-The growing complexity of software employed in the cyber-physical domain is calling for a thorough study of both its functional and extra-functional properties. Ethical aspects are among important extra-functional properties, that cover the whole life cycle with different stages from design, development, deployment/production to use of cyber physical systems. One of the ethical challenges involved is the question of identifying the responsibilities of each stakeholder associated with the development and use of a cyber-physical system. This challenge is made even more pressing by the introduction of autonomous increasingly intelligent systems that can perform functionalities without human intervention, because of the lack of experience, best practices and policies for such technology.In this article, we provide a framework for responsibility attribution based on the amount of autonomy and automation involved in AI based cyber-physical systems. Our approach enables traceability of anomalous behaviors back to the responsible agents, be they human or software, allowing us to identify and separate the "responsibility" of the decision-making software from human responsibility. This provides us with a framework to accommodate the ethical "responsibility" of the software for AI based cyber-physical systems that will be deployed in the future, underscoring the role of ethics as an important extra-functional property. Finally, this systematic approach makes apparent the need for rigorous communication protocols between different actors associated with the development and operation of cyberphysical systems that further identifies the ethical challenges involved in the form of group responsibilities.

show abstract

Negotiating autonomy and responsibility in military robots

Cited by 50 publications

References 22 publications

Ethical Decision Making in Robots: Autonomy, Trust and Responsibility

Ethical Decision Making in Robots: Autonomy, Trust and Responsibility

Autonomy and the Intelligence Degree of the Complex Technical Systems

Ethics Aspects of Embedded and Cyber-Physical Systems

Contact Info

Product

Resources

About