Recommendations for Future Development of Artificial Agents [Commentary]

Johnson, Deborah G.; Noorman, Merel

doi:10.1109/mts.2014.2363978

“…In the case of autonomy, this would be a result of autonomous vehicles being programmed to learn as they operate. This would also mean that not even the human initially responsible for programming these vehicles, would be able to understand or predict the processes underpinning artificial agent decision making in future scenarios [26].…”

Section: 2mentioning

confidence: 99%

Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018)

2019

Advances in Intelligent Systems and Computing

5

0

View full text Add to dashboard Cite

Automated vehicles are expected to revolutionise everyday travel with anticipated benefits of improved road safety, comfort and mobility. However, they also raise complex ethical challenges. Ethical debates have primarily centred around moral judgements that must be made by autonomous vehicles in safetycritical situations, with proposed solutions typically based on deontological principles or consequentialism. However, ethics should also be acknowledged in the design, development and deployment of partially-automated systems that invariably rely upon the human driver to monitor and intervene when required, even though they may be ill-prepared to do so. In this literature review, we explore the lesser-discussed ethics associated with the role of, and expectations placed upon, the human driver in partially-automated vehicles, discussing factors such as the marketing and deployment of these vehicles, and the impact upon the human driver's development of trust and complacency in automated functionality, concluding that the human driver must be kept 'in the loop' at all times.

show abstract

“…In software development, however, and here particularly in the development of autonomous agents, authenticity considerations as such are often missing. Johnson and Noorman emphasis this lack by saying that "responsibility issues should be addressed when artificial agent technologies are in the early stages of development" [39].…”

Section: Authenticity Of Agentsmentioning

confidence: 99%

Perceptions on Authenticity in Chat Bots

Neururer

¹

,

Schlögl

²

,

Brinkschulte

³

et al. 2018

MTI

View full text Add to dashboard Cite

In 1950, Alan Turing proposed his concept of universal machines, emphasizing their abilities to learn, think, and behave in a human-like manner. Today, the existence of intelligent agents imitating human characteristics is more relevant than ever. They have expanded to numerous aspects of daily life. Yet, while they are often seen as work simplifiers, their interactions usually lack social competence. In particular, they miss what one may call authenticity. In the study presented in this paper, we explore how characteristics of social intelligence may enhance future agent implementations. Interviews and an open question survey with experts from different fields have led to a shared understanding of what it would take to make intelligent virtual agents, in particular messaging agents (i.e., chat bots), more authentic. Results suggest that showcasing a transparent purpose, learning from experience, anthropomorphizing, human-like conversational behavior, and coherence, are guiding characteristics for agent authenticity and should consequently allow for and support a better coexistence of artificial intelligence technology with its respective users.

show abstract

Keeping the Driver in the Loop: The ‘Other’ Ethics of Automation

Banks¹,

Shaw

²

,

Large

³

2018

Advances in Intelligent Systems and Computing

View full text Add to dashboard Cite

Automated vehicles are expected to revolutionise everyday travel with anticipated benefits of improved road safety, comfort and mobility. However, they also raise complex ethical challenges. Ethical debates have primarily centred around moral judgements that must be made by autonomous vehicles in safetycritical situations, with proposed solutions typically based on deontological principles or consequentialism. However, ethics should also be acknowledged in the design, development and deployment of partially-automated systems that invariably rely upon the human driver to monitor and intervene when required, even though they may be ill-prepared to do so. In this literature review, we explore the lesser-discussed ethics associated with the role of, and expectations placed upon, the human driver in partially-automated vehicles, discussing factors such as the marketing and deployment of these vehicles, and the impact upon the human driver's development of trust and complacency in automated functionality, concluding that the human driver must be kept 'in the loop' at all times.

show abstract

Recommendations for Future Development of Artificial Agents [Commentary]

Abstract: A IEEE TECHNOLOGY AND SOCIETY MAGAZINE | WINTER 2014 | 23 recommendations here along with our rationale for putting them forward.

Cited by 5 publications

References 27 publications

Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018)

Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018)

Perceptions on Authenticity in Chat Bots

Keeping the Driver in the Loop: The ‘Other’ Ethics of Automation

Contact Info

Product

Resources

About