AI apology: interactive multi-objective reinforcement learning for human-aligned AI

Abstract

For an Artificially Intelligent (AI) system to maintain alignment between human desires and its behaviour, it is important that the AI account for human preferences. This paper proposes and empirically evaluates the first approach to aligning agent behaviour to human preference via an apologetic framework. In practice, an apology may consist of an acknowledgement, an explanation and an intention for the improvement of future behaviour. We propose that such an apology, provided in response to recognition of undesirable behaviour, is one way in which an AI agent may both be transparent and trustworthy to a human user. Furthermore, that behavioural adaptation as part of apology is a viable approach to correct against undesirable behaviours. The Act-Assess-Apologise framework potentially could address both the practical and social needs of a human user, to recognise and make reparations against prior undesirable behaviour and adjust for the future. Applied to a dual-auxiliary impact minimisation problem, the apologetic agent had a near perfect determination and apology provision accuracy in several non-trivial configurations. The agent subsequently demonstrated behaviour alignment with success that included up to complete avoidance of the impacts described by these objectives in some scenarios.

Beyond the Business Case for Responsible Artificial Intelligence: Strategic CSR in Light of Digital Washing and the Moral Human Argument

“…While organizations are generally embracing AI-related CSR strategies proactively [65], voluntary engagement in the effective taming of AI's social impact is still in its infancy. Nonetheless, the business case for investing in CSR linked to AI has already gained popularity; by focusing on maximizing AI's business potentiality while minimizing its threats, organizations are aiming at exploiting social disruption brought by AI for business opportunities [3,66]. Nonetheless, the ethical consequences of the future steps of AI foresee a much harder challenge than trying to align business and ethical considerations in the short term due to AI's forecasted ability (although still debated) to surpass human work capabilities in many sectors [3].…”