Your Robot Therapist Will See You Now: Ethical Implications of Embodied Artificial Intelligence in Psychiatry, Psychology, and Psychotherapy

Abstract

Background Research in embodied artificial intelligence (AI) has increasing clinical relevance for therapeutic applications in mental health services. With innovations ranging from ‘virtual psychotherapists’ to social robots in dementia care and autism disorder, to robots for sexual disorders, artificially intelligent virtual and robotic agents are increasingly taking on high-level therapeutic interventions that used to be offered exclusively by highly trained, skilled health professionals. In order to enable responsible clinical implementation, ethical and social implications of the increasing use of embodied AI in mental health need to be identified and addressed. Objective This paper assesses the ethical and social implications of translating embodied AI applications into mental health care across the fields of Psychiatry, Psychology and Psychotherapy. Building on this analysis, it develops a set of preliminary recommendations on how to address ethical and social challenges in current and future applications of embodied AI. Methods Based on a thematic literature search and established principles of medical ethics, an analysis of the ethical and social aspects of currently embodied AI applications was conducted across the fields of Psychiatry, Psychology, and Psychotherapy. To enable a comprehensive evaluation, the analysis was structured around the following three steps: assessment of potential benefits; analysis of overarching ethical issues and concerns; discussion of specific ethical and social issues of the interventions. Results From an ethical perspective, important benefits of embodied AI applications in mental health include new modes of treatment, opportunities to engage hard-to-reach populations, better patient response, and freeing up time for physicians. Overarching ethical issues and concerns include: harm prevention and various questions of data ethics; a lack of guidance on development of AI applications, their clinical integration and training of health professionals; ‘gaps’ in ethical and regulatory frameworks; the potential for misuse including using the technologies to replace established services, thereby potentially exacerbating existing health inequalities. Specific challenges identified and discussed in the application of embodied AI include: matters of risk-assessment, referrals, and supervision; the need to respect and protect patient autonomy; the role of non-human therapy; transparency in the use of algorithms; and specific concerns regarding long-term effects of these applications on understandings of illness and the human condition. Conclusions We argue that embodied AI is a promising approach across the field of mental health; however, further research is needed to address the broader ethical and societal concerns of these technologies to negotiate best research and medical practices in innovative mental health care. We conclude by indicating areas o...

Artificial intelligence and the future of psychiatry: Insights from a global physician survey

“…The gender differences in AI risk perception noted in our survey are novel but may be commensurate with a large body of findings that women are more risk averse than men (24). Thus, female psychiatrists may be more cautious and circumspect in weighing up the benefits versus harms of AI/ML, especially where ambiguities persist with respect to ethics, biases, inequities, data privacy and risks of poorly validated "black box" algorithms (2,10,25). Unlike European countries which operate with universal health coverage and strict regulations about consumer and citizen data privacy, the US operates on multiple insurance-systems and has substantially weaker data privacy rules.…”

Special Section on Ethics in Health Informatics

“…Though data sharing and privacy dominated the results, the search for papers related to ELSI uncovered an emerging area of concern: the appropriate use and governance of artificial intelligence (AI) in informatics. Four papers addressed various aspects of ethics in AI, including the appropriate development, validation, and implementation of AI in patient care [19]; a proposed governance model for AI [20]; support for citizen trust when AI is in use [21]; and ethical issues related to the use of AI in psychiatry [22]. The ongoing development of methods for reliably using large, multimodal data sources, and the need for answers to clinical questions more quickly (e.g., successful treatments for particular conditions) ensure that AI will grow as a focus area for ethics within informatics.…”

What Makes a Social Robot Good at Interacting with Humans?

“…There are ethical concerns surrounding the use of social robots and most of the residents don't know for example, that Paro is not a real animal, which may have affected the way they interacted with Paro [24,40,41]. There has been some debate around whether it is unethical and involves deceit when social robots are used, for example, to provide emotional care and companionship to lonely older people [42][43][44][45][46]. If using social robots is deceitful, then can the deceit be eliminated with a human carer or can doctors/nurses regulate their emotions when involving care of patients [44,47]?…”