On the ethics of algorithmic decision-making in healthcare

Abstract

In recent years, a plethora of high-profile scientific publications has been reporting about machine learning algorithms outperforming clinicians in medical diagnosis or treatment recommendations. This has spiked interest in deploying relevant algorithms with the aim of enhancing decision-making in healthcare. In this paper, we argue that instead of straightforwardly enhancing the decision-making capabilities of clinicians and healthcare institutions, deploying machines learning algorithms entails trade-offs at the epistemic and the normative level. Whereas involving machine learning might improve the accuracy of medical diagnosis, it comes at the expense of opacity when trying to assess the reliability of given diagnosis. Drawing on literature in social epistemology and moral responsibility, we argue that the uncertainty in question potentially undermines the epistemic authority of clinicians. Furthermore, we elucidate potential pitfalls of involving machine learning in healthcare with respect to paternalism, moral responsibility and fairness. At last, we discuss how the deployment of machine learning algorithms might shift the evidentiary norms of medical diagnosis. In this regard, we hope to lay the grounds for further ethical reflection of the opportunities and pitfalls of machine learning for enhancing decision-making in healthcare.

Clinical Knowledge Graph Integrates Proteomics Data into Clinical Decision-Making

“…A next step could be the integration of electronic patient records (EHRs) into the graph, which has been suggested as a way to bridge the gap between research and direct patient care (Jensen et al, 2014;Nelson et al, 2019). However, this will require addressing a plethora of regulatory and ethical issues (Abul-Husn and Kenny, 2019; Grote and Berens, 2020). Medical institutions in different geographical areas often have different database systems and data formats, making data harmonization difficult.…”

Designing Futuristic Telemedicine Using Artificial Intelligence and Robotics in the COVID-19 Era

“…Furthermore, rigid algorithm protocols and decision-making trees are subject to the consequences of the inability of AI to fully take in and interpret contextual information or delineate between relevant vs. non-relevant informational input even when employing deep machine learning (23). Contingencies are the norm in healthcare, and the human skill required to navigate and manage this offnominal, or unpredictable situations must be carefully weighed against the advantages of using AI technology (23)(24)(25)(26)(27)(28). User interface and data input methods are critical as voice recognition and interpretation is a major challenge of AI utilization (29).…”

How to achieve trustworthy artificial intelligence for health

“…For example, while robots could be useful in the care of the elderly, there are risks of reduced contact between humans, the deception of encouraging companionship with a machine and loss of control over a person's own life. 5 Questions have also been raised about the extent to which artificial intelligence technologies could replace clinicians 6 and, if so, whether the opacity of machine learning-based decisions weaken the authority of clinicians, threaten patients' autonomy 7 or jeopardize shared decision-making between doctor and patient. 8 Discussions of the risks posed by artificial intelligence systems range from current concerns, such as violations of privacy or harmful effects on society, to debates about whether machines could ever escape from human control.…”