Ethical Implications of Artificial Intelligence in Population Health and the Public’s Role in Its Governance: Perspectives From a Citizen and Expert Panel

Abstract

Background Artificial intelligence (AI) systems are widely used in the health care sector. Mainly applied for individualized care, AI is increasingly aimed at population health. This raises important ethical considerations but also calls for responsible governance, considering that this will affect the population. However, the literature points to a lack of citizen participation in the governance of AI in health. Therefore, it is necessary to investigate the governance of the ethical and societal implications of AI in population health. Objective This study aimed to explore the perspectives and attitudes of citizens and experts regarding the ethics of AI in population health, the engagement of citizens in AI governance, and the potential of a digital app to foster citizen engagement. Methods We recruited a panel of 21 citizens and experts. Using a web-based survey, we explored their perspectives and attitudes on the ethical issues of AI in population health, the relative role of citizens and other actors in AI governance, and the ways in which citizens can be supported to participate in AI governance through a digital app. The responses of the participants were analyzed quantitatively and qualitatively. Results According to the participants, AI is perceived to be already present in population health and its benefits are regarded positively, but there is a consensus that AI has substantial societal implications. The participants also showed a high level of agreement toward involving citizens into AI governance. They highlighted the aspects to be considered in the creation of a digital app to foster this involvement. They recognized the importance of creating an app that is both accessible and transparent. Conclusions These results offer avenues for the development of a digital app to raise awareness, to survey, and to support citizens’ decision-making regarding the ethical, legal, and social issues of AI in population health.

Exploring the Efficacy and Potential of Large Language Models for Depression: A Systematic Review

“…These findings also underscore ethical concerns surrounding the widespread use of AI in mental health and highlight significant concerns regarding the impact of AI on human well-being. Among these are the risk of medical errors, potential discrimination that may exacerbate health disparities (58), and the spread of misleading medical information or unverified treatments that could compromise general practitioners’ understanding of medical conditions (59). Despite the potential of AI to enhance medical training through realistic patient scenarios, the risks associated with its misuse remain a critical consideration (60).…”

Perceptions and concerns of emergency medicine practitioners about artificial intelligence in emergency triage management during the pandemic: a national survey-based study

“…We believe that, as a pilot study in the early stages of the AI era, our research will shed light on future applications. Aside from these, numerous ethical issues concerning various AI usage domains can be discussed ( 26 ).…”

Moral Values in Medical AI: A Scoping Review

“…For example, scholars argue that a number of AI technologies are less accurate or outright fail at their objective when being used for populations and individuals that are underrepresented in the training data [e.g. 38,39]. Moreover, medical AI poses numerous ethical concerns regarding issues such as patient privacy, informed consent, and autonomy.…”

“…The literature on the design of healthcare technologies is vast, focusing as it does on the identi cation of needs, the effectiveness of the approach or device, best practices or regulatory expectations for research and development (R&D), social acceptability, the demands of responsible innovation, and so forth. Interestingly, what emerges from the literature on the ethics of AI in healthcare shows that there is a certain exceptionalism in the design, R&D, regulation and use of AI in healthcare that calls for attention to the very foundations on which the assessment of these technologies must be made [39]. One of these foundations, which is postulated as being exceptional, is the axiological foundations (viz., values) that underpin the development of AI in healthcare.…”