Digital Futures in Mind: Reflecting on Technological Experiments in Mental Health & Crisis Support

Artificial intelligence (AI) and machine learning (ML) based decision support systems in mental health: An integrative review

“…Consideration must also be given to the clinical and professional accountability of AI/ML based supported decision making. The accountability for AI systems in the mental health context must be appropriately distributed, with suitable solutions in place (Gooding et al 2022). The attribution of accountability and responsibility is vital for not only those affected using the tools but also for public trust in AI solutions.…”

“…The attribution of accountability and responsibility is vital for not only those affected using the tools but also for public trust in AI solutions. There must be adequate opportunity to integrate the objectives, outcomes and trade-offs that come with the use of AI, however clinician accountability is yet to be clearly defined (Gooding et al 2022). Both clinicians and patients, that is, end-users, should be involved in the development and design of new health technologies.…”

“…Both clinicians and patients, that is, end-users, should be involved in the development and design of new health technologies. The very people who stand to benefit the most from new technologies in mental health care are often missed in the research design and reporting of innovation in the literature (Gooding et al 2022), their omission compromises user-centred design and denies them authentic contribution in partnership with clinicians to promote development and creation of potentially powerful shared decision making platforms. Finally, as more AI/ML based interventions are introduced into healthcare settings, often presented as a panacea for many problems, using an algorithm that performs well will not necessarily equate to better care.…”

“…Future innovations should consider potential iatrogenic harms to ensure safety (Farthing et al 2021), especially with vulnerable or already disadvantaged populations (World Health Organization 2021). Of particular note, there is very limited involvement overall of the inclusion of lived experience service users (Gooding et al 2022), that is, the very people who are supposed to gain the greatest benefit from these innovations. It is recommended that future research be framed to understand better how the use of AI/ML in the delivery of care will affect those with a lived experience of mental illness, especially psychosis (Higgins et al 2022).…”

“…AI is an emerging technology with considerable push momentum for application across many fields. Despite this, the current market, especially in mental health, is still speculative in its potential (Gooding et al 2022). Overall, much of the literature remains in pilot or exploratory stages and is most frequently located in the computer science field (Gooding & Kariotis 2021).…”