Fracking our humanity

AI knows best? Avoiding the traps of paternalism and other pitfalls of AI-based patient preference prediction

“…Jesudason states that using an AI to predict preferences may contribute to ‘fracking our humanity’ 9. To support this view, Jesudason states that ‘[t]o deliberate together for incapacitated others is among those solemn privileges that verify our humanity’9 and ‘[h]aving AI mine these delicate pain-forests risks treating our suffering as the new oil—to be extracted and exploited, but beyond our vision and at our cost’ 9. We believe an AI is an artefact—a combined product of epistêmê and technē—and the extent to which it retains and expresses parts of our humanity depends on how it is designed and used.…”