Lessons learned from developing a COVID-19 algorithm governance framework in Aotearoa New Zealand

Abstract

Aotearoa New Zealand’s response to the COVID-19 pandemic has included the use of algorithms that could aid decision making. Te Pokapū Hātepe o Aotearoa, the New Zealand Algorithm Hub, was established to evaluate and host COVID-19 related models and algorithms, and provide a central and secure infrastructure to support the country’s pandemic response. A critical aspect of the Hub was the formation of an appropriate governance group to ensure that algorithms being deployed underwent cross-disciplinary scrutiny prior to being made available for quick and safe implementation. This framework necessarily canvassed a broad range of perspectives, including from data science, clinical, Māori, consumer, ethical, public health, privacy, legal and governmental perspectives. To our knowledge, this is the first implementation of national algorithm governance of this type, building upon broad local and global discussion of guidelines in recent years. This paper describes the experiences and lessons learned through this process from the perspective of governance group members, emphasising the role of robust governance processes in building a high-trust platform that enables rapid translation of algorithms from research to practice.

An example of governance for AI in health services from Aotearoa New Zealand

“…It could be argued that one national approach is entirely appropriate in a country with a relatively small population. The national health service (Te Whatu Ora) has established a national expert advisory group that will build on this work as well as the lessons learned from developing a COVID-19 algorithm governance framework 15 . The intention is to provide expert advice and assistance in the development and implementation of AI tools across the country.…”

“… Topol The Topol Review – Preparing the healthcare workforce to deliver the digital future 20 An independent review conducted for the NHS on key digital technologies, barriers to its adoption and potential solutions to these barriers. Aotearoa NZ specific Hudson et al Te Ara Tika Guidelines for Māori Research Ethics 15 Provides a framework for researchers to work with Māori ensuring research is undertaken based on tikanga and matauranga Māori (Māori ethical principles and philosophies). ‘He Matapihi ki te Mana Rarauanga’ – Conceptualising Big Data through a Māori lens 21 Provides concepts of Māori Data Sovereignty and presents a framework for conceptualising data/AI through tikanga and matauranga.…”

“…Whilst several governance frameworks and supporting guidance materials have been published 8 , 10 – 14 minimal information has been published around the actual implementation of an AI governance body within a health service organisation. Further, there is little published that is specific to the Aotearoa New Zealand (NZ) context, beyond Te Pokapū Hātepe o Aotearoa, the New Zealand Algorithm Hub 15 .…”

Data and model bias in artificial intelligence for healthcare applications in New Zealand

“…In New Zealand, given the long history of racism toward Māori, the design and development of AI systems should feature a high degree of control by Māori (Wilson et al, 2022). This allows implementations to be fair and relevant to Māori, and serves Māori aspirations.…”

“…This includes access to and through healthcare and receipt of high-quality healthcare (Webster et al, 2022). In New Zealand, Māori experience significant inequities in health compared to the non-Indigenous population (Curtis et al, 2019;Webster et al, 2022;Wilson et al, 2022). Although Māori experience a high level of health care need, they receive less access to the full spectrum of health care services and poorer care throughout, from preventative to tertiary care (Curtis et al, 2019;Webster et al, 2022).…”