Algorithmic constructions of risk: Anticipating uncertain futures in child protection services

Abstract

This paper examines how predictive algorithms construct risk by calculating and anticipating children's uncertain futures. Theoretically, we analyze algorithmic risk construction by attending to (a) the problematizations justifying algorithmic prediction, (b) their underpinning data infrastructures, and (c) the configurations of agencies across humans and machines. Empirically, we examine two experiments in Danish child protection services that developed algorithmic models to predict children's maltreatment. Our analysis highlights how algorithmic predictions can create different notions of risk. The first case used predictive algorithms to supplement human risk assessments with data from child protection services, while the second case aimed to detect risk early by constructing parents as risk factors, requiring data from other welfare sectors. By comparing these cases, we highlight two distinct risk constructions: one that uses algorithmic prediction to manage uncertainty and another that seeks to eliminate undesired futures by preempting risk. These different constructions have implications for how the present is viewed as a moment of intervention and for how families are constructed as “risk objects.”

Ethical Plateaus in Danish Child Protection Services

“…Callon, 1986) of this situation, two (the municipalities) targeting the massive amounts of notifications, one (RISK) targeting the assessment of these notifications and, finally, one (Gladsaxe) trying to pre-empt notifications through early intervention (cf. Ratner and Elmholdt, 2023).…”

“…The decision-support model was thus made valuable as a potential to help children but also a as research project assessing the efficiency of such a tool. Although sharing with Gladsaxe the objective of improving child protection, RISK's model also differs in important ways (Ratner and Elmholdt, 2023). First, rather than predicting risk before symptoms occur, RISK aimed predicting risk after symptoms had been notified.…”