Predicting child maltreatment: A meta-analysis of the predictive validity of risk assessment instruments

Abstract

Risk assessment is crucial in preventing child maltreatment since it can identify high-risk cases in need of child protection intervention. Despite widespread use of risk assessment instruments in child welfare, it is unknown how well these instruments predict maltreatment and what instrument characteristics are associated with higher levels of predictive validity. Therefore, a multilevel meta-analysis was conducted to examine the predictive accuracy of (characteristics of) risk assessment instruments. A literature search yielded 30 independent studies (N=87,329) examining the predictive validity of 27 different risk assessment instruments. From these studies, 67 effect sizes could be extracted. Overall, a medium significant effect was found (AUC=0.681), indicating a moderate predictive accuracy. Moderator analyses revealed that onset of maltreatment can be better predicted than recurrence of maltreatment, which is a promising finding for early detection and prevention of child maltreatment. In addition, actuarial instruments were found to outperform clinical instruments. To bring risk and needs assessment in child welfare to a higher level, actuarial instruments should be further developed and strengthened by distinguishing risk assessment from needs assessment and by integrating risk assessment with case management.

Child maltreatment in the time of the COVID-19 pandemic: A proposed global framework on research, policy and practice

“…A second aspect is that despite the instruments performing better than clinical assessments, there is lack of evidence on how far they can help professionals with case support ( van der Put, Assink, & van Solinge, 2017 ). Those instruments are valuable as comparable measures of prevalence across countries.…”

Better Decisions for Children with “Big Data”: Can Algorithms Promote Fairness, Transparency and Parental Engagement?

“…He cited sixteen studies of human service professionals "in all but one of which the predictions made actuarially were either approximately equal or superior to those made by a clinician" [36] (p. 119). Over the next sixty years, further major studies would lend weight to these earlier findings [37][38][39][40].…”

Medical Visits From Birth to 6 Months Predict Child Maltreatment Diagnoses Up to Age 5

“…Actuarial (statistically based) screening instruments have been shown to have better predictive validity than instruments based on subjective clinical judgment. 20 Therefore, providing physicians with evidence-based information about predictors of maltreatment available to them in the EHR may help improve identification of maltreatment and prevent future incidents. Similarly, a lack of documentation of maltreatment in EHR can lead to missed opportunities for early intervention, and inadequate referrals to necessary services.…”