Probabilistic uncertainty analysis of epidemiological modeling to guide public health intervention policy

Abstract

Mathematical modeling of disease transmission has provided quantitative predictions for health policy, facilitating the evaluation of epidemiological outcomes and the cost-effectiveness of interventions. However, typical sensitivity analyses of deterministic dynamic infectious disease models focus on model architecture and the relative importance of parameters but neglect parameter uncertainty when reporting model predictions. Consequently, model results that identify point estimates of intervention levels necessary to terminate transmission yield limited insight into the probability of success. We apply probabilistic uncertainty analysis to a dynamic model of influenza transmission and assess global uncertainty in outcome. We illustrate that when parameter uncertainty is not incorporated into outcome estimates, levels of vaccination and treatment predicted to prevent an influenza epidemic will only have an approximately 50% chance of terminating transmission and that sensitivity analysis alone is not sufficient to obtain this information. We demonstrate that accounting for parameter uncertainty yields probabilities of epidemiological outcomes based on the degree to which data support the range of model predictions. Unlike typical sensitivity analyses of dynamic models that only address variation in parameters, the probabilistic uncertainty analysis described here enables modelers to convey the robustness of their predictions to policy makers, extending the power of epidemiological modeling to improve public health.

Bayesian Methods for Calibrating Health Policy Models: A Tutorial

“…Using parameter point estimates is the simplest approach, but unlike probabilistic sensitivity analysis this approach does not provide uncertainty estimates for modelled outcomes. In addition, as modelled outcomes are typically non-linear functions of the parameters, the results produced by using parameter point estimates will differ from the mean results from a probabilistic sensitivity analysis (via Jensen’s inequality) (10). For these reasons, it is becoming increasingly conventional for modelled economic evaluations to take parameter uncertainty into account (11–13).…”

Modelling microbial infection to address global health challenges

“…However, collecting detailed data to inform each of these parameters can strain resources when they are thinly spread during an emergency response. Sensitivity analysis can support clinicians and epidemiologists in prioritizing data collection efforts 86 .…”

Assessing dengue vaccination impact: Model challenges and future directions

“…In that respect, sensitivity analyses need to go beyond finding and reporting on the most influential parameters but crucially have to incorporate uncertainties in parameter values as well as in the underlying model structure and assumptions [27].…”