“…A number of predictive models have been developed to determine the impact of changing a medical intervention on the health outcome for an individual, including: Markov chain models (Ayer et al, 2012;Mason et al, 2013;Deo et al, 2013;Andersen et al, 2017), dynamical systems models (Helm et al, 2015), decision tree models (Wu et al, 2013), graph-theoretic models (Fetta et al, 2018), bandit models (Negoescu et al, 2014), and dynamic programming models (Engineer et al, 2009). (This literature also studies the problem of designing optimal treatment plans, which we do not consider in our present paper.)…”