Optimization and Control of Agent-Based Models in Biology: A Perspective

Abstract

Agent-based models (ABMs) have become an increasingly important mode of inquiry for the life sciences. They are particularly valuable for systems that are not understood well enough to build an equation-based model. These advantages, however, are counterbalanced by the difficulty of analyzing and using ABMs, due to the lack of the type of mathematical tools available for more traditional models, which leaves simulation as the primary approach. As models become large, simulation becomes challenging. This paper proposes a novel approach to two mathematical aspects of ABMs, optimization and control, and it presents a few first steps outlining how one might carry out this approach. Rather than viewing the ABM as a model, it is to be viewed as a surrogate for the actual system. For a given optimization or control problem (which may change over time), the surrogate system is modeled instead, using data from the ABM and a modeling framework for which ready-made mathematical tools exist, such as differential equations, or for which control strategies can explored more easily. Once the optimization problem is solved for the model of the surrogate, it is then lifted to the surrogate and tested. The final step is to lift the optimization solution from the surrogate system to the actual system. This program is illustrated with published work, using two relatively simple ABMs as a demonstration, Sugarscape and a consumer-resource ABM. Specific techniques discussed include dimension reduction and approximation of an ABM by difference equations as well systems of PDEs, related to certain specific control objectives. This demonstration illustrates the very challenging mathematical problems that need to be solved before this approach can be realistically applied to complex and large ABMs, current and future. The paper outlines a research program to address them.

Applying Optimization Algorithms to Tuberculosis Antibiotic Treatment Regimens

“…by using models to predict optimal conditions or to control model behavior. 3,25,51 As models that describe biological phenomena grow more complicated, there is a need for the proper tools to obtain the most out of these models.…”

Determining controllability of sepsis using genetic algorithms on a proxy agent-based model of systemic inflammation

“…The rationale for the current investigation is an attempt to address this 9 fundamental question: can the trajectory of clinical sepsis be controlled, and if so, what is the scale and scope of 10 the therapeutic interventions required to do so? 11 It is well known in biology that the systemic response to identical perturbations in genetically identical 12 individuals (i.e., mice) is governed according to some probability distribution. In a chaotic system, this small 13 stochastic variability in response can ultimately lead to a radically different final state [4].…”

“…Specifically, was have previously developed an 27 agent-based model (ABM) of systemic inflammation, the Innate Immune Response agent-based model (IIRABM). 28 We propose to use the existing IIRABM as a surrogate proxy system [11] for the investigation of potential control 29 strategies for sepsis. We note that while the model does not contain a comprehensive list of all signaling 30 mediators present in the human body, all relevant cellular behaviors are represented.…”

Sepsis Reconsidered: Identifying novel metrics for behavioral landscape characterization with a high-performance computing implementation of an agent-based model

“…There are nearly 1 million cases of sepsis in the United States each year, with a mortality rate between 2 28-50% [1] While operational care process improvements in the last 20 years that have led to reduction in 3 mortality [2] therapeutic options for sepsis remain variations of anti-microbial and physiological support 4 dating back nearly a quarter century, and, crucially, there remains no FDA approved biologically 5 targeted therapeutic for the treatment of sepsis. In an era where the overall goal of medical care is to 6 provide personalized/precision medicine, which should mean "right drug for the right patient at the right 7 time," achieving this goal in sepsis is significantly hampered by the lack of success in translating basic 8 science knowledge into robust and effective therapeutics -a problem pervasive across the biomedical 9 spectrum [3].…”

“…This use of computational/simulation models as proxy systems has a long history in systems engineering, 23 and has been described specifically in the use of biomedical agent-based models (ABMs) [5]. The 24 rationale for using a simulation proxy model to establish analytical boundary conditions is based on the 25 fact that there is complete knowledge of the computational model, i.e.…”