In the context of science, the well-known adage "a picture is worth a thousand words" might well be "a model is worth a thousand datasets." Scientific models, such as Newtonian physics or biological gene regulatory networks, are human-driven simplifications of complex phenomena that serve as surrogates for the countless experiments that validated the models. Recently, machine learning has been able to overcome the inaccuracies of approximate modeling by directly learning the entire set of nonlinear interactions from data. However, without any predetermined structure from the scientific basis behind the problem, machine learning approaches are flexible but data-expensive, requiring large databases of homogeneous labeled training data. A central challenge is reconciling data that is at odds with simplified models without requiring "big data". In this work we develop a new methodology, universal differential equations (UDEs), which augments scientific models with machinelearnable structures for scientifically-based learning. We show howUDEs can be utilized to discover previously unknown governing equations, accurately extrapolate beyond the original data, and accelerate model simulation, all in a time and data-efficient manner. This advance is coupled with open-source software that allows for training UDEs which incorporate physical constraints, delayed interactions, implicitly-defined events, and intrinsic stochasticity in the model. Our examples show how a diverse set of computationallydifficult modeling issues across scientific disciplines, from automatically discovering biological mechanisms to accelerating climate simulations by 15,000x, can be handled by training UDEs.

In the context of science, the well-known adage “a picture is worth a thousand words” might well be “a model is worth a thousand datasets.” Scientific models, such as Newtonian physics or biological gene regulatory networks, are human-driven simplifications of complex phenomena that serve as surrogates for the countless experiments that validated the models. Recently, machine learning has been able to overcome the inaccuracies of approximate modeling by directly learning the entire set of nonlinear interactions from data. However, without any predetermined structure from the scientific basis behind the problem, machine learning approaches are flexible but data-expensive, requiring large databases of homogeneous labeled training data. A central challenge is reconciling data that is at odds with simplified models without requiring "big data". In this work demonstrate how a mathematical object, which we denote universal differential equations (UDEs), can be utilized as a theoretical underpinning to a diverse array of problems in scientific machine learning to yield efficient algorithms and generalized approaches. The UDE model augments scientific models with machine-learnable structures for scientifically-based learning. We show how UDEs can be utilized to discover previously unknown governing equations, accurately extrapolate beyond the original data, and accelerate model simulation, all in a time and data-efficient manner. This advance is coupled with open-source software that allows for training UDEs which incorporate physical constraints, delayed interactions, implicitly-defined events, and intrinsic stochasticity in the model. Our examples show how a diverse set of computationally-difficult modeling issues across scientific disciplines, from automatically discovering biological mechanisms to accelerating the training of physics-informed neural networks and large-eddy simulations, can all be transformed into UDE training problems that are efficiently solved by a single software methodology.

Living systems maintain or increase local order by working against the second law of thermodynamics. Thermodynamic consistency is restored as they consume free energy, thereby increasing the net entropy of their environment. Recently introduced estimators for the entropy production rate have provided major insights into the efficiency of important cellular processes. In experiments, however, many degrees of freedom typically remain hidden to the observer, and, in these cases, existing methods are not optimal. Here, by reformulating the problem within an optimization framework, we are able to infer improved bounds on the rate of entropy production from partial measurements of biological systems. Our approach yields provably optimal estimates given certain measurable transition statistics. In contrast to prevailing methods, the improved estimator reveals nonzero entropy production rates even when nonequilibrium processes appear time symmetric and therefore may pretend to obey detailed balance. We demonstrate the broad applicability of this framework by providing improved bounds on the energy consumption rates in a diverse range of biological systems including bacterial flagella motors, growing microtubules, and calcium oscillations within human embryonic kidney cells.

SINGLE CELL AGENT-BASED SIMULATIONS Model descriptionOur single cell model is based on the agent-based framework described in [1], with modifications to include the effect of the flow on the cells and cell-cell polar adhesion. Cells are modeled as ellipsoids of half-length l and half-width r; each cell is described by its position x, orientationn and effective local viscosity µ . The dynamics of the cells are approximated as over-damped, as cells live at low Reynolds number Re ≈ 10 −4 [1]. Denoting the identity matrix by I and the dynamic viscosity of water by µ w , the over-damped translational and orientational dynamics for a single cell are