Nonequilibrium landscape theory of neural networks

Abstract

The brain map project aims to map out the neuron connections of the human brain. Even with all of the wirings mapped out, the global and physical understandings of the function and behavior are still challenging. Hopfield quantified the learning and memory process of symmetrically connected neural networks globally through equilibrium energy. The energy basins of attractions represent memories, and the memory retrieval dynamics is determined by the energy gradient. However, the realistic neural networks are asymmetrically connected, and oscillations cannot emerge from symmetric neural networks. Here, we developed a nonequilibrium landscape-flux theory for realistic asymmetrically connected neural networks. We uncovered the underlying potential landscape and the associated Lyapunov function for quantifying the global stability and function. We found the dynamics and oscillations in human brains responsible for cognitive processes and physiological rhythm regulations are determined not only by the landscape gradient but also by the flux. We found that the flux is closely related to the degrees of the asymmetric connections in neural networks and is the origin of the neural oscillations. The neural oscillation landscape shows a closed-ring attractor topology. The landscape gradient attracts the network down to the ring. The flux is responsible for coherent oscillations on the ring. We suggest the flux may provide the driving force for associations among memories. We applied our theory to rapid-eye movement sleep cycle. We identified the key regulation factors for function through global sensitivity analysis of landscape topography against wirings, which are in good agreements with experiments.neural circuits | free energy | entropy production | nonequilibrium thermodynamics A grand goal of biology is to understand the function of the human brain. The brain is a complex dynamical system (1-6). The individual neurons can develop action potentials and connect with each other through synapses to form the neural circuits. The neural circuits of the brain perpetually generate complex patterns of activity that have been shown to be related with special biological functions, such as learning, long-term associative memory, working memory, olfaction, decision making and thinking (7-9), etc. Many models have been proposed for understanding how neural circuits generate different patterns of activity. HodgkinHuxley model gives a quantitative description of a single neuronal behavior based on the voltage-clamp measurements of the voltage (4). However, various vital functions are carried out by the circuit rather than individual neurons. It is at present still challenging to explore the underlying global natures of the large neural networks built from individual neurons.Hopfield developed a model (5, 6) that makes it possible to explore the global natures of the large neural networks without losing the information of essential biological functions. For symmetric neural circuits, an energy landscape can be constructed that decreas...

Construction of an Effective Landscape for Multistate Genetic Switches

“…One possible solution would be the method in which the slow variables are first obtained from simulations by a diffusion map [38,39], and the corresponding FPE is established by the equation-free approach [40]. Some mean field approximation methods [41][42][43][44] also have recently been proposed to deal with multidimensional cases. It would be also interesting to compare the different approaches on a large-scale network.…”

Quantification of motor network dynamics in Parkinson’s disease by means of landscape and flux theory

“…Rather than individual trajectory evolution, the probabilistic evolution can characterize the dynamics globally and therefore is often more appropriate. In a recent work, we applied the landscape and flux theory for studying general neural networks [34]. We quantified the potential landscape related to the steady state probability distribution.…”

“…Although the oscillations in our model are not exactly at the tremor frequency, quantitatively exploring such oscillatory behaviors in beta band is still useful for understanding the mechanisms of movement disorders such as tremor. We found the curl flux force J ss / P ss approximately plays the role of velocity when the oscillating system moves in the state space [33, 34]. Therefore, the flux is closely related to the period of oscillations.…”

“…The function f i ( x i ) represents the average firing rate of neural module i , which has a monotonic and sigmoid form. In this work we use the Hill function as the form of the response function f i ( x i ) [34]. s and n are the coefficients of the Hill function which determine the threshold and steepness of the sigmoidal function.…”

Balls, cups, and quasi-potentials: quantifying stability in stochastic systems

“…Recently, the quasi-potential has been embraced by researchers analyzing models in other areas of biology, although it often appears under other names, and is disconnected from the Freidlin-Wentzell formulation (but see Zhou et al 2012 ). These applications include gene regulatory networks (Zhou et al 2012, Lv et al 2014, neural networks (Yan et al 2013 ), and evolution (Wang et al 2011, Zhang et al 2012. Very recently, it has been applied to a predator-prey system (Xu et al 2014 ), and with countless other possibilities for application, we argue that the quasi-potential is poised to become a major quantitative tool in ecology.…”