Role of sufficient statistics in stochastic thermodynamics and its implication to sensory adaptation

Abstract

A sufficient statistic is a significant concept in statistics, which means a probability variable that has sufficient information required for an inference task. We investigate the roles of sufficient statistics and related quantities in stochastic thermodynamics. Specifically, we prove that for general continuous-time bipartite networks, the existence of a sufficient statistic implies that an informational quantity called the sensory capacity takes the maximum. Since the maximal sensory capacity imposes a constraint that the energetic efficiency cannot exceed one-half, our result implies that the existence of a sufficient statistic is inevitably accompanied by energetic dissipation. We also show that, in a particular parameter region of linear Langevin systems there exists the optimal noise intensity at which the sensory capacity, the information-thermodynamic efficiency, and the total entropy production are optimized at the same time. We apply our general result to a model of sensory adaptation of E. coli and find that the sensory capacity is nearly maximal with experimentally realistic parameters.

Unified framework for the entropy production and the stochastic interaction based on information geometry

“…Because the second law of information thermodynamics is essential for biochemical information processing [45,[54][55][56][57][58][59], this work would give geometric insight into biochemical information processing. This work provides the physical validity of the integrated information theory [25,26,30,32] for biochemical information processing.…”

A Brief Introductory Review of Information Thermodynamics(執筆途中)

“…For the discussion below, there are two most important points on this discussion of Szilard engine. One of them is that the essence of operation of "Maxwell's demon" is to perform feedback control [36][37] based on measurements at the level of thermal fluctuations [3]. Another important point is that the amount of work k B T ln2 extracted in the cycle is proportional to the 'amount of information' ln2 obtained in the measurement, with k B T as the proportional constant.…”

“…The origin of the research fields that integrate information theory and thermodynamics can be traced back to Maxwell's thought experiment "Maxwell's demon" [1]. This concept can be formulated as reducing total entropy in the system by feedback control based on measurements at the level of thermal fluctuations [2] [3], and this seems to contradict the second law of thermodynamics [4][2] [3].…”

Probing complexity: thermodynamics and computational mechanics approaches to origins studies

“…The second compelling reason to employ stochastic thermodynamics in the study of prebiotic mineral systems is evidenced in its connection to information processing and learning [112,113,[146][147][148][149][150][151]. To confront the question of if and how information manifested in prebiotic mineral systems, one must determine what the information was correlated with and what the requisite energetic budget is to store and process information.…”