Information Integration from Distributed Threshold-Based Interactions

Abstract

We consider a collection of distributed units that interact with one another through the sending of messages. Each message carries a positive (+1) or negative (−1) tag and causes the receiving unit to send out messages as a function of the tags it has received and a threshold. This simple model abstracts some of the essential characteristics of several systems used in the field of artificial intelligence, and also of biological systems epitomized by the brain. We study the integration of information inside a temporal window as the model's dynamics unfolds. We quantify information integration by the total correlation, relative to the window's duration (w), of a set of random variables valued as a function of message arrival. Total correlation refers to the rise of information gain above and beyond that which the units already achieve individually, being therefore related to consciousness studies in some models. We report on extensive computational experiments that explore the interrelations of the model's parameters (two probabilities and the threshold), highlighting relevant scenarios of message traffic and how they impact the behavior of total correlation as a function of w. We find that total correlation can occur at significant fractions of the maximum possible value and provide semianalytical results on the message-traffic characteristics associated with values of w for which it peaks. We then reinterpret the model's parameters in terms of the current best estimates of some quantities pertaining to cortical structure and dynamics. We find the resulting possibilities for best values of w to be well aligned with the time frames within which percepts are thought to be processed and eventually rendered conscious.

Estimating the Integrated Information Measure Phi from High-Density Electroencephalography during States of Consciousness in Humans

“…The recovery of responsiveness following anesthesia in the absence of a full recovery of integrated information implies that there may be a threshold of integration above which subjects regain purposeful responsiveness (Tononi, 2008 ; Tononi and Koch, 2015 ; Barbosa, 2017 ). The differential values are consistent with what is likely a richer phenomenology at baseline compared to just after emergence from anesthesia.…”

The Complexity of Social Capital: The Influence of Board and Ownership Interlocks on Implied Cost of Capital in an Emerging Market

“…In this paper we are interested in the effect of two different kinds of relevant complex networks in finance [1][2][3] on implied cost of capital for the listed companies, particularly in a prominent emerging market, Brazil, which have been the subject of studies on complexity in other disciplines such as epidemiology [4], geophysics [5], ecology [6,7], and information science [8,9].…”

Information-theoretic signatures of biodiversity in the barcoding gene

“…This principle has been formalized as the so-called total correlation of the variables and its generalizations [10]. It is behind several studies related to the integration of information in complex systems, including some targeted at the temporal evolution of probabilistic cellular automata [11], of threshold-based systems in general [12], and of the cerebral cortex as it gives rise to consciousness [13][14][15].…”