2001
DOI: 10.1162/089976601300014358
|View full text |Cite
|
Sign up to set email alerts
|

Metabolically Efficient Information Processing

Abstract: Energy efficient information transmission may be relevant to biological sensory signal processing as well as to low power electronic devices. We explore its consequences in two different regimes. In an "immediate" regime, we argue that the information rate should be maximized subject to a power constraint, while in an "exploratory" regime, the transmission rate per power cost should be maximized. In the absence of noise, discrete inputs are optimally encoded into Boltzmann distributed output symbols. In the ex… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1

Citation Types

5
144
0

Year Published

2005
2005
2017
2017

Publication Types

Select...
5
3
1

Relationship

0
9

Authors

Journals

citations
Cited by 129 publications
(149 citation statements)
references
References 13 publications
5
144
0
Order By: Relevance
“…Strategies to improve the energy efficiency of neural coding are not restricted to single neurons but can also occur within populations of neurons (Levy and Baxter, 1996;Vinje and Gallant, 2000;Balasubramanian et al, 2001;Willmore and Tolhurst, 2001;De Polavieja, 2002;Perez-Orive et al, 2002;Schreiber et al, 2002;Olshausen and Field, 2004;Hromádka et al, 2008). Energy efficiency within neural populations is still constrained by the properties of individual neurons, such as the relationship between the energetic cost of maintaining a neuron at rest and whilst signalling.…”
Section: Energy Efficiency In Sensory Systemsmentioning
confidence: 99%
See 1 more Smart Citation
“…Strategies to improve the energy efficiency of neural coding are not restricted to single neurons but can also occur within populations of neurons (Levy and Baxter, 1996;Vinje and Gallant, 2000;Balasubramanian et al, 2001;Willmore and Tolhurst, 2001;De Polavieja, 2002;Perez-Orive et al, 2002;Schreiber et al, 2002;Olshausen and Field, 2004;Hromádka et al, 2008). Energy efficiency within neural populations is still constrained by the properties of individual neurons, such as the relationship between the energetic cost of maintaining a neuron at rest and whilst signalling.…”
Section: Energy Efficiency In Sensory Systemsmentioning
confidence: 99%
“…Noise is a constraint both upon energy efficient coding and the minimization of wiring costs within the nervous system (Balasubramanian et al, 2001;De Polavieja, 2002;Faisal et al, 2005). For example, an optimum energy efficient code that maximizes the information coded by a given number of spikes (the Boltzmann distribution) predicts that neural spike rates should follow an exponential distribution.…”
Section: Energy Efficiency In Sensory Systemsmentioning
confidence: 99%
“…Noise also constrains coding efficiency potentially preventing neuronal populations from implementing the most efficient codes and, consequently, reducing the energy efficiency of information coding (reviewed in [23]). For example, in populations of neurons encoding natural stimuli low spike rates are used less often than predicted because of their low reliability, causing a deviation from the maximally efficient coding scheme in which spike rates are distributed exponentially [57,58].…”
Section: Synaptic Inputsmentioning
confidence: 99%
“…It is known that energetic costs place important constraints on the design of physical computing devices as well as on neural computing architectures in the brain and retina (9)(10)(11), suggesting that these constraints may also influence the design of cellular computing networks.…”
mentioning
confidence: 99%