2021
DOI: 10.3389/fncom.2021.587721
|View full text |Cite
|
Sign up to set email alerts
|

Local Homeostatic Regulation of the Spectral Radius of Echo-State Networks

Abstract: Recurrent cortical networks provide reservoirs of states that are thought to play a crucial role for sequential information processing in the brain. However, classical reservoir computing requires manual adjustments of global network parameters, particularly of the spectral radius of the recurrent synaptic weight matrix. It is hence not clear if the spectral radius is accessible to biological neural networks. Using random matrix theory, we show that the spectral radius is related to local properties of the neu… Show more

Help me understand this report
View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1

Citation Types

0
3
0

Year Published

2021
2021
2024
2024

Publication Types

Select...
4
2
1

Relationship

2
5

Authors

Journals

citations
Cited by 7 publications
(3 citation statements)
references
References 56 publications
0
3
0
Order By: Relevance
“…Adaptation rules for the bias entering a transfer function, such as Equations ( 8), ( 7), have the task to regulate overall activity levels. The overall magnitude of the synaptic weights, which are determined by synaptic rescaling factors, here n d and n p , as defined in Equations ( 5), ( 6), will regulate in contrast the variance of the neural activity, and not the average level (Schubert and Gros, 2021). In this spirit we consider…”
Section: Homeostatic Parameter Regulationmentioning
confidence: 99%
See 1 more Smart Citation
“…Adaptation rules for the bias entering a transfer function, such as Equations ( 8), ( 7), have the task to regulate overall activity levels. The overall magnitude of the synaptic weights, which are determined by synaptic rescaling factors, here n d and n p , as defined in Equations ( 5), ( 6), will regulate in contrast the variance of the neural activity, and not the average level (Schubert and Gros, 2021). In this spirit we consider…”
Section: Homeostatic Parameter Regulationmentioning
confidence: 99%
“…The dynamic variables Ĩ p and Ĩ d are simply low-pass filtered running averages of I p and I d . Overall, the framework specified here allows the neuron to be fully flexible, as long as the activity level and its variance fluctuate around preset target values (Schubert and Gros, 2021 ).…”
Section: Modelmentioning
confidence: 99%
“…In [84], we explored the possibility of controlling the spectral radius of a recurrent network by combining intrinsic adaptation with a local synaptic scaling rule. For this purpose, we used an echo state framework [95,96], which we introduce in Section 3.1.…”
Section: Flow Controlmentioning
confidence: 99%