Optimal added noise for minimizing distortion in quantizer-array linear estimation

Xie, Tian; Ji, Yuandong; Yang, Zhongshan; Duan, Fabing; Abbott, Derek

doi:10.1016/j.chaos.2022.112887

Cited by 2 publications

(1 citation statement)

References 75 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In turn, in the case of the influence of noise on the transmission efficiency, our results are consistent with the results obtained in the works of [40]- [43], which also found that a certain level of noise in the considered system (neural networks, signal recovery through an array of saturating sensors, estimator design) may be beneficial in the context of information processing. This means that since the maximum transmission rate is reached as the number of neurons increases, for higher and higher noise values s, it shows that larger networks are more reliable.…”

Section: Disscusion and Conclusionsupporting

confidence: 91%

Does Adding of Neurons to the Network Layer Lead to Increased Transmission Efficiency?

Paprocki,

Pregowska,

Szczepanski

2024

IEEE Access

View full text Add to dashboard Cite

The aim of this study is to contribute to the important question in Neuroscience of whether the number of neurons in a given layer of network affects a transmission efficiency. Mutual Information, as defined by Shannon, between the input and output signals for certain classes of networks is analyzed theoretically and numerically. A Levy-Baxter probabilistic neural model is applied. This model includes all important qualitative mechanisms involved in the transmission process in the brain. We derived analytical formulas for the Mutual Information of input signals coming from Information Sources as Bernoulli processes. These formulas depend on the parameters of the Information Source, neuron and network. Numerical simulations were performed using these equations. It turned out, that the Mutual Information starting from a certain value increases very slowly with the number of neurons being added. The increase is of the rate m − c where m is the number of neurons in the transmission layer, and c is very small. The calculations also show that for a practical number (up to 15000) of neurons, the Mutual Information reaches only approximately half of the information that is carried out by the input signal. The influence of noise on the transmission efficiency depending on the number of neurons was also analyzed. It turned out that the noise level at which transmission is optimal increases significantly with this number. Our results indicate that a large number of neurons in the network does not generally indicate an essential improvement in transmission efficiency, but can contribute to reliability.INDEX TERMS Shannon communication theory; neural network; transmission efficiency; mutual information; model of neuron, spike trains, information source, entropy.

show abstract

Section: Disscusion and Conclusionsupporting

confidence: 91%