The structure dilemma in biological and artificial neural networks

Abstract

Brain research up to date has revealed that structure and function are highly related. Thus, for example, studies have repeatedly shown that the brains of patients suffering from schizophrenia or other diseases have a different connectome compared to healthy people. Apart from stochastic processes, however, an inherent logic describing how neurons connect to each other has not yet been identified. We revisited this structural dilemma by comparing and analyzing artificial and biological-based neural networks. Namely, we used feed-forward and recurrent artificial neural networks as well as networks based on the structure of the micro-connectome of C. elegans and of the human macro-connectome. We trained these diverse networks, which markedly differ in their architecture, initialization and pruning technique, and we found remarkable parallels between biological-based and artificial neural networks, as we were additionally able to show that the dilemma is also present in artificial neural networks. Our findings show that structure contains all the information, but that this structure is not exclusive. Indeed, the same structure was able to solve completely different problems with only minimal adjustments. We particularly put interest on the influence of weights and the neuron offset value, as they show a different adaption behaviour. Our findings open up new questions in the fields of artificial and biological information processing research.

Analysis and Optimization of Network Properties for Bionic Topology Hopfield Neural Network Using Gaussian-Distributed Small-World Rewiring Method

“…Rosen et al [20] estimated the absolute number of axons linking cortical areas from a whole-cortex diffusion MRI connectome and observed that real human cortical areas are small-world connected. Pircher et al [21] further compared the smallworld network between artificial and biological-based neural networks and observed remarkable parallels between these two neural networks. Scientists have started exploring the specifics of the characteristics of small-world networks.…”

Shannon’s Lens: The Catalyst for Cognitive Evolution of Edge Based Smart Machines

“…Autonomous cognitive networks mirror natural evolution 42 . There exists a structural balance in biological and artificial networks 43 , assortativity 44 influences cognition and human information processing 45 occurs in complex networks. A mathematical framework can be developed for meaningful communication 46 and quantum key distribution 47 secures Machine-to-Machine (M2M) communication 3 in smart grids.…”