Analysis and Optimization of Network Properties for Bionic Topology Hopfield Neural Network Using Gaussian-Distributed Small-World Rewiring Method

Abstract

The fully connected topology, which coordinates the connection of each neuron with all other neurons, remains the most commonly used structure in Hopfield-type neural networks. However, fully connected neurons may form a highly complex network, resulting in a high training cost and making the network biologically unrealistic. Biologists have observed a small-world topology with sparse connections in the actual brain cortex. The bionic small-world neural network structure has inspired various application scenarios. However, in previous studies, the long-range wirings in the small-world network have been found to cause network instability. In this study, we investigate the influence of neural network training on the small-world topology. The role of the path length and clustering coefficient of neurons is expounded in the neural network training process. We employ Watt and Strogatz's small-world model as the topology for the Hopfield neural network and conduct computer simulations. We observe that the random existence of neuron connections may cause unstable network energies and generate oscillations during the training process. A new method is proposed to mitigate the instability of small-world networks. The proposed method starts with a neuron as the pattern centroid along the radial, which arranges its wirings in compliance with the Gaussian distribution. The new method is tested on the MNIST handwritten digit dataset. The simulation confirms that the new small-world series has higher stability in terms of the learning accuracy and a higher convergence speed compared with Watt and Strogatz's small-world model.

Indoor Positioning System (IPS) Using Ultra-Wide Bandwidth (UWB)—For Industrial Internet of Things (IIoT)

“…It is an information management model that works in a similar way to the biological nervous systems function of the human brain [ 103 ]. The advantage of NN application is that it provides more accurate results due to complex natural systems with large numbers of inputs; thus, the network can generate the best possible result without the requirement of redesigning the output criteria [ 104 ]. In order to accomplish high-precision positioning, different NN models were proposed and evaluated for the implementation, such as the multi-layer perceptron (MLP) [ 105 ], radial basis function (RBF) [ 106 ] and generalized regression neural network (GRNN).…”

Multistable Memristor Synapse-Based Coupled Bi-Hopfield Neuron Model: Dynamic Analysis, Microcontroller Implementation and Image Encryption

“…Hopfield networks have emerged as pivotal models in the field of neuroscience owing to their dynamic behavior and efficient structure [1]. These networks provide a valuable framework for exploring human memory mechanisms, with both continuous and discrete models being extensively studied [2][3][4]. Their practicality lies in their ability to capture associative memory processes, making them indispensable tools for investigating cognition and learning [5][6][7][8].…”