A Modified Particle Swarm Optimization Algorithm for Optimizing Artificial Neural Network in Classification Tasks

Abstract

Artificial neural networks (ANNs) have achieved great success in performing machine learning tasks, including classification, regression, prediction, image processing, image recognition, etc., due to their outstanding training, learning, and organizing of data. Conventionally, a gradient-based algorithm known as backpropagation (BP) is frequently used to train the parameters’ value of ANN. However, this method has inherent drawbacks of slow convergence speed, sensitivity to initial solutions, and high tendency to be trapped into local optima. This paper proposes a modified particle swarm optimization (PSO) variant with two-level learning phases to train ANN for image classification. A multi-swarm approach and a social learning scheme are designed into the primary learning phase to enhance the population diversity and the solution quality, respectively. Two modified search operators with different search characteristics are incorporated into the secondary learning phase to improve the algorithm’s robustness in handling various optimization problems. Finally, the proposed algorithm is formulated as a training algorithm of ANN to optimize its neuron weights, biases, and selection of activation function based on the given classification dataset. The ANN model trained by the proposed algorithm is reported to outperform those trained by existing PSO variants in terms of classification accuracy when solving the majority of selected datasets, suggesting its potential applications in challenging real-world problems, such as intelligent condition monitoring of complex industrial systems.

Optimization of land subsidence prediction features based on machine learning and SHAP value with Sentinel-1 InSAR Data

“…BPNN (Backpropagation Neural Network) is a common artificial neural network model for solving classification and regression problems [32]. It consists of an input layer, a hidden layer and an output layer, and is trained and weighted by a backpropagation algorithm.…”

MTLBORKS-CNN: An Innovative Approach for Automated Convolutional Neural Network Design for Image Classification

“…In contrast, MSA-based approaches present a promising solution by integrating natureinspired search operators, facilitating the discovery of optimal network architectures without the need for specialized domain expertise. These methods, including particle swarm optimization (PSO), grey wolf optimization (GWO), teaching-learning-based optimization (TLBO), and differential evolution (DE), exhibit robust global search capabilities and find extensive application across various domains [21][22][23][24]. Due to their appealing features, MSA-based techniques have emerged as popular alternatives to conventional design methods, offering researchers a versatile tool to effectively address a wide array of deep learning challenges.…”

Differential Mutation Incorporated Quantum Honey Badger Algorithm with Dynamic Opposite Learning and Laplace Crossover for Fuzzy Front-End Product Design

“…In the last few years, SI was designated as a small branch of artificial intelligence, is widely used in areas like path planning, mechanical control, engineering scheduling, feature extraction, image processing, training MLP, etc. [ 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 ], and has achieved significant development. The No Free Lunch (NFL) theorem proposed by Wolpert et al [ 22 ] logically proves that there is no algorithm that can solve all optimization problems.…”