Optimizing Convolutional Neural Network Hyperparameters by Enhanced Swarm Intelligence Metaheuristics

Abstract

Computer vision is one of the most frontier technologies in computer science. It is used to build artificial systems to extract valuable information from images and has a broad range of applications in various areas such as agriculture, business, and healthcare. Convolutional neural networks represent the key algorithms in computer vision, and in recent years, they have attained notable advances in many real-world problems. The accuracy of the network for a particular task profoundly relies on the hyperparameters’ configuration. Obtaining the right set of hyperparameters is a time-consuming process and requires expertise. To approach this concern, we propose an automatic method for hyperparameters’ optimization and structure design by implementing enhanced metaheuristic algorithms. The aim of this paper is twofold. First, we propose enhanced versions of the tree growth and firefly algorithms that improve the original implementations. Second, we adopt the proposed enhanced algorithms for hyperparameters’ optimization. First, the modified metaheuristics are evaluated on standard unconstrained benchmark functions and compared to the original algorithms. Afterward, the improved algorithms are employed for the network design. The experiments are carried out on the famous image classification benchmark dataset, the MNIST dataset, and comparative analysis with other outstanding approaches that were tested on the same problem is conducted. The experimental results show that both proposed improved methods establish higher performance than the other existing techniques in terms of classification accuracy and the use of computational resources.

A systematic review of emerging feature selection optimization methods for optimal text classification: the present state and prospective opportunities

“…Hyperparameters for metaheuristic algorithms are an area that can help in testing different values of control parameters during the evaluation phase of estimating the viability of the algorithm [155]. The accuracy of network for a specific task greatly depends on the hyperparameters' configuration [156]. xi.…”

An IoT System for Social Distancing and Emergency Management in Smart Cities Using Multi-Sensor Data

“…One of the most used techniques to model or track moving crowds is Computer Vision [50]. Convolutional Neural Networks (CNNs) represent the key algorithms in computer vision, and recently [51], enhanced versions of the tree growth and firefly metaheuristics algorithms have been proposed to automatize the hyperparameters' optimization process (i.e., find the right set of hyperparameters that allow one to obtain the best CNN model accuracy), obtaining better performances (in terms of image classification accuracy and the use of computational resources) than the traditional approaches (that require time expertise). Furthermore, faster regions CNN (Faster R-CNN) is considered one of the most important techniques for automatic pedestrian detection from video [52], and, if automatic color enhancement (ACE) is used, good performances (in terms of recognition rate and offset of target selection) can be obtained because of the reduced susceptibility to the diversity of pedestrians' appearances and the light intensity in specific scenarios (e.g., a subway) [52].…”

The Buttressed Walls Problem: An Application of a Hybrid Clustering Particle Swarm Optimization Algorithm

“…The medical diagnoses and prognoses were tackled in [41] combining swarm intelligence metaheuristics with the probabilistic search models of estimation of distribution algorithms. In [42], the authors used swarm intelligence metaheuristics for the convolution neural network hyper-parameters tuning. In [32], a multiverse optimizer algorithm was used for text documents clustering.…”