Hyperparameter tuning is a critical function necessary for the effective deployment of most machine learning (ML) algorithms. It is used to find the optimal hyperparameter settings of an ML algorithm in order to improve its overall output performance. To this effect, several optimization strategies have been studied for fine-tuning the hyperparameters of many ML algorithms, especially in the absence of model-specific information. However, because most ML training procedures need a significant amount of computational time and memory, it is frequently necessary to build an optimization technique that converges within a small number of fitness evaluations. As a result, a simple deterministic selection genetic algorithm (SDSGA) is proposed in this article. The SDSGA was realized by ensuring that both chromosomes and their accompanying fitness values in the original genetic algorithm are selected in an elitist-like way. We assessed the SDSGA over a variety of mathematical test functions. It was then used to optimize the hyperparameters of two well-known machine learning models, namely, the convolutional neural network (CNN) and the random forest (RF) algorithm, with application on the MNIST and UCI classification datasets. The SDSGA’s efficiency was compared to that of the Bayesian Optimization (BO) and three other popular metaheuristic optimization algorithms (MOAs), namely, the genetic algorithm (GA), particle swarm optimization (PSO) and biogeography-based optimization (BBO) algorithms. The results obtained reveal that the SDSGA performed better than the other MOAs in solving 11 of the 17 known benchmark functions considered in our study. While optimizing the hyperparameters of the two ML models, it performed marginally better in terms of accuracy than the other methods while taking less time to compute.
Closed-loop routing in flying ad hoc networks (FANET) arises as a result of the quick changes of communication links and topology. As such, causing link breakage during information dissemination. This paper proposed a destination path flow model to improve the communication link in FANET. The models utilized Smell Agent Optimization and Particle Swarm Optimization algorithms in managing link establishment between communicating nodes. The modeled scenario depicts the practical application of FANET in media and sports coverage where only one vendor is given the license for live coverage and must relay to other vendors. Three different scenarios using both optimization Algorithms were presented. From the result obtained, the SAO optimizes the bandwidth costs much better than PSO with a percentage improvement of 10.46%, 4.04% and 3.66% with respect to the 1st, 2nd and 3rd scenarios respectively. In the case of communication delay between the FANET nodes, the PSO has a much better communication delay over SAO with percentage improvement of 40.89%, 50.26% and 68.85% in the first, second and third scenarios respectively.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.