MbGWO-SFS: Modified Binary Grey Wolf Optimizer Based on Stochastic Fractal Search for Feature Selection

Abstract

Grey Wolf Optimizer (GWO) simulates the grey wolves' nature in leadership and hunting manners. GWO showed a good performance in the literature as a meta-heuristic algorithm for feature selection problems, however, it shows low precision and slow convergence. This paper proposes a Modified Binary GWO (MbGWO) based on Stochastic Fractal Search (SFS) to identify the main features by achieving the exploration and exploitation balance. First, the modified GWO is developed by applying an exponential form for the number of iterations of the original GWO to increase the search space accordingly exploitation and the crossover/mutation operations to increase the diversity of the population to enhance exploitation capability. Then, the diffusion procedure of SFS is applied for the best solution of the modified GWO by using the Gaussian distribution method for random walk in a growth process. The continuous values of the proposed algorithm are then converted into binary values so that it can be used for the problem of feature selection. To ensure the stability and robustness of the proposed MbGWO-SFS algorithm, nineteen datasets from the UCI machine learning repository are tested. The K-Nearest Neighbor (KNN) is used for classification tasks to measure the quality of the selected subset of features. The results, compared to binary versions of the-state-of-the-art optimization techniques such as the original GWO, SFS, Particle Swarm Optimization (PSO), hybrid of PSO and GWO, Satin Bowerbird Optimizer (SBO), Whale Optimization Algorithm (WOA), Multiverse Optimization (MVO), Firefly Algorithm (FA), and Genetic Algorithm (GA), show the superiority of the proposed algorithm. The statistical analysis by Wilcoxon's rank-sum test is done at the 0.05 significance level to verify that the proposed algorithm can work significantly better than its competitors in a statistical way.

A systematic review of emerging feature selection optimization methods for optimal text classification: the present state and prospective opportunities

“…Feature selection is an essential data preparation technique performed to characterize the most relevant, pertinent and significant feature space. It involves selecting the subset of the most distinct and relevant feature from a large group of features to represent a record in a dataset for predictive modelling [24]. It is an aspect of feature engineering where the attribute or item of a dataset is utilized to reduce the dimensionality of the problem to be addressed and thus, facilitate the phase of the classification process.…”

Novel Feature Selection and Voting Classifier Algorithms for COVID-19 Classification in CT Images

“…Figure 2 shows the diffusion process of the SFS technique in a graphical form for a solution. For the best solution BP , a list of solutions BP 1 , BP 2 , BP 3 , BP 4 , and BP 5 can be listed around this best solution [57].…”

Metaheuristic Algorithms on Feature Selection: A Survey of One Decade of Research (2009-2019)

“…In the text feature selection, grey wolf optimizer and grasshopper optimization algorithm were employed [247], for industrial foam injection processes, PSO algorithm and gravitational search algorithm were used [248]. A combination of the grey wolf and stochastic fractal search algorithm [249] and grasshopper and cat swarm optimization algorithm are used for feature selection [250].…”