Bio-Inspired Feature Selection Algorithms With Their Applications: A Systematic Literature Review

Abstract

Based on the principles of the biological evolution of nature, bio-inspired algorithms are gaining popularity in developing robust techniques for optimization. Unlike gradient descent optimization methods, these metaheuristic algorithms are computationally less expensive, and can also considerably perform well with nonlinear and high-dimensional data. Objectives: To understand the algorithms, application domains, effectiveness, and challenges of bio-inspired feature selection techniques. Method: A systematic literature review is conducted on five major digital databases of science and engineering. Results: The primary search included 695 articles. After removing 263 duplicated articles, 432 studies remained to be screened. Among those, 317 irrelevant papers were removed. We then excluded 77 studies according to the exclusion criteria. Finally, 38 articles were selected for this study. Conclusion: Out of 38 studies, 28 papers discussed Swarmbased algorithms, 2 papers studied Genetic Algorithms, and 8 papers covered algorithms in both categories. Considering the application domains, 21 of the articles focused on problems in the healthcare sector, while the rest mainly investigated issues in cybersecurity, text classification, and image processing. Hybridization with other BIAs was employed by approximately 18.5% of papers, and 13 out of 38 studies used S-shaped transfer functions. The majority of studies used supervised classification methods such as k-NN and SVM for building fitness functions. Accordingly, we conclude that future research should focus on applying bio-inspired feature selection to a diverse area of applications such as finance and social networks. And further exploration into enhancement techniques such as quantum representation, rough set theory, chaotic maps, and Lévy flight is necessary. Additionally, we suggest investigating other transfer functions besides S-shaped, such as V-shaped and X-shaped. Moreover, clustering and deep learning models for constructing fitness functions in bio-inspired feature selection algorithms need to be investigated further.

Feature Selection Problem and Metaheuristics: A Systematic Literature Review about Its Formulation, Evaluation and Applications

“…Benchmark Real-Word Paper Year Function Metrics Techniques Classifier Application Application [4] 2023 ✓ ✓ ✓ [5] 2023 ✓ [6] 2023 ✓ ✓ ✓ ✓ [7] 2023 ✓ ✓ ✓ ✓ ✓ [8] 2022 ✓ [9] 2022…”

“…On the other hand, the metaheuristics used to solve the problem are the common aspects studied in the mentioned reviews. The authors address the binarization of metaheuristics in [4][5][6]10]. For example, in [5], the authors detail whether the metaheuristics were binarized or modified with chaotic maps.…”

“…For example, in [5], the authors detail whether the metaheuristics were binarized or modified with chaotic maps. In addition, different classifications based on behavior, hybridization, the main modifications carried out, and real-world applications, among others, are presented in [4][5][6]8,9,11,13]. Also, in investigations such as [3,[7][8][9]12,13], the authors indicate the contribution made by the metaheuristic to the field of feature selection.…”

“…Also, in investigations such as [3,[7][8][9]12,13], the authors indicate the contribution made by the metaheuristic to the field of feature selection. The works that address the different classifiers commonly define each classifier used or at least the most common ones and, for example, in [6], the authors additionally indicate the statistical tests used to validate the obtained results. Regarding the datasets used, classifications are also presented.…”

“…Given the extensive number of investigations on the topic, many methods for solving the problem have emerged. Following the extensive related literature [3][4][5][6][7][8][9][10][11][12][13][14], the solution methods for the feature selection problem can be classified as shown below:…”