Performance evaluation of machine learning models for distributed denial of service attack detection using improved feature selection and hyper‐parameter optimization techniques

Abstract

This article gives the framework of extensive experimentation of various machine learning models to detect distributed denial of service attacks (DDoS). We use six-tier feature ranking methods that use statistical techniques as well as machine learning based classifiers to obtain the significant features. The measurable statistical based feature selection involves Chi-Square (Chi2), information gain (IG), merged Chi-Square (Chi2)-IG ranking and machine learning classifiers involve ensemble classifiers, that is, decision tree, random forest and eXtreme gradient boosting (XGBoost). Different supervised machine learning models (logistic regression, decision tree classifier, linear support vector machine, k-nearest neighbors, Gaussian Naive Bayes, random forest classifier, XGBoost) are trained on a feature-engineered datasets. To further our research, we use neural networks (ANN and CNN) using both feature-selected and auto-feature selection training setup. We check the validation and adaptability of these models with the optimal tuning of various parameters using GridSearchCV and the effectiveness of random sampling in overcoming the class imbalance problem. Based on various feature selection methods, the models are evaluated for their best performance. The experimental results show that our trained machine learning models and neural networks outperformed the ones in the state of art. The performance analysis is done based on confusion matrix scores, that is, accuracy, false alarm rate, sensitivity, specificity, false-positive rate, F1 score, area under curve analysis and loss functions on well-known KDD Cup 99 and UNSW-NB15 datasets. This study is significant for furthering the research in DDoS detection with machine learning and deep neural networks.

Decoding Bovine Behavior: A Machine Learning Analysis of Disease and Event Detection

“…How well a machine learning model performs with new and untrained data determines how effective the model is. The optimal configuration method for machine learning models was determined by analyzing the accuracy scores in conjunction with the F1score, Precession, and Recall values (Habib, Beenish, et al, 2022). The area under the curve with respect to ROC curve are also shown against genuine positive and false negative data to further support the findings.…”

“…One essential function is data pre-processing in determining the final performance of machine learning models (Habib, Beenish et al, 2022). It involves data cleaning as Missing values may seriously affect the accuracy as well as reliability of machine learning models, thus it's critical to manage them properly.…”

Investigation of Bovine Disease and Events through Machine Learning Models

“…An evaluation is the last action. The F1-score, Precession, and Recall values were examined along with the accuracy scores to find the ideal configuration strategy for machine learning models (Habib and Khursheed, 2022). In order to further confirm the results, the receiver operating characteristic (ROC) and area under the curve (AUC) are also displayed against true positive and false negative data.…”

Optimized MLP-CNN Model to Enhance Detecting DDoS Attacks in SDN Environment

“…In [12], the authors evaluated the performance of detecting DDoS attacks by using logistic regression, a decision tree classifier, linear support vector machine, k-nearest neighbors, Gaussian Naive Bayes, Random Forest Classifier, XGBoost, ANN, and CNN. They also used hyperparameter optimization and applied various techniques to select features on KDD Cup 99 and UNSW-NB15.…”