Comprehensive analysis of network traffic data

Abstract

With the large volume of network traffic flow, it is necessary to preprocess raw data before classification to gain the accurate results speedily. Feature selection is an essential approach in preprocessing phase. The principal component analysis (PCA) is recognized as an effective and efficient method. In this paper, we classify network traffic flows by using the PCA technique together with 6 machine learning algorithms-Naive Bayes, decision tree, 1-nearest neighbor, random forest, support vector machine, and H 2 O. We analyzed the impact of PCA on the classification results by applying each algorithm with and without PCA onto the data set. Experiments were set out by varying the size of input data sets, and the performances were measured from 2 aspects, including average overall accuracy and F-measure. The computational time was also considered in analyzing the performance. Our results showed that random forest and 1-nearest neighbor were the top 2 algorithms among all the 6 regarding the 2 metrics mentioned above. Then we continued the study of PCA impact on per class level with these 2 algorithms as examples. And the positive correlation between overall impact and the number of class with significant impact was revealed.Lastly, the visualization was used in exploring the reasons of the impacts caused by PCA. Two factors are considered in PCA's impact on per class level: benefit for classes grouped by PCA and mislabeled error interfered by nearby groups.

Comparative study on machine learning algorithms for early fire forest detection system using geodata.

“…-Random Forest is a collection of decision trees applied to avoid the instability and risk of overtraining that can occur with a single tree. It consists in suppressing the decision nodes without reducing the overall precision of the tree [49]. Characterized by an adjustment of only two parameters which are the number of trees and the set of attributes to be chosen during the construction of each node, which simplifies the generation of decision forests [50] -Support vector machines are a classification method that transforms a linear problem into a higher dimensional space entity.…”

Deep Learning Approach for Real-time Video Streaming Traffic Classification

“…The work in [20] defined a method to classify network traffic flows by using principal component analysis (PCA) technique together with six ML algorithms. They paid attention to the pre-processing phase as they adopted the 20 features presented in [21], and used the feature of server responding duration in their classification experiment.…”

A Comparative Study of Traffic Classification Techniques for Smart City Networks

“…Miao et al [ 29 ] compared six machine learning algorithms for traffic classification: Naive Bayes, RF, SVM, H O, KNN, and DT. They used principal component analysis for feature extraction and analyzed its influence on the classification results.…”