Incremental Learning From Unbalanced Data with Concept Class, Concept Drift and Missing Features : A Review

Abstract

Recently, stream data mining applications has drawn vital attention from several research communities. Stream data is continuous form of data which is distinguished by its online nature. Traditionally, machine learning area has been developing learning algorithms that have certain assumptions on underlying distribution of data such as data should have predetermined distribution. Such constraints on the problem domain lead the way for development of smart learning algorithms performance is theoretically verifiable. Real-word situations are different than this restricted model. Applications usually suffers from problems such as unbalanced data distribution. Additionally, data picked from non-stationary environments are also usual in real world applications, resulting in the "concept drift" which is related with data stream examples. These issues have been separately addressed by the researchers, also, it is observed that joint problem of class imbalance and concept drift has got relatively little research. If the final objective of clever machine learning techniques is to be able to address a broad spectrum of real world applications, then the necessity for a universal framework for learning from and tailoring (adapting) to, environment where drift in concepts may occur and unbalanced data distribution is present can be hardly exaggerated. In this paper, we first present an overview of issues that are observed in stream data mining scenarios, followed by a complete review of recent research in dealing with each of the issue.

Parameter estimation in abruptly changing dynamic environments using stochastic learning weak estimator

“…In this Section, we survey some of the most pertinent techniques for estimation in dynamic environments that are orthogonal to the SLWE. For a thorough survey we refer the reader to the surveys [6,15] which provide a comprehensive taxonomy of estimation methods in non-stationary environments, namely, adaptive windowing, aging factors, instance selection and instance weighting.…”

Deep learning for malicious flow detection

“…Incremental learning is a feasible method to mitigate imbalanced data issue [9]. The objective of incremental learning is intended to learning from the newly introduced data without forgetting past memories.…”

“…These information can be obtained in TCP payloads. [7] 85.18% 65.9% DNN + Undersampling (45 samples/class) [8] 68.89% 49.45% DNN + Incremental Learning [9] 78 2) Network Packet Payload: TCP and UDP payloads always contain the transmitted data, and the former are sometimes sent encrypted under TLS or SSL protocols. In order to trace the malicious flows and the accompanied malware, the transmitted data of all payloads in a flow is important and should be taken into consideration.…”

A Novel Computer Assisted Automatic Sleep Scoring System by Employing Artificial Neural Network–A review

“…It is unknown at the starting of the process unlike the input and the output layer which have a precise definition from the beginning. Hence, the input is fed and the output is observed by the neural network [16]. With numerous such iterations, and by employing the trial and error method, the number of hidden layers and their activation functions are calculated gradually by the artificial neural network.…”