A Stable and Online Approach to Detect Concept Drift in Data Streams

Abstract

Abstract-The detection of concept drift allows to point out when a data stream changes its behavior over time, what supports further analysis to understand why the phenomenon represented by such data has changed. Nowadays, researchers have been approaching concept drift using unsupervised learning strategies, due to data streams are open-ended sequences of data which are extremely hard to label. Those approaches usually compute divergences of consecutive models obtained over time. However, those strategies tend to be imprecise as models are obtained by clustering algorithms that do not hold any stability property. By holding a stability property, clustering algorithms would guarantee that a change in clustering models correpond to actual changes in input data. This drawback motivated this work which proposes a new approach to model data streams by using a stable hierarchical clustering algorithm. Our approach also considers a data stream composed of a mixture of time-dependent and independent observations. Experiments were conducted using synthetic data streams under different behaviors. Results confirm this new approach is capable of detecting concept drift in data streams.

The Entropy-Based Time Domain Feature Extraction for Online Concept Drift Detection

“…Costa et al [ 19 ] dealt with the concept drift of time series by decomposing the time series into deterministic components consisting of non-independent observations and stochastic components consisting of independent observations. In order to eliminate the time dependence in deterministic components, Taken’s immersion theory was used to decompose deterministic components into independently and identically distributed data.…”

“…Even though many approaches related to the detection of concept drifts of time series have been proposed in recent years [ 17 , 18 , 19 ], some problems are still open. On the one hand, most of the existing detection algorithms are based on the performance indicators of the classifiers.…”