Tracking Recurring Concepts with Meta-learners

Gama, João; Kosina, Petr

doi:10.1007/978-3-642-04686-5_35

Cited by 41 publications

(53 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…New al gorithms have appeared during the last years Gaber et al (2007); Gama et al (2004);Hulten, Spencer, and Domingos (2001); Street and Kim (2001);Tsymbal (2004);Žliobaite˙ (2010); Widmer and Kubat (1996), but some other related challenges have received far less attention. Such is the case of situations where the same concept or a similar one reappears, and a previous model could be reused to en hance the learning process in terms of accuracy and processing time as in the case of Gama and Kosina (2009);Gomes et al (2010); Katakis et al (2010); Ramamurthy and Bhatnagar (2007); Yang et al (2005);2006).…”

Section: Data Stream Classificationmentioning

confidence: 99%

“…• Recurring concepts, as a particular type of the aforementioned concept drift (Gama & Kosina, 2009;Katakis et al, 2010;Widmer & Kubat, 1996;Yang et al, 2005) where a previous learned concept is expected to reappear.…”

Section: Motivationmentioning

confidence: 99%

“…With that recognition task in place, it would be possible for the algorithms to avoid relearning something from scratch that has been already learned (Gama & Kosina, 2009Gomes et al, 2010;Gonçalves & Barros, 2013;Katakis et al, 2010;Widmer & Kubat, 1996;Yang et al, 2005). This same idea has been already explored in Gomes et al (2010), where concepts are able to be saved in a repository.…”

Section: Motivationmentioning

confidence: 99%

“…This means that a previously seen concept may reappear in the future and probably in a similar con text (Harries et al, 1998;Widmer, 1997). However, only a few ap proaches explore it (Gama & Kosina, 2009Gonçalves & Barros, 2013;Katakis, Tsoumakas, & Vlahavas, 2010;Widmer & Kubat, 1996;Yang, Wu, & Zhu, 2005). In these cases, concept changes are generally the result of context changes.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Predicting recurring concepts on data-streams by means of a meta-model and a fuzzy similarity function

Ángel

Bártolo²,

Ernestina

2016

Expert Systems with Applications

View full text Add to dashboard Cite

Stream-mining approach is defined as a set of cutting-edge techniques designed to process streams of data in real time, in order to extract knowledge. In the particular case of classification, stream-mining has to adapt its behavior to the volatile underlying data distributions, what has been called concept drift. It is important to note that concept drift may lead to situations where predictive models become invalid and have therefore to be updated to represent the actual concepts that data poses. In this context, there is a specific type of concept drift, known as recurrent concept drift, where the concepts represented by data have already appeared in the past. In those cases the learning process could be saved or at least minimized by applying a previously trained model. To deal with the aforementioned scenario, meta-models can be used in the process of enhancing the drift detection mechanisms used by data stream algorithms, by representing and predicting when the change will occur. There are some real-world situations where a concept reappears, as in the case of intrusion detection systems (IDS), where the same incidents or an adaptation of them usually reappear over time. In these environments the early prediction of drift by means of a better knowledge of past models can help to anticipate to the change, thus improving efficiency of the model regarding the training instances needed. Furthermore, as a complement of meta-models, a mechanism to assess the similarity between classifica-tion models is also needed when dealing with recurrent concepts. In this context, when reusing a previously trained model a rough comparison between concepts is usually made, applying boolean logic. The intro-duction of fuzzy logic comparisons between models could lead to a better efficient reuse of previously seen concepts, by applying not just equal models, but also similar ones. This work faces the aforementioned open issues by means of the MM-PRec system, that integrates a meta-model mechanism and a fuzzy similarity function. The theoretical proposal of MM-PRec is also validated in this paper by means of different experiments using both synthetic and real datasets.

show abstract

Section: Data Stream Classificationmentioning

confidence: 99%

Section: Motivationmentioning

confidence: 99%

Section: Motivationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Predicting recurring concepts on data-streams by means of a meta-model and a fuzzy similarity function

Ángel

Bártolo²,

Ernestina

2016

Expert Systems with Applications

View full text Add to dashboard Cite

show abstract

“…However, more sophisticated approaches that exploit this possibility, such as [8,31], store learned models and reuse them when a similar concept reappears in the stream, thus avoiding the effort to relearn a previously observed concept. The method proposed by Yang et al [31] uses a proactive approach to recurring concepts, which means to reuse a concept from the history of concepts.…”

Section: Drift Detectionmentioning

confidence: 99%

Tracking Recurrent Concepts Using Context

Gomes

Menasalvas

Sousa

2010

Rough Sets and Current Trends in Computing

View full text Add to dashboard Cite

Abstract. The problem of recurring concepts in data stream classification is a special case of concept drift where concepts may reappear. Although several existing methods are able to learn in the presence of concept drift, few consider contextual information when tracking recurring concepts. Nevertheless, in many real-world scenarios context information is available and can be exploited to improve existing approaches in the detection or even anticipation of recurring concepts.In this work, we propose the extension of existing approaches to deal with the problem of recurring concepts by reusing previously learned decision models in situations where concepts reappear. The different underlying concepts are identified using an existing drift detection method, based on the error-rate of the learning process. A method to associate context information and learned decision models is proposed to improve the adaptation to recurring concepts. The method also addresses the challenge of retrieving the most appropriate concept for a particular context. Finally, to deal with situations of memory scarcity, an intelligent strategy to discard models is proposed. The experiments conducted so far, using synthetic and real datasets, show promising results and make it possible to analyze the trade-off between the accuracy gains and the learned models storage cost.

show abstract