Semi-Supervised Streaming Learning with Emerging New Labels

Abstract

In many real-world applications, the modeling environment is usually dynamic and evolutionary, especially in a data stream where emerging new class often happens. Great efforts have been devoted to learning with novel concepts recently, which are typically in a supervised setting with completely supervised initialization. However, the data collected in the stream are often in a semi-supervised manner actually, which means only a few of them are labeled while the great majority miss ground-truth labels. Besides, new classes hidden in unlabeled instances bring more challenges for the learning task. In this paper, we tackle these issues by a new approach called SEEN which consists of three major components: an effective novel class detector based on clustering random trees, a robust classifier for predictions on the known classes, and an efficient updating process that ensures the whole framework adapts to the changing environment automatically. The classifier produces known labels via label propagation that utilizes all labeled and part unlabeled data in the past which naturally describe the entire stream seen so far. Empirical studies on several datasets validate that the algorithm can accurately classify points on a dynamic stream with a small number of labeled examples and emerging new classes.

Semi-Supervised Predictive Clustering Trees for (Hierarchical) Multi-Label Classification

“…In [15], the authors addressed the task of multi-label learning with incomplete labels, by combining the label imputation function and multi-label prediction function in a mutually benefcial manner. Specifcally, the proposed method conducts automatic label imputation within a lowrank and sparse matrix recovery framework while simultaneously performing vector-valued multi-label learning and exploiting unlabeled data with vector-valued manifold regularization.…”

Robust Deep Semi-Supervised Learning: A Brief Introduction

“…There are some SSL studies trying to tackle sub-problems in dynamic environments, such as classifying the new emerging labels [144], [145], adapting to gradually shifting distributions [146], [147]. But these attempts mainly focused on specific small problems and are still a long way from being applied to real-world tasks with dynamic environments.…”

Role of Machine Learning in Resource Allocation Strategy over Vehicular Networks: A Survey

“…Stream learning, online learning, and incremental learning are the types of machine learning that can update their models for a given continuous data stream without performing multiple passes over data [ 40 ]. Stream learning is closely related to semi-supervised learning [ 41 ]. By implementing stream learning, real-time data analytics can be performed.…”