TagLearner: A P2P Classifier Learning System from Collaboratively Tagged Text Documents

Abstract

The amount of text data on the Internet is growing at a very fast rate. Online text repositories for news agencies, digital libraries and other organizations currently store gigaand tera-bytes of data. Large amounts of unstructured text poses a serious challenge for data mining and knowledge extraction. End user participation coupled with distributed computation can play a crucial role in meeting these challenges.In many applications involving classification of text documents, web users often participate in the tagging process. This collaborative tagging results in the formation of large scale Peer-to-Peer (P2P) systems which can function, scale and self-organize in the presence of highly transient population of nodes and do not need a central server for co-ordination. In this paper, we describe TagLearner, a P2P classifier learning system for extracting patterns from text data where the end users can participate both in the task of labeling the data and building a distributed classifier on it. We present a novel distributed linear programming based classification algorithm which is asynchronous in nature. The paper also provides extensive empirical results on text data obtained from an online repository -the NSF Abstracts Data.

Peer‐to‐peer distributed text classifier learning in PADMINI

“…They can help in performing complex data mining tasks in a decentralized and efficient fashion [2–4]. Various data mining algorithms have been developed to work effectively on P2P networks, such as multivariate regression [5], decision tree induction [6], eigen monitoring [7], and classification [8].…”

“…In our previous work [8], we describe a P2P classifier learning system ‘TagLearner’. This work proposes a system prototype for the P2P classifier learning application composed of a service‐provider and client‐side browser plugin.…”

“…Hence, a distributed P2P classifier learning algorithm [8] is proposed to learn the classifier without centralizing the training data. This algorithm is a distributed linear programming‐based classifier learning algorithm.…”

Learning Structure and Schemas from Heterogeneous Domains in Networked Systems: A Survey

“…In many application areas involving classification of text documents, web users participate in the tagging process and the collaborative tagging results in the formation of large scale P2P systems which can function, scale and self-organize in the presence of highly transient population of nodes and do not need a central server for co-ordination. In [14] it is presented a P2P classifier learning system for extracting patterns from text data where the end users can participate both in the task of labeling the data and building a distributed classifier on it. The approach is based on a novel distributed linear programming based classification algorithm which is asynchronous in nature.…”