On Hadamard-Type Output Coding in Multiclass Learning

Zhang, Aijun; Wu, Zhi Li; Li, Chun Hung; Fang, Kai

doi:10.1007/978-3-540-45080-1_51

Cited by 4 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The array has strength t if, in every t by n submatrix, all the possible d t distinct rows appear the same number of times. In multiclass learning, a certain type of orthogonal arrays, known as Hadamard matrix, is found to be useful [48]. This binary square matrix has the following properties: ݉ = ߪ and ݀ = ‫ݐ‬ = 2.…”

Section: Ensemble Constructionmentioning

confidence: 99%

Ensemble methods for multi-label classification

Rokach

Schclar

Itach

2014

Expert Systems with Applications

107

View full text Add to dashboard Cite

Ensemble methods have been shown to be an effective tool for solving multi-label classification tasks. In the RAndom k-labELsets (RAKEL) algorithm, each member of the ensemble is associated with a small randomly-selected subset of k labels. Then, a single label classifier is trained according to each combination of elements in the subset. In this paper we adopt a similar approach, however, instead of randomly choosing subsets, we select the minimum required subsets of k labels that cover all labels and meet additional constraints such as coverage of inter-label correlations. Construction of the cover is achieved by formulating the subset selection as a minimum set covering problem (SCP) and solving it by using approximation algorithms. Every cover needs only to be prepared once by offline algorithms. Once prepared, a cover may be applied to the classification of any given multi-label dataset whose properties conform with those of the cover. The contribution of this paper is two-fold. First, we introduce SCP as a general framework for constructing label covers while allowing the user to incorporate cover construction constraints. We demonstrate the effectiveness of this framework by proposing two construction constraints whose enforcement produces covers that improve the prediction performance of random selection. Second, we provide theoretical bounds that quantify the probabilities of random selection to produce covers that meet the proposed construction criteria. The experimental results indicate that the proposed methods improve multi-label classification accuracy and stability compared with the RAKEL algorithm and to other state-of-the-art algorithms.

show abstract

Section: Ensemble Constructionmentioning

confidence: 99%