Rotation transformation-based selective ensemble of one-class extreme learning machines

Abstract

Extreme learning machine (ELM) possesses merits of rapid learning speed and good generalization ability. However, due to the random initialization of connection weights, the network outputs of ELM are usually unstable. Similar to ELM, one-class ELM (OCELM) also has the disadvantage of output instability. To enhance the stability and generalization performance of OCELM, a selective ensemble of OCELMs based on rotation transformation is proposed. First, principal component analysis (PCA)-based rotation transformation is utilized to construct different transformed training sets. Furthermore, several component OCELMs are trained independently on these training sets. Second, a dissimilarity measure based on angle cosine is used to evaluate the dissimilarity between each pair of OCELMs. The diversity of each component OCELM in the obtained ensemble can be further achieved. Thereafter, the component OCELMs with lower value of diversity are removed from the original ensemble. Finally, the voting strategy is utilized to determine that testing samples belong to the target class or the non-target class. Experimental results on 15 UCI benchmark data sets and one handwritten digit data set show that the proposed method is superior to its related approaches.