Robust Graph Regularized Nonnegative Matrix Factorization

Abstract

Nonnegative Matrix Factorization (NMF) has become a popular technique for dimensionality reduction, and been widely used in machine learning, computer vision, and data mining. Existing unsupervised NMF methods impose the intrinsic geometric constraint on the encoding matrix, which only indirectly affects the base matrix. Moreover, they ignore the global structure of the data space. To address these issues, in this paper we propose a novel unsupervised NMF learning framework, called Robust Graph regularized Nonnegative Matrix Factorization (RGNMF). RGNMF constructs a sparse graph imposed on the basis matrix to catch the global structure and preserve the discriminative information. And it models the local structure by building a k-NN graph constrained on the encoding matrix, which gains the compact representation. Consequently, RGNMF not only respects the global structure, but also depicts the local structure. In addition, it employs such a L2,1-norm cost function to decompose the basis matrix and encoding matrix that its robustness can be improved. Further, it imposes the L2,1-norm constraint on the basis matrix to choose the discriminative feature. Hence, RGNMF can gain the robust discriminative representation by combining structure learning and L2,1-norm constraints imposed on the basis matrix and encoding matrix. Extensive experiments on real-world problems demonstrate that RGNMF achieves better clustering results than the state-of-the-art approaches.

Multiple Graph Adaptive Regularized Semi-Supervised Nonnegative Matrix Factorization with Sparse Constraint for Data Representation

“…To enhance the performance of the original NMF method, much new research approaches have been developed in recent years [18][19][20][21][22]. For example, the graph regularizationbased NMF methods have been proposed [23][24][25], which consider the intrinsic geometry structure information of data (or feature) space, and incorporate the single (or dual) graph regularization for enhancing the performance.…”