Improving Sparse Representation-Based Classification Using Local Principal Component Analysis

Abstract

Sparse representation-based classification (SRC), proposed by Wright et al., seeks the sparsest decomposition of a test sample over the dictionary of training samples, with classification to the most-contributing class.Because it assumes test samples can be written as linear combinations of their same-class training samples, the success of SRC depends on the size and representativeness of the training set. Our proposed classification algorithm enlarges the training set by using local principal component analysis to approximate the basis vectors of the tangent hyperplane of the class manifold at each training sample. The dictionary in SRC is replaced by a local dictionary that adapts to the test sample and includes training samples and their corresponding tangent basis vectors. We use a synthetic data set and three face databases to demonstrate that this method can achieve higher classification accuracy than SRC in cases of sparse sampling, nonlinear class manifolds, and stringent dimension reduction.given training set is insufficient to generalize the data set's class structure) [5], as well as occlusion and noise [2].In 2009, Wright et al. proposed sparse representation-based classification (SRC) [2]. SRC was motivated by the recent boom in the use of sparse representation in signal processing (see, e.g., the work of Candès [6]). The catalyst of these advancements was the discovery that, under certain conditions, the sparsest representation of a signal using an over-complete set of vectors (often called a dictionary) could be found by minimizing the 1 -norm of the representation coefficient vector [7]. Since the 1 -minimization problem is convex, this gave rise to a tractable approach to obtaining the sparsest solution.SRC applies this relationship between the minimum 1 -norm and the sparsest solution to classification.The algorithm seeks the sparsest decomposition of a test sample over the dictionary of training samples via 1minimization, with classification to the class whose corresponding portion of the representation approximates the test sample with least error. The method assumes that class manifolds are linear subspaces, so that the test sample can be represented using training samples in its ground truth class. Wright et al. [2] argue that this is precisely the sparsest decomposition of the test sample over the training set. They make the case that sparsity is critical to high-dimensional image classification and that, if properly harnessed, it can lead to superior classification performance, even on highly corrupted or occluded images. Further, good results can be achieved regardless of the choice of image features that are used for classification, provided that the number of retained features is large enough [2]. Though SRC was originally applied to face recognition, similar methods have been employed in clustering [8], dimension reduction [9], and texture and handwritten digit classification [10].The SRC assumption that class manifolds are linear subspaces is often violated; e.g., facial images that v...

Sparse Representation for Different Animal Vertebra Classification along the Fixation Trajectory of Pedicle Screw

“…e experimental system for spectrum measurement is shown in Figure 1, which consists of a HL2000-HP-FHSA light source (Ocean Optics), free-hand drilling probe, USB2000 fibre optic spectrometer (Ocean Optics, wavelength gating from 200 nm to 1100 nm), and a computing workstation [16]. e self-made free-hand drill probe holder has a diameter of 5 mm, and two optical fibres with a diameter of 200 μm each were used for optical transmission and acquisition, respectively.…”

“…However, these methods have some disadvantages, which cannot be avoided. In this paper, the spare representation-based classifier (SRC) was first applied for tissue optical reflectance spectra recognition [16]. Compared with other methods, the proposed method does not need to extract the features of area, peak, and shape of the spectra.…”