Local Tangent Distances for Classification Problems

Yang, Jian Wu; Zhu, Kexin; Zhong, Ning

doi:10.1109/wi-iat.2012.46

Cited by 1 publication

(2 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When the data is assumed to lie on a low-dimensional manifold, local tangent hyperplanes are a simple and intuitive approach to enhancing the data set and gaining insight into the manifold structure. Our proposed method is very much related to tangent distance classification (TDC) [14,15,16], which constructs local tangent hyperplanes of the class manifolds, computes the distances between these hyperplanes and the given test sample, and then classifies the test sample to the class with the closest hyperplane. We show in Section 5 that our proposed method's integration of tangent hyperplane basis vectors into the sparse representation framework generally outperforms TDC.…”

Section: Related Workmentioning

confidence: 99%

“…We compared LPCA-SRC to the original SRC, SRC pruned (a modification of SRC which we explain shortly), two versions of tangent distance classification (our implementations are inspired by Yang et al [16]), locality-sensitive dictionary learning SRC [20], k -nearest neighbors classification, and k -nearest neighbors classification over extended dictionary.…”

Section: Algorithms Comparedmentioning

confidence: 99%

See 1 more Smart Citation

Improving Sparse Representation-Based Classification Using Local Principal Component Analysis

Weaver

Saito

2018

Computational Intelligence for Pattern Recognition

View full text Add to dashboard Cite

Sparse representation-based classification (SRC), proposed by Wright et al., seeks the sparsest decomposition of a test sample over the dictionary of training samples, with classification to the most-contributing class.Because it assumes test samples can be written as linear combinations of their same-class training samples, the success of SRC depends on the size and representativeness of the training set. Our proposed classification algorithm enlarges the training set by using local principal component analysis to approximate the basis vectors of the tangent hyperplane of the class manifold at each training sample. The dictionary in SRC is replaced by a local dictionary that adapts to the test sample and includes training samples and their corresponding tangent basis vectors. We use a synthetic data set and three face databases to demonstrate that this method can achieve higher classification accuracy than SRC in cases of sparse sampling, nonlinear class manifolds, and stringent dimension reduction.given training set is insufficient to generalize the data set's class structure) [5], as well as occlusion and noise [2].In 2009, Wright et al. proposed sparse representation-based classification (SRC) [2]. SRC was motivated by the recent boom in the use of sparse representation in signal processing (see, e.g., the work of Candès [6]). The catalyst of these advancements was the discovery that, under certain conditions, the sparsest representation of a signal using an over-complete set of vectors (often called a dictionary) could be found by minimizing the 1 -norm of the representation coefficient vector [7]. Since the 1 -minimization problem is convex, this gave rise to a tractable approach to obtaining the sparsest solution.SRC applies this relationship between the minimum 1 -norm and the sparsest solution to classification.The algorithm seeks the sparsest decomposition of a test sample over the dictionary of training samples via 1minimization, with classification to the class whose corresponding portion of the representation approximates the test sample with least error. The method assumes that class manifolds are linear subspaces, so that the test sample can be represented using training samples in its ground truth class. Wright et al. [2] argue that this is precisely the sparsest decomposition of the test sample over the training set. They make the case that sparsity is critical to high-dimensional image classification and that, if properly harnessed, it can lead to superior classification performance, even on highly corrupted or occluded images. Further, good results can be achieved regardless of the choice of image features that are used for classification, provided that the number of retained features is large enough [2]. Though SRC was originally applied to face recognition, similar methods have been employed in clustering [8], dimension reduction [9], and texture and handwritten digit classification [10].The SRC assumption that class manifolds are linear subspaces is often violated; e.g., facial images that v...

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Algorithms Comparedmentioning

confidence: 99%