Image Analysis on Symmetric Positive Definite Manifolds

Abstract

Over the last two decades, the research community has witnessed extensive research growth in the field of analysing and understanding scenes. Automatic scene analysis can support many critical applications, from person reidentification as an advanced security tool, to real-time action classification as an assistive technology for disabled patients. However, building effective systems is still a challenge due to the presence of occlusion, varying illumination, varying pose and other factors encountered in the practical environment.To deal with the real world environment, which is naturally not free from noise, a recent trend in computer vision is to represent a given image through a covariance matrix of a set of extracted features. Covariance matrices are robust to noise and are well known to be compact and informative feature descriptors. Non-singular covariance matrices are naturally symmetric positive definite (SPD) matrices which form connected Riemannian manifolds.As such, their underlying distance and similarity functions might not be accurately defined in Euclidean space, and consequently the Riemannian geometry needs to be considered in order to solve scene analysing tasks. The traditional methods of analysing such manifolds require embedding them in Euclidean spaces, a process which can be interpreted as warping the feature space. However, embedding manifolds is not free from drawbacks and it can lead to limitations, as the manifold structure may not be accurately preserved.In this work we propose three methods for analysing SPD matrices on Riemannian manifolds that unlike traditional methods respect the underlying structure of a given image, while considering the computational complexity of the learning algorithm. While all three methods offer strong solutions for the task of image analysis over SPD manifolds that outperform state-ofthe-art methods, each of them tends to tackle one vision application better than the rest. This is owed to the existing differences between each vision application. Although all of these vision tasks can be categorised as a image classification problem, each application offers unique challenges, such as very limited training data, strong pose variation etc. To be more specific, the 1 first proposed method outperforms the rest of the proposed methods in face recognition; the extension of the second method performs very well in the task of person re-identification; and the last proposed method outperforms other two in the task of texture recognition.This work addresses the challenge of analysing SPD manifolds using the below proposed methods:1. Graph-Embedding Discriminant Analysis 2. Relational Divergence Based Classification Random ProjectionsThe first method proposes to embed Riemannian manifolds into Reproducing Kernel Hilbert Spaces (RKHS) and then tackle the problem of discriminant analysis on the Hilbert space. To achieve an efficient machinery, we present a graph-based local discriminant analysis that utilises within-class and between-class similarity graphs to...