Supervised Regularized Multidimensional Scaling Using Weighted Stress Measure

Abstract

Supervised Regularized Multidimensional Scaling (SRMDS), a non-linear variant of classical Multi-Dimensional Scaling (cMDS) is proposed recently which involves Radial basis function. The method is focused on the effective selection of centers of the radial basis functions in transforming data from a higher dimensional space to a lower dimension. The transformation matrix is determined by minimizing stress. Weights of components of the stress that are of great importance for classification of data got less focus in Supervised Regularized Multidimensional Scaling. In this article, we have investigated several forms of non-linear functions which may be used as weights of the stress measure. A new form of Z-shape weight function dependent on intraclass information of the dataset is introduced which prefers to preserve global structure of the dataset. The efficiency of the proposed approach is illustrated on several benchmarking datasets which shows that the weighted Supervised Regularized Multidimensional Scaling (WSRMDS) outperforms the base method and some other state of the art approaches such as Linear Discriminant Analysis (LDA), and Supervised Principal Component Analysis (SPCA). Observing the finding of this research, among different weight functions, Z-shape weight function is recommended to use since it works better then any other weight functions for most of the data sets.