In this paper, a multi-layer architecture (in a hierarchical fashion) by stacking various Kernel Ridge Regression (KRR) based Auto-Encoder for one-class classification is proposed and is referred as MKOC. MKOC has many layers of Auto-Encoders to project the input features into new feature space and the last layer is regression based one class classifier. The Auto-Encoders use an unsupervised approach of learning and the final layer uses semi-supervised (trained by only positive samples) approach of learning. The proposed MKOC is experimentally evaluated on 15 publicly available benchmark datasets. Experimental results verify the effectiveness of the proposed approach over 11 existing state-of-the-art kernel-based one-class classifiers. Friedman test is also performed to verify the statistical significance of the claim of the superiority of the proposed one-class classifiers over the existing state-of-the-art methods. description [5], self-organizing map data description [5], Auto-Encoder data descriptor [11] etc. Whereas, the kernelbased one-class classifier approaches are support vector data description [12], one-class support vector machine[13], kernel principal component analysis based data description [14] etc. However, kernel-based methods have been shown to outperform non-kernel-based methods in the literature [1,5]. Despite this fact, these kernel-based methods involve the solution of a quadratic optimization problem, which is computationally expensive. Apart of these kernel-based methods, KRR-based models [15] optimize the problem rapidly in a non-iterative way by solving a linear systems.Therefore, KRR-based models [15,16,17,18,19] have received quite attention by researchers for solving various types of problems viz., regression, binary, multi-class etc. In recent years, various KRR-based one-class classifiers have been developed and exhibited better performance compared to various state-of-the-art one-class classifiers. Overall, the KRR-based one-class classifiers can be divided into two types, namely, (i) without Graph-Embedding (ii) with Graph-Embedding. For 'without Graph-Embedding', two types of architectures have been explored for OCC. One is KRR-based single output node architecture [20], and other is KRR-based Auto-Encoder architecture [21]. For 'with Graph-Embedding', Iosifidis et al.[22] presented local and global structure. Different types of Laplacian Graphs are employed for local (i.e., Local Linear Embedding, Laplacian Eigenmaps etc.) and global (linear discriminant analysis and clustering-based discriminant analysis etc.) Graph-embedding. Later, global variance-based Graph-Embedding has been extended in order to exploit class variance and sub-class variance information for face verification task by Mygdalis et al.[23]. All the above-mentioned KRR-based one-class classifiers employ a single-layered architectures.Over the last decade, stacked Auto-encoder based multi-layer architectures have received quite attention by researchers for multi-class or binary class classification tasks [24,...