Polarimetric synthetic aperture radar (PolSAR) image classification is a hot topic in remote sensing field. Although recently many deep learning methods such as convolutional based networks have provided great success in PolSAR image classification, but they need a high volume of labeled samples, which are not usually available in practice, or they cause a high computational burden for implementation. In this work, instead of spending cost for network training, the inherent nature of PolSAR image is used for generation of convolutional kernels for extraction of deep and robust features. Moreover, extraction of diverse scattering characteristics contained in the coherency matrix of PolSAR and fusion of their output classification results with a high confidence have high impact in providing a reliable classification map. The introduced method called discriminative features based high confidence classification (DFC) utilizes several approaches to deal with difficulties of PolSAR image classification. It uses a multi-view analysis to generate diverse classification maps with different information. It extracts deep polarimetric-spatial features, consistent and robust with respect to the original PolSAR data, by applying several pre-determined convolutional filters selected from the important regions of image. Convolutional kernels are fixed without requirement to be learned. The important regions are determined with selecting the key points of image. In addition, a two-step discriminant analysis method is proposed to reduce dimensionality and result in a feature space with minimum overlapping and maximum class separability. Eventually, a high confidence decision fusion is implemented to find the final classification map. Impact of multi-view analysis, selection of important regions as fixed convolutional kernels, two-step discriminant analysis and high confidence decision fusion are individually assessed on three real PolSAR images in different sizes of training sets. For example, the proposed method achieves 96.40% and 98.72% overall classification accuracy by using 10 and 100 training samples per class, respectively in L-band Flevoland image acquired by AIRSAR. Generally, the experiments show high efficiency of DFC compared to several state-of-the-art methods especially for small sample size situations.