Synthetic Aperture Radar (SAR) image segmentation and classification is a popular technique for learning and detection of objects such as buildings, trees, monuments, crops water-bodies, hills, etc. SAR technique is being used for urban development and city-planning, building control of municipal objects, searching best locations, detection of changes in the existing systems, etc. using polarimetry based on Deep Neural Networks. In this paper, weproposed a technique for Urban Image Segmentation and Classification using Polarimetric SAR based on Deep NeuralNetworks (DNN-PolSAR). In our proposed DNN-PolSAR technique, we useMask-RCNN, LinkNet, FPN, and PSP- Net as model architectures, whereas ResNet50, ResNet101, ResNet152, and VGG-19 are used as backbone networks.We first apply polarimetric decomposition on airborne Uninhabited Aerial Vehicle Synthetic Aperture (UAVSAR) im- ages of urban areas and then the decomposed images are fed to DNNs for segmentation and classification. We then simulate DNN-PolSAR considering different hyper-parameters and compare the obtained scores of hyper-parametersagainst used model architectures and backbone networks. In comparison, it is found that DNN-PolSAR based on FPN model with ResNet152 performed the best for segmentation and classification. The mean Average Precision (mAP) score of the DNN-PolSAR based on FPN with a pixel accuracy of 90.9% is 0.823, which outperforms other Deep Learning models.