In the emerging age of technologies, machines are becoming more and more skilled and capable just like humans. Despite the fact that machines do not have their own intelligence, but still due to advancement in Artificial Intelligence (AI), machines are rapidly advancing. The area of Pattern Recognition (PR) deals with bringing enhancements to identify obscure patterns corresponding to specific classes. Optical Character Recognition (OCR) is a subfield of PR which deals with the recognition of characters. A great work has been done for Japanese, Hindi, Arabic and Chinese scripts, but only a diminutive work has been done for Urdu script. The Urdu language is highly cursive and is written in different calligraphic styles like Naskh, Nastalique, Kofi, Devani and Riqa. The Nastalique font is very calligraphic with aesthetic beauty. The ligature segmentation of Urdu Nastalique is also more difficult as compared to other languages. Urdu Nastalique has some characteristics like stacking of ligatures and cursiveness which makes its ligature segmentation a difficult task. Cursiveness means ligatures are joined together to form a new shape. It contains connected ligatures which makes it more complicated as compared to other languages. The ligature recognition of Urdu text by an OCR is a strenuous task due to variants of scaling, rotation, orientation and font style. In this study, a scale and rotation invariant classifier for Urdu Nastalique OCR is proposed. A combination of scale and location invariant moments is used for feature extraction and the classification is performed using Cascade Forward Backpropagation Neural Network. The model is validated through independent dataset testing and 5-fold cross-validation which gave 96.474% and 96.922% accuracy. The results depict the adaptability of the proposed model due to its high accuracy for recognition of Urdu Nastalique Ligature.INDEX TERMS Deep neural network (DNN), optical character recognition (OCR), scale invariant classifier, rotation invariant classifier.