Deep Neural Networks Combined with STN for Multi-Oriented Text Detection and Recognition

Abstract

Developing systems for interpreting visuals, such as images, videos is really challenging but important task to be developed and applied on benchmark datasets. This study solves the very challenge by using STN-OCR model consisting of deep neural networks (DNN) and Spatial Transformer Networks (STNs). The network architecture of this study consists of two stages: localization network and recognition network. In the localization network it finds and localizes text regions and generates sampling grid. Whereas, in the recognition network, text regions will be input and then this network learns to recognize text including low resolution, curved and multioriented text. Deep learning-based approaches require a lot of data for training effectively, therefore, this study has used two benchmark datasets, Street View House Numbers (SVHN) and International Conference on Document Analysis and Recognition (ICDAR) 2015 to evaluate the system. The STN-OCR model achieves better results than literature on these datasets.

Scene Based Text Recognition From Natural Images and Classification Based on Hybrid CNN Models with Performance Evaluation

“…This approach did not meet the necessary general symmetry points due to the small font, low contrast, and complex background in the video. The Discrete Cosine Transform (DCT) factors of the intensity images have been extensively deployed as the texture elements for text detection [16][17][18].…”