Enhancing Optical Character Recognition on Images with Mixed Text Using Semantic Segmentation

Abstract

Optical Character Recognition has made large strides in the field of recognizing printed and properly formatted text. However, the effort attributed to developing systems that are able to reliably apply OCR to both printed as well as handwritten text simultaneously, such as hand-filled forms, is lackadaisical. As Machine printed/typed text follows specific formats and fonts while handwritten texts are variable and non-uniform, it is very hard to classify and recognize using traditional OCR only. A pre-processing methodology employing semantic segmentation to identify, segment and crop boxes containing relevant text on a given image in order to improve the results of conventional online-available OCR engines is proposed here. In this paper, the authors have also provided a comparison of popular OCR engines like Microsoft Cognitive Services, Google Cloud Vision and AWS recognitions. We have proposed a pixel-wise classification technique to accurately identify the area of an image containing relevant text, to feed them to a conventional OCR engine in the hopes of improving the quality of the output. The proposed methodology also supports the digitization of mixed typed text documents with amended performance. The experimental study shows that the proposed pipeline architecture provides reliable and quality inputs through complex image preprocessing to Conventional OCR, which results in better accuracy and improved performance.

An efficient method for disaster tweets classification using gradient-based optimized convolutional neural networks with BERT embeddings

“…This is most suitable for tasks such as text classification. The parameters, such as moving averages of gradients and squared gradients, are adaptively fine-tuned to arrive at early convergence [ 18 ]. In the context of text classification of disaster tweets, exponentially decaying moving averages of gradients and squared gradients ( ) are properly maintained.…”

Telugu letters dataset and parallel deep convolutional neural network with a SGD optimizer model for TCR

“…SGD has difficulty navigating ravines, which are frequently found near local optimums and are defined as regions where the surface slopes considerably more sharply in one dimension than another. A function's local minimum can be found using the optimization technique known as GD [32]. The weights are iteratively updated in backpropagation to reduce the error function.…”

A Survey of OCR in Arabic Language: Applications, Techniques, and Challenges

“…Patil et al [76] propose a semantic segmentation approach for images containing mixed text to segment the image into different regions based on their content. The segmented regions are then processed using different OCR methods that are specifically tailored to the type of text in each region.…”