Semantic Text Segmentation from Synthetic Images of Full-Text Documents

Abstract

An algorithm (divided into multiple modules) for generating images of full-text documents is presented. These images can be used to train, test, and evaluate models for Optical Character Recognition (OCR).
 The algorithm is modular, individual parts can be changed and tweaked to generate desired images. A method for obtaining background images of paper from already digitized documents is described. For this, a novel approach based on Variational AutoEncoder (VAE) to train a generative model was used.
 These backgrounds enable the generation of similar background images as the training ones on the fly.The module for printing the text uses large text corpora, a font, and suitable positional and brightness character noise to obtain believable results (for natural-looking aged documents).
 A few types of layouts of the page are supported. The system generates a detailed, structured annotation of the synthesized image. Tesseract OCR to compare the real-world images to generated images is used. The recognition rate is very similar, indicating the proper appearance of the synthetic images. Moreover, the errors which were made by the OCR system in both cases are very similar. From the generated images, fully-convolutional encoder-decoder neural network architecture for semantic segmentation of individual characters was trained. With this architecture, the recognition accuracy of 99.28% on a test set of synthetic documents is reached.

Semantic Segmentation of Intralobular and Extralobular Tissue from Liver Scaffold H&E Images

“…The second tested method inspired by [ 23 , 24 , 25 ] is built upon a feed-forward fully-convolutional neural network (CNN), with an encoder–decoder structure. Based on our previous research [ 26 ], we believe that such a structure is perfectly suitable for semantic segmentation tasks. Firstly, the encoder compresses the data from raw image pixels on the input into a feature vector representation.…”

Object Recognition by Components and Relations between Them

“…[1]. Алгоритмы распознавания нашли применение в промышленности, например, при контроле состояния оборудования, контроле ношения средств индивидуальной защиты, контроле качества сырья, полуфабрикатов и готовой продукции [1, 2], аутентификации персонала [3], а также в оцифровке текстов [4]. Решение задач распознавания объектов внешнего мира является одним из ключевых элементов в создании автономных систем, таких как автомобили с автопилотом [5], автономные робототехнические системы [6,7], системы дополненной реальности [8].…”