Word Level Font-to-Font Image Translation using Convolutional Recurrent Generative Adversarial Networks

Abstract

Conversion of one font to another font is very useful in real life applications. In this paper, we propose a Convolutional Recurrent Generative model to solve the word level font transfer problem. Our network is able to convert the font style of any printed text images from its current font to the required font. The network is trained end-to-end for the complete word images. Thus it eliminates the necessary pre-processing steps, like character segmentations. We extend our model to conditional setting that helps to learn one-to-many mapping function. We employ a novel convolutional recurrent model architecture in the Generator that efficiently deals with the word images of arbitrary width. It also helps to maintain the consistency of the final images after concatenating the generated image patches of target font. Besides, the Generator and the Discriminator network, we employ a Classification network to classify the generated word images of converted font style to their subsequent font categories. Most of the earlier works related to image translation are performed on square images. Our proposed architecture is the first of its kind which can handle images of varying widths. Word images generally have varying width depending on the number of characters present. Hence, we test our model on a synthetically generated font dataset. We compare our method with some of the state-of-the-art methods for image translation. The superior performance of our network on the same dataset proves the ability of our model to learn the font distributions.

Recognition And Classification of Indian Scripts in Natural Scene Images

“…A system to identify handwritten characters in the Odia dialect on the internet. The authors had primarily concentrated on classifying distinct classes using strokes [4]. The writers have several character recognition techniques, including feature extraction and input pre-processing, which they describe in great depth.…”

Selective Style Transfer for Text

“…Aksan et al [2] propose a generative model to disentangle content and style of handwritten text represented as temporally ordered strokes, and apply it to handwriting synthesis and style transfer. More related to our work, Ankan et al [16] focus on font to font translation in images of printed documents using a GAN architecture. Also, Azadi et al [3] propose a conditional GAN to style machine printed text to more complex scene text fonts, learning each character style independently.…”