Learning Document Image Features With SqueezeNet Convolutional Neural Network

Abstract

The classification of various document image classes is considered an important step towards building a modern digital library or office automation system. Convolutional Neural Network (CNN) classifiers trained with backpropagation are considered to be the current state of the art model for this task. However, there are two major drawbacks for these classifiers: the huge computational power demand for training, and their very large number of weights. Previous successful attempts at learning document image features have been based on training very large CNNs. SqueezeNet is a CNN architecture that achieves accuracies comparable to other state of the art CNNs while containing up to 50 times less weights, but never before experimented on document image classification tasks. In this research we have taken a novel approach towards learning these document image features by training on a very small CNN network such as SqueezeNet. We show that an ImageNet pretrained SqueezeNet achieves an accuracy of approximately 75 percent over 10 classes on the Tobacco-3482 dataset, which is comparable to other state of the art CNN. We then visualize saliency maps of the gradient of our trained SqueezeNet's output to input, which shows that the network is able to learn meaningful features that are useful for document classification. Previous works in this field have made no emphasis on visualizing the learned document features. The importance of features such as the existence of handwritten text, document titles, text alignment and tabular structures in the extracted saliency maps, proves that the network does not overfit to redundant representations of the rather small Tobacco-3482 dataset, which contains only 3482 document images over 10 classes.

Convolutional Neural Network-Based Classification Model of Corn Leaf Disease

“…SqueezeNet is a CNN architecture that can achieve the accuracy of AlexNet, which incidentally won the ImageNet classification task in 2012 by using fewer parameters and fast training time [16]. The SqueezeNet architecture replaces several 3x3 convolution layers with 1x1 and filters are used less to shrink the dimensions of the activation map or called squeeze [17]. Then, proceed with the convolution layer process with more filters to enlarge the activation map again, or what is called the expanding process.…”

Classification of heterogeneous Malayalam documents based on structural features using deep learning models

“…A novel model was investigated by Gayathri and Kannan [12] on a dataset containing over 3,000 images to classify Ayurvedic documents which gave promising results. Jimenez et al [13] [14] to classify documents based on visual features with an accuracy of 77% was obtained. Kanchi et al [15] discussed a deep multi model-based approach to classify documents on datasets containing 16 and 10 classes respectively.…”

An Automatic Internal Wave Recognition Algorithm Based on CNN Applicable to an Ocean Data Buoy System

“…Their application has revolutionized the way we tackle various challenges and tasks. With their ability to analyze large amounts of data and extract meaningful features [33,34], CNNs have been extensively applied in ocean engineering, including ocean data analysis, ocean environmental monitoring, marine robotics, and autonomous systems [35][36][37][38][39][40][41][42]. Him et al [35] show that a statistical forecast model employing a CNN approach produces skilled ENSO forecasts for lead times of up to one and a half years.…”