Multi-Scale CNN for Fine-Grained Image Recognition

Abstract

Most conventional fine-grained image recognitions are based on a two-stream model of object-level and part-level CNNs, where the part-level CNN is responsible for learning the object-parts and their spatial relationships. To train the part-level CNN, we first need to separate parts from an object. However, there exist sub-level objects with no distinctive and separable parts. In this paper, a multi-scale CNN with a baseline Object-level and multiple Part-level CNNs is proposed for the fine-grained image recognition with no separable object-parts. The basic idea to train different CNNs of the multi-scale CNNs is to adopt different scales in resizing the training images. That is, the training images are resized such that the entire object appears as much as possible for the Object-level CNN, while only a local part of the object is to be included for the Part-level CNN. This scale-specific image resizing approach requires a scale-controllable parameter in the image resizing process. In this paper, a scale-controllable parameter is introduced for the linear-scaling and random-cropping method. Also, a line-based image resizing method with a scale-controllable parameter is employed for the part-level CNNs. The proposed multi-scale CNN is applied to a food image classification, which belongs to a fine-grained classification problem with no separable object-parts. Experimental results on the public food image datasets show that the classification accuracy improves substantially when the predicted scores of the multi-scale CNN are fused together. This reveals that the object-level and part-level CNNs work harmoniously in differentiating subtle differences of the sub-level objects.

Kohonen Network-Based Adaptation of Non Sequential Data for Use in Convolutional Neural Networks

“…CNN networks are one of the primary sources of deep learning success. They have been used in image recognition [3][4][5], facial analysis [6], speech recognition [7], analysis of ECG records [8,9], analysis of medical images [10], natural language processing [11], and many other problems of classification of sequential data, i.e., videos, images and time series. Their key role in computational generative methods such as autoencoders [12] and generative-adversarial networks (GANs) [13] cannot be overlooked either.…”

Object Detection and Classification Based on YOLO-V5 with Improved Maritime Dataset

“…The application areas that make use of domain-specific datasets have been expanding and now include road condition recognition [9,10], face detection [11,12], and food recognition [13,14], among others. Object recognition [15,16] in maritime environments is another important domain-specific problem for various security and safety purposes.…”

Prediction of Confined Flow Field Around a Circular Cylinder and Its Force Based on Convolution Neural Network

“…This modeling paradigm of exploring physical mechanisms with deep learning models is called data-driven model [9,10]. As one of the most promising deep learning models, the convolutional neural network (CNN) has wide successful applications [11][12][13], especially in image classification [14], recognition [15] since it was first proposed by Lecun [16]. For the combination of CNN model and CFD method, some papers has been published recently [17][18][19].. Jin et al [20] used CNN to establish the mapping relationship between the pressure fluctuations on the cylinder and the velocity field around the cylinder using the CFD dataset.…”