Near Duplicate Image Retrieval using Multilevel Local and Global Convolutional Neural Network Features

Abstract

In this work, we present an approach based on multilevel local as well as global Convolutional Neural Network (CNN) feature matching to retrieve near duplicate images. CNN features are suitable for visual matching. The CNN features of entire image may not give accuracy in retrieval due to various image editing/capturing operations. Our retrieval task focuses on matching image pairs based on local and global levels. In local matching, an image is segmented into fixed size blocks followed by extracting patches by considering neighboring regions at different levels. Matching local image patches at different levels provides robustness to our retrieval model. In local patch extraction, we select blocks containing SURF feature points instead of selecting all blocks. CNN features are extracted and stored for each image patch and then followed by extraction of global CNN features. Finally, similarity between image pairs is computed by considering all extracted CNN features. Our similarity function is based on correlation and number of blocks found in matching. We implemented our proposed approach on benchmarking Holiday dataset. Retrieval results show remarkable improvement in mean average precision (mAP) on the dataset.

Visual Analysis on the Research of Color-based Image Retrieval

“…By using support vector machines (SVM) to classify data in a supervised learning manner, SVM algorithms can achieve more accurate results when processing small regions, even though they are still facing issues such as slow machine algorithm speed, complex algorithm implementation paths, and high computational requirements [17]. Through DL, combined with the feature data and deep belief networks (DBN) of images, color image recognition can be improved, thereby enhancing the recognition and processing capabilities of computer languages and improving the accuracy of image recognition in response to the changing nature of images [18].…”