GaborNet: investigating the importance of color space, scale and orientation for image classification

Abstract

Content-Based Image Retrieval (CBIR) is the cornerstone of today’s image retrieval systems. The most distinctive retrieval approach used, involves the submission of an image-based query whereby the system is used in the extraction of visual characteristics like the shape, color, and texture from the images. Examination of the characteristics is done for ensuring the searching and retrieval of proportional images from the image database. Majority of the datasets utilized for retrieval lean towards to comprise colored images. The colored images are regarded as in RGB (Red, Green, Blue) form. Most colored images use the RGB image for classifying the images. The research presents the transformation of RGB to other color spaces, extraction of features using different color spaces techniques, Gabor filter and use Convolutional Neural Networks for retrieval to find the most efficient combination. The model is also known as Gabor Convolution Network. Even though the notion of the Gabor filter being induced in CNN has been suggested earlier, this work introduces an entirely different and very simple Gabor-based CNN which produces high recognition efficiency. In this paper, Gabor Convolutional Networks (GCNs or GaborNet), with different color spaces are used to examine which combination is efficient to retrieve natural images. An extensive experiment using Cifar 10 dataset was made and comparison of simple CNN, ResNet 50 and GCN model was also made. The models were evaluated through a several statistical analysis based on accuracy, precision, recall, F-Score, area under the curve (AUC), and receiving operating characteristic (ROC) curve. The results shows GaborNet model effectively retrieve images with 99.68% of AUC and 99.09% of Recall. The results also shows different images are effectively retrieved using different color space. Therefore research concluded it is very significance to transform images to different color space and use GaborNet for effective retrieval.

MultiFusedNet: A Multi-Feature Fused Network of Pretrained Vision Models via Keyframes for Student Behavior Classification

“…To extract features from each video keyframe, we first apply an image transform from RGB to CIELAB or L*a*b* color space [41]. We then feed the transformed image through a VGG-16 model, which utilizes a global average pooling layer for its final pooling operation.…”

Rotational Invariance Using Gabor Convolution Neural Network and Color Space for Image Processing

“…Several approaches based on Gabor Convolutional Networks have been used in this paper. Rimiru et al (2022) develop a method for determining the significance of color space, scale, and orientation in image classification. The authors discovered the best Gabor parameters for feature extraction (Krizhevsky et al, 2017).…”

Hybrid Features of Mask Generated with Gabor Filter for Texture Analysis and Sobel Operator for Image Regions Segmentation Using K-Means Technique

“…Also, there is another color space which considered a very common color space which is CIE (Commission International de lclairage) LAB. The CIELAB color space (denoted as CIE L*a*b* or infrequently abbreviated as "Lab" color space) which is considered by CIE (International Commission on Illumination) in 1976 (Rimiru et al,2022). In this paper, the segmentation process proposed to apply two different color spaces based on the Gabor filter and gradient image intensity with the Sobel operator.…”