Hybrid network model based on 3D convolutional neural network and scalable graph convolutional network for hyperspectral image classification

Abstract

Hyperspectral images (HSIs) contain hundreds of continuous spectral bands and are rich in spectral-spatial information. In terms of HSIs' classification, traditional convolutional neural networks (CNNs) extract features based on HSI's spectral-spatial information through 2D convolution. However, 2D convolution extracts features in 2D plane without considering the relationships between spectral bands, which inevitably leads to insufficient feature extraction. 3D convolutional neural networks (3DCNNs) take account of the correlations among spectral bands and outperform 2D convolutional networks in feature extraction, but the computational cost is rather expensive. To address the above problem, a light-weight three-layer 3D convolutional network Module (3D-M) for HSIs' spectral-spatial feature extraction is proposed. Another challenge is that neither 2D convolution nor 3D convolution utilizes the structural information inherent in the data. Graph convolution networks (GCNs) can model and utilize such information through the similarity matrix, also known as adjacency matrix. However, traditional GCNs cannot handle large-scale data because they construct adjacency matrix on all data, which results in high computational complexity and large storage requirement. To conquer this challenge, this article proposes a batch-graph strategy on which a scalable GCN is developed. Finally, a hybrid network model (HNM) based on the proposed light-weight 3D-M and scalable GCN is presented. HNM extracts spectral-spatial features of HSIs with low computational complexity through the light-weight 3D convolution network and leverages the structural information in data via the scalable GCN. The experimental results on three public datasets with different sizes demonstrate that the proposed HNM produces better classification results than other state-of-the-art hyperspectral images classification models in terms of overall accuracy (OA), average accuracy (AA) and kappa coefficient (Kappa).

Improving Reproducibility and Efficiency of Interstitial HDR Brachytherapy Through MRI-based Targeted Innovations

“…Although CNN is computationally expensive, since it requires large amounts of data, it is highly efficient for image processing and segmentation. The CNN is a mathematical model that is generally composed of three different layers: convolution, pooling, and fully connected layers (237,238). Figure 2.10 shows an example of how an image of a car is classified using CNN.…”

A Synergistical Attention Model for Semantic Segmentation of Remote Sensing Images

“…Tang et al [25] developed a 3-D octave convolution with the spatialspectral attention network to capture discriminative spatialspectral features for the classification of hyperspectral images. Wang et al [26] a light-weight three-layer 3D convolutional network module for hyperspectral images' spectralspatial feature extraction. Alternatively, spectral-spatial fusion mechanism was investigated.…”

Classification of Tree Species in Transmission Line Corridors Based on YOLO v7

“…The recent rapid progress in deep learning has significantly enhanced the detection accuracy and computing speed, particularly through the use of convolutional neural networks in image detection. This improvement can be attributed to the advantages of automatic learning and feature extraction inherent in deep learning techniques [8]. In the realm of tree species classification, deep learning recognition processing consistently produces classification results that outperform those of other commonly used classifiers, such as support vector machines and random forests [9].…”