Semantic Segmentation of High-Resolution Airborne Images with Dual-Stream DeepLabV3+

Abstract

In geospatial applications such as urban planning and land use management, automatic detection and classification of earth objects are essential and primary subjects. When the significant semantic segmentation algorithms are considered, DeepLabV3+ stands out as a state-of-the-art CNN. Although the DeepLabV3+ model is capable of extracting multi-scale contextual information, there is still a need for multi-stream architectural approaches and different training approaches of the model that can leverage multi-modal geographic datasets. In this study, a new end-to-end dual-stream architecture that considers geospatial imagery was developed based on the DeepLabV3+ architecture. As a result, the spectral datasets other than RGB provided increments in semantic segmentation accuracies when they were used as additional channels to height information. Furthermore, both the given data augmentation and Tversky loss function which is sensitive to imbalanced data accomplished better overall accuracies. Also, it has been shown that the new dual-stream architecture using Potsdam and Vaihingen datasets produced 88.87% and 87.39% overall semantic segmentation accuracies, respectively. Eventually, it was seen that enhancement of the traditional significant semantic segmentation networks has a great potential to provide higher model performances, whereas the contribution of geospatial data as the second stream to RGB to segmentation was explicitly shown.

Dual Path Attention Network (DPANet) for Intelligent Identification of Wenchuan Landslides

“…Thus, the obtained landslide sample database could be used for landslide identification. UNet, DeeplabV_3+, and pyramid scene parsing network (PSPNet) were used as a basis [50][51][52], and the PyTorch framework was used to implement the above networks for the training and validation of the sample set. The optimal baseline network was selected, and the problems revealed by the baseline network were addressed by constructing a new network to solve the problems and improve recognition accuracy.…”

Redefining brain tumor segmentation: a cutting-edge convolutional neural networks-transfer learning approach

“…The efficiency of our ensemble CNN-transfer learning system relies on the innovative architecture of DeepLabv3+, as shown in Figure 3. This model excels in semantic segmentation, emphasizing precise object boundary delineation crucial for medical image analysis [19]. Atrous or dilated convolution expands the receptive field without increasing parameters, ensuring accurate segmentation by capturing features from finegrained to high-level details.…”

A Review and Meta-analysis of Semantic Segmentation Models in Land Use/ Land Cover Mapping

“…Change detection methods employing DL have attained remarkable achievements [27] across various domains, including urban change detection [4], agriculture, forestry, wildfire management, and vegetation monitoring [28]. • Urban Among the 15 publications related to urban studies, 38% focus on segmentation applications, including urban scene segmentation [19,29,30], while 31% address urban change detection for mapping, planning, and growth [31,32]. For instance, change detection techniques provide insights into urban dynamics by identifying changes from remote sensing imagery [7], including changes in settlement areas.…”