Geometry‐guided semantic segmentation for post‐earthquake buildings using optical remote sensing images

Abstract

Deep‐learning‐based automatic recognition of post‐earthquake damage for urban buildings is increasingly in demand for rapid and precise assessment of seismic hazards from optical remote sensing images. In this study, a novel loss function fusing geometric consistency constraint (GCC) with cross‐entropy (CE) loss is designed for post‐earthquake building segmentation with complex geometric features across multiple scales. Specifically, the GCC loss incorporates three critical components, namely, split line length, curvature, and area, and enables the exact extraction of the geometric constraints of boundary and region for damaged buildings. Through the optimization of multiple key coefficients of GCC loss, the proposed method achieves significant performance improvements in semantic segmentation, which is attributed to the enhanced ability to identify and capture the pixel relationship near the boundary. Merging GCC in the loss function enables faster and more accurate convergence of predicted values towards the ground truth during the training process, surpassing the performance of the CE loss alone. The results show that the combination of GCC and CE losses achieves the largest validation mIoU of 86.98% for damaged buildings segmentation, which facilitates post‐earthquake assessment with high accuracy. Moreover, incorporating GCC leads to more precise and robust seismic damage segmentation by effectively improving edge closure, removing internal noise, and reducing false‐positive and false‐negative misrecognition. In addition, the GCC term further validates the effectiveness of improving segmentation tasks for other networks (e.g., DeepLabv3+). The GCC‐derived method exhibits its desirable performance on segmentation accuracy, portability, and universality for building recognition with complex geometric features and post‐earthquake scenes.

Advances in Rapid Damage Identification Methods for Post-Disaster Regional Buildings Based on Remote Sensing Images: A Survey

“…For instance, Wang et al designed a novel loss function based on U-Net [53], incorporating both geometric consistency constraint and cross-entropy losses. This loss function is employed for seismic post-disaster building segmentation across multiple scales with complex geometry.…”

Coarse-to-Fine Seismic Assessment Based on Computer Vision

“…A novel loss function named geometric consistency enhanced (GCE) loss is designed considering the geometrical constraints of split line length, curvature, and area to focus on local boundaries and improve the segmentation details [15][16][17]:…”