Assessment of the Degree of Building Damage Caused by Disaster Using Convolutional Neural Networks in Combination with Ordinal Regression

Abstract

We propose a new convolutional neural networks method in combination with ordinal regression aiming at assessing the degree of building damage caused by earthquakes with aerial imagery. The ordinal regression model and a deep learning algorithm are incorporated to make full use of the information to improve the accuracy of the assessment. A new loss function was introduced in this paper to combine convolutional neural networks and ordinal regression. Assessing the level of damage to buildings can be considered as equivalent to predicting the ordered labels of buildings to be assessed. In the existing research, the problem has usually been simplified as a problem of pure classification to be further studied and discussed, which ignores the ordinal relationship between different levels of damage, resulting in a waste of information. Data accumulated throughout history are used to build network models for assessing the level of damage, and models for assessing levels of damage to buildings based on deep learning are described in detail, including model construction, implementation methods, and the selection of hyperparameters, and verification is conducted by experiments. When categorizing the damage to buildings into four types, we apply the method proposed in this paper to aerial images acquired from the 2014 Ludian earthquake and achieve an overall accuracy of 77.39%; when categorizing damage to buildings into two types, the overall accuracy of the model is 93.95%, exceeding such values in similar types of theories and methods. a set of 13 change detention features and support vector machine (SVM). Simon Plank [12] reviewed the methods of rapid damage assessment using multitemporal Synthetic Aperture Radar(SAR) data. Gupta et al. [13] present a satellite imagery dataset for building damage assessment with over 700,000 labeled building instances covering over 5000 km 2 of imagery.Recent studies show that the machine learning algorithm performs well in earthquake damage assessment. Li [14] assessed building damage with one-class SVM using pre-and post-earthquake QuickBird imagery and assessed the discrimination power of different level (pixel-level, texture, and object-based) features. Haiyang et al. [15] combined SVM and the image segmentation method to detect building damage. Cooner et al. [16] evaluate the effectiveness of machine learning algorithms in detecting earthquake damage. A series of textural and structural features were used in this study. A SVM and feature selection approach was carried out for damage mapping with post-event very high spatial resolution(VHR) image and obtained overall accuracy (OA) of 96.8% and Kappa of 0.5240 [11]. Convolutional neural networks (CNN) was utilized to identify collapsed buildings from post-event satellite imagery and obtained an OA of 80.1% and Kappa of 0.46 [17]. Multiresolution feature maps were derived and fused with CNN for the image classification of building damages in [18], and an OA of 88.7% was obtained.Most of the above-mentioned damage information extracti...

Using Satellite Imagery to Understand and Promote Sustainable Development

“…These include recurrent neural network variants such as long-short term memory networks (LSTMs), 39 convolutional LSTMs, 40 and 3-D CNNs, where images are fed in sequence into the model before it makes a prediction. These models have been successfully used for crop classification, [41][42][43] crop yield prediction, 21,44 predicting landslide susceptibility, 45 assessing building damage after disasters 46,47 among many other tasks.…”

Portability and Acceleration of Deep Learning Inferences to Detect Rapid Earthquake Damage From VHR Remote Sensing Images Using Intel OpenVINO Toolkit

“…In this accuracy range, other research work based on natural disaster detection particularly for landslide and flood detection by implementing a CNN model in order to extract features more effectively was proposed in [10] using Google Earth Aerial Imagery. In addition, it can be noticed that there are several available pretrained models applied to remote sensing problems such as U-Net [11], VGG-Net [12] or Res-Net [13] focused on DL, although it is known to all researchers that to develop a robust network considering full control on architecture layers and its parameters are essentials to achieve maximizing accuracy but minimizing the computation times. As compared to aerial/UAV imagery, Geoeye-1 satellite is one of the possibilities to collected several hundred thousand square kilometers of VHR satellite imagery every day using a optimised sensor for large projects.…”

Dwell Time Estimation of Import Containers as an Ordinal Regression Problem

“…Recent studies have solved similar problems with ordinal regressors based on deep neural networks and other machine-learning algorithms, e.g., image ordinal estimation [21], knee osteoarthritis severity [22], degree of building damage [23], and Twitter sentimental analysis [24]. These problems present a class attribute with an ordinal domain, such as the dwell time of import containers in a yard.…”