Deep leaf‐bootstrapping generative adversarial network for structural image data augmentation

Abstract

Employing Deep Learning (DL) technologies to solve Civil Engineering problems is an emerging topic in recent years. However, due to the lack of labeled data, it is difficult to obtain accurate results with DL. One commonly used method to tackle this issue is to use affine transformation to augment the data set, but it can only generate new images that are highly correlated with the original ones. Moreover, unlike normal natural objects, distribution of structural images is much more complex and mixed. To address these challenges, Generative Adversarial Network (GAN) can be one feasible choice. We introduce one specific generative model, namely, Deep Convolutional Generative Adversarial Network (DCGAN) and propose a Leaf‐Bootstrapping (LB) method to improve the performance of this DCGAN. To effectively and quantitatively evaluate the quality of the synthetic images generated by DCGAN to complement human evaluation, Self‐Inception Score (SIS) and Generalization Ability (GA) are proposed. We also propose a pipeline based on Transfer Learning (TL) using synthetic images to help enhance a weak classifier performance under the condition of low‐data regime and limited computational resources. Finally, we conduct computer experiments with the proposed methods for two scenarios (scene level identification and damage state check) and one special synthetic data aggregation case. The results demonstrate the effectiveness and robustness of the proposed methods.

Convolutional neural networks for pavement roughness assessment using calibration‐free vehicle dynamics

“…At present, deep learning methods are popularly applied for various applications. For example, damage identification on structures with images (Cha, Choi, & Büyüköztürk, 2017;Gao, Kong, & Mosalam, 2019;Gao & Mosalam, 2018;Li, Zhao, & Zhou, 2019;Ni, Zhang, & Chen, 2019;Wu et al, 2019;Yang et al, 2018), with sensor measurements (Huang, Beck, & Li, 2019;Y. Zhang, Miyamori, Mikami, & Saito, 2019), concrete property estimation (Rafiei, Khushefati, Demirboga, & Adeli, 2017), and vehicle type detection in real traffic data (Molina-Cabello, Luque-Baena, López-Rubio, & Thurnhofer-Hemsi, 2018).…”

Transdisciplinary, expediency, and rigor of CACAIE

“…The experience with CACAIE during the review process of (Gao & Mosalam, 2018) was not an exception or an anomaly. This became evident as we experienced the same willingness to accept transdisciplinary research with expeditious and rigorous review process during our second submission, recently published as Gao, Kong, and Mosalam (2019).…”

Data Augmentation for Motor Imagery Signal Classification Based on a Hybrid Neural Network

“…Recently, some studies have demonstrated that generative adversarial networks (GANs) are well suited for EEG-DA [25,40,41]. However, few studies were conducted on the analysis of MI signals.…”