Semi-Supervised Semantic Segmentation Using Adversarial Learning for Pavement Crack Detection

Abstract

Regular inspection of pavement conditions is important to guarantee the safety of transportation. However, current approaches are time-consuming and subjective, which requires the technician to annotate each training image exactly pixel by pixel. To ease the workload of the inspector and lower the cost of acquiring the high-quality training dataset, a semi-supervised method for the pavement crack detection is proposed. Firstly, unlabeled pavement images can be used for the model training in our proposed algorithm, our model can generate a supervisory signal for unlabeled pavement images, which makes up for the deficiency of image annotation. Secondly, an adversarial learning method and a full convolution discriminator are adopted, which can learn to distinguish the ground truth from segmentation predictions. To improve the accuracy of pavement crack detection, the adversarial loss is coupled with the cross-entropy loss in discriminator. Thus, the quality of the training model is no longer dependent on the quantity of the labeled dataset and the accuracy of the labeled. Compared with existing methods that can only employ labeled images, our method utilizes unlabeled images to improve the pavement crack detection accuracy. Moreover, our model is validated on the CFD dataset and AigleRN dataset, the experimental results show that the proposed algorithm is effective. Compared with existing methods, not only can our method detect different types of cracks, but also be particularly effective when only a few labeled are available: when using 118 crack images with a resolution of 480 × 320, using only 50% of the labeled data, the detection accuracy of our model can reach 95.91%.

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

“…The improved algorithm can use a small number of labeled datasets to train a crack detection model with better robustness. However, when detecting relatively thin cracks, the effect is still not very satisfactory [ 37 ]. In [ 38 ], a block crack detection method was proposed, which divided the input image into block units, judged whether there were cracks in each block through the classifier, and then segmented the cracks from the classified blocks.…”

Multiscale and Adversarial Learning-Based Semi-Supervised Semantic Segmentation Approach for Crack Detection in Concrete Structures

“…When using the GAN theory, the time-consuming labeling work could be eliminated owing to the use of a deep neural network to acquire the new training image data [30], [31]. Li et al attempted to apply this method to detect the cracks occurring in road pavements [32], and this approach could likely be used as a core technology for accurate diagnosis maintenance systems to realize the crack detection in concrete structures, which requires a highly precise inspection.…”

Lightweight Semantic Segmentation for Road-Surface Damage Recognition Based on Multiscale Learning

“…Irregular road-surface conditions, such as potholes and cracks, lead to vehicle collisions and other major accidents [7]. One of the most fundamental tasks is to detect and repair the pavement crack to ensure safety on roads and highways [8]. The first step to keep the traffic safe is to locate the areas with cracks during road maintenance.…”