A novel intelligent inspection robot with deep stereo vision for three-dimensional concrete damage detection and quantification

Abstract

Crack assessment of reinforced concrete structures using stereo cameras is a potential way for increasing the efficiency and safety of infrastructure maintenance routines. However, existing damage methods for reinforced concrete structures are based on the segmentation of two-dimensional planes without consideration to the actual size of concrete damage. Furthermore, on-site structural monitoring requires the installation of a large number of contact-based sensing devices, resulting in the potentially excessive consumption of time and financial resources. Therefore, a new vision-based damage assessment method for reinforced concrete structures using a novel intelligent inspection robot with Internet of things–enabled data communication system is proposed in this article. In the first part of this article, the data acquisition system of the inspection robot and the algorithm for three-dimensional structural reconstruction using a stereo camera is discussed. The discussion is followed by a description of the method for crack quantification based on a new proposed deep-learning technique. Finally, to accomplish damage localization, the quantified concrete damage with actual size information is projected onto a three-dimensional surface point cloud reconstruction of the inspected structure. To verify the proposed method, a reinforced concrete column that has undergone cyclic loading failure is used as an inspection subject. The validation experiment demonstrated the ability of the proposed system to segment, localize, and quantify the damage in three-dimensional space with high accuracy.

What's Cracking? A Review and Analysis of Deep Learning Methods for Structural Crack Segmentation, Detection and Quantification

“…As the camera distance to the surface is also known, they propose to quantify the cracks using the euclidean distance transform and the pinpoint camera formula. In [6] a remotecontrolled robot equipped with stereo vision is used to capture surfaces of reinforced concrete. Using the data from stereo vision, a 3-D representation of the surfaces is created.…”

Modular climbing robot design with automated vision-based defect classification

“…Inspection robot applications over the past decade are seen in technical inspection and maintenance such as failure or breakdown diagnosis [4], pipeline and turbine inspection [3], [5], [6] surface flaw detection of tanks and offshore platforms [7], power plants [8], Non-destructive testing [9] and in the aviation industry for inspection [10]. Furthermore, robots have also been applied in the inspection of civil structures [11], military and cleaning operations [12] Inspection of welds [13], marine environment for hull porosity and cracks [14], container inspection [15], aircraft structural inspection [16] [10].…”

Multidirectional crack monitoring of concrete structures using 3D piezoceramic sensing array

“…Damage monitoring plays an important role in the infrastructure's lifetime, and the challenge of implementing monitoring in practical engineering has inspired a wave of research based on vibration analysis, 1 computer vision technology, 2 near‐infrared (IR) photoluminescence, 3 percussion method, 4 and so on. In recent years, piezoceramic transducers have shown their unique advantages in structural damage monitoring for both laboratory research and field applications 5–9 .…”