No abstract

The development of an accurate and efficient method for detecting missing bolts in engineering structures is crucial. To this end, a missing bolt detection method that leveraged machine vision and deep learning was developed. First, a comprehensive dataset of bolt images captured under natural conditions was constructed, which improved the generality and recognition accuracy of the trained bolt target detection model. Second, three deep learning network models, namely, YOLOv4, YOLOv5s, and YOLOXs, were compared, and YOLOv5s was selected as the bolt target detection model. With YOLOv5s as the target recognition model, the bolt head and bolt nut had average precisions of 0.93 and 0.903, respectively. Third, a missing bolt detection method based on perspective transformation and IoU was presented and validated under laboratory conditions. Finally, the proposed method was applied to an actual footbridge structure to test its feasibility and effectiveness in real engineering scenarios. The experimental results showed that the proposed method could accurately identify bolt targets with a confidence level of over 80% and detect missing bolts under different image distances, perspective angles, light intensities, and image resolutions. Moreover, the experimental results on a footbridge demonstrated that the proposed method could reliably detect the missing bolt even at a shooting distance of 1 m. The proposed method provided a low-cost, efficient, and automated technical solution for the safety management of bolted connection components in engineering structures.

Bolted joints are widely used in the field of aerospace, civil and mechanical engineering. During their service life, extreme loading or environmental factors can cause the loosening of bolts. In this paper, a bolt loosening detection method based on computer vision and image processing is developed to identify bolt rotation angle in a steel multi-story frame structure. The experimental results show that the bolt target detection accuracy can reach 100% by using the Yolo-V5s deep learning model trained with a self-developed bolt object dataset. The dataset consists of 337 bolt images captured in nature scenes. For the angle calculation, the final result shows that the identification error is less than 5.8°, and at a slight camera angle (0∼20°), the maximum error even does not exceed 2.8°. Thus, the effectiveness of this method for detecting rotary loosening of bolts is well validated.

Bolt joints are very common and important in engineering structures. Due to extreme service environment and load factors, bolts often get loose or even disengaged. To real-time or timely detect the loosed or disengaged bolts is an urgent need in practical engineering, which is critical to keep structural safety and service life. In recent years, many bolt loosening detection methods using deep learning and machine learning techniques have been proposed and are attracting more and more attention. However, most of these studies use bolt images captured in laboratory for deep leaning model training. The images are obtained in a well-controlled light, distance, and view angle conditions. Also, the bolted structures are well designed experimental structures with brand new bolts and the bolts are exposed without any shelter nearby. It is noted that in practical engineering, the above well controlled lab conditions are not easy realized and the real bolt images often have blur edges, oblique perspective, partial occlusion and indistinguishable colors etc., which make the trained models obtained in laboratory conditions loss their accuracy or fails. Therefore, the aim of this study is to develop a dataset named NPU-BOLT for bolt object detection in natural scene images and open it to researchers for public use and further development. In the first version of the dataset, it contains 337 samples of bolt joints images mainly in the natural environment, with image data sizes ranging from 400*400 to 6000*4000, totaling approximately 1275 bolt targets. The bolt targets are annotated into four categories named blur bolt, bolt head, bolt nut and bolt side. The dataset is tested with advanced object detection models including yolov5, Faster-RCNN and CenterNet. The effectiveness of the dataset is validated.