Machine-learning-based top-view safety monitoring of ground workforce on complex industrial sites

Abstract

Telescopic cranes are powerful lifting facilities employed in construction, transportation, manufacturing and other industries. Since the ground workforce cannot be aware of their surrounding environment during the current crane operations in busy and complex sites, accidents and even fatalities are not avoidable. Hence, deploying an automatic and accurate top-view human detection solution would make significant improvements to the health and safety of the workforce on such industrial operational sites. The proposed method (CraneNet) is a new machine learning empowered solution to increase the visibility of a crane operator in complex industrial operational environments while addressing the challenges of human detection from top-view on a resource-constrained small-form PC to meet the space constraint in the operator’s cabin. CraneNet consists of 4 modified ResBlock-D modules to fulfill the real-time requirements. To increase the accuracy of small humans at high altitudes which is crucial for this use-case, a PAN (Path Aggregation Network) was designed and added to the architecture. This enhances the structure of CraneNet by adding a bottom-up path to spread the low-level information. Furthermore, three output layers were employed in CraneNet to further improve the accuracy of small objects. Spatial Pyramid Pooling (SPP) was integrated at the end of the backbone stage which increases the receptive field of the backbone, thereby increasing the accuracy. The CraneNet has achieved 92.59% of accuracy at 19 FPS on a portable device. The proposed machine learning model has been trained with the Standford Drone Dataset and Visdrone 2019 to further show the efficacy of the smart crane approach. Consequently, the proposed system is able to detect people in complex industrial operational areas from a distance up to 50 meters between the camera and the person. This system is also applicable to the detection of any other objects from an overhead camera.

NetApps Approach for Accelerating Vertical Adoption of 5G Networks: A UAV Case

“…This will allow other researchers to compare their work with these results. Moreover, we trained YOLOv3 with a private UWS dataset allowing us to perform intruder detection in industrial areas [12] and wildness for smart agriculture scenarios. Thousands of frames were extracted and manually labelled to provide the ground truth for the training process.…”

Application of AIoT Image Sensor for Lifting Operation Safety Monitoring of Mobile Crane

“…Golcarenarenji et al proposed a method called CraneNet in 2021 to detect people under crane lifting equipment [13]. In this method, a camera is hung on a hanging hook, and an image is transmitted to a small computer with NVIDIA Jetson Xavier through a wireless network.…”

Impact of Traditional and Embedded Image Denoising on CNN-Based Deep Learning

“…All of the images for lens blur, lens dirtiness, salt and pepper noise, contrast, overexposure, and underexposure impacts are used from the CURE-OR dataset, which includes all 100 object classes. From the literature, it is evident that the complex/cluttered backgrounds make object recognition difficult [53]. Therefore, to present the type of background of the CURE-OR dataset images, an example of a set of images having their background is shown in Figure 2.…”