MPDNet: A 3D Missing Part Detection Network Based on Point Cloud Segmentation

Abstract

Utilizing computer vision technologies for machinery missing part detection has been a hot research topic recently. Most of existing methods take images as input and utilize 2D object detection pipelines for detecting fault regions. However, 2D models can't handle the situation when occlusion exists. To tackle the issue, in this paper, we propose a novel model named MPDNet, which exploits 3D point cloud pairs as input for missing part detection. In MPDNet, the missing part detection problem is transformed into a binary segmentation problem. The key idea behind our approach is that difference between two point clouds can be fully perceived in the latent feature space if they are encoded by the same encoder. Specially, we firstly propose a shared encode and abnormal lift module to find and enlarge difference between the target point cloud to be diagnosed and its corresponding predefined source point cloud without any fault. Then an attention based decoder is proposed to segment the source point cloud into two clusters: points that are missing in the target point cloud and points that are preserved in the target point cloud. Meanwhile, to make the model robust, a point cloud construction module is proposed as an auxiliary task to help the shared encoder to learn more discriminative features. Experiments on both synthetic and real world datasets have demonstrated the effectiveness of our model.

Fault Detection for Point Machines: A Review, Challenges, and Perspectives

“…Regarding Req. 2, an array of sensors including current, force, voltage, power, motor speed, motor torque, temperature, resistance of contacts, displacement of the operating rod and indication rod, vibration, strain, audio, tension and 2D/3D measurement sensors has been contemplated [2,52,68,69]. Obviously, reasonably deploying these transducers and fusing the mass signals becomes a problem.…”

Dual supervised sampling networks for real-time segmentation of cervical cell nucleus

“…The supervised up-sampling module is the decoding layer of the network. It includes feature fusion layers (FFM), segmentation network, and edge detection network [40] , [41] . Both edge detection and segmentation networks are composed of convolution layers ( Fig.…”

Detection for missing small sized parts based on machine vision

“…A difference image is calculated between the standard image and the target image, and the missing components on the circuit are detected and located by employing cluster analysis of the difference image. Zhaoxin Fan et al [3] utilized 3D vision technologies for machinery missing parts detection, they proposed a novel model named MPDNet, which exploits 3D point cloud pairs as input for missing part detection. The missing part detection problem is transformed into a binary segmentation problem.…”