Sensor Fusion Based Pipeline Inspection for the Augmented Reality System

Abstract

Augmented reality (AR) systems are becoming next-generation technologies to intelligently visualize the real world in 3D. This research proposes a sensor fusion based pipeline inspection and retrofitting for the AR system, which can be used in pipeline inspection and retrofitting processes in industrial plants. The proposed methodology utilizes a prebuilt 3D point cloud data of the environment, real-time Light Detection and Ranging (LiDAR) scan and image sequence from the camera. First, we estimate the current pose of the sensors platform by matching the LiDAR scan and the prebuilt point cloud data from the current pose prebuilt point cloud data augmented on to the camera image by utilizing the LiDAR and camera calibration parameters. Next, based on the user selection in the augmented view, geometric parameters of a pipe are estimated. In addition to pipe parameter estimation, retrofitting in the existing plant using augmented scene are illustrated. Finally, step-by-step procedure of the proposed method was experimentally verified at a water treatment plant. Result shows that the integration of AR with building information modelling (BIM) greatly benefits the post-occupancy evaluation process or pre-retrofitting and renovation process for identifying, evaluating, and updating the geometric specifications of a construction environment.

Application of Building Information Modelling (BIM) in the Health Monitoring and Maintenance Process: A Systematic Review

“…Health monitoring through BIM is not restricted to structures and can be applied to practical fields such as underground pipelines [ 199 ]. Some researchers have focused on monitoring the corrosion of pipelines in the petroleum industry or the rehabilitation and maintenance process of pipelines [ 18 , 200 ]. Integrating a BIM system with passive sensors to collect site data by considering sensing technology has been a notably relevant approach [ 18 ].…”

“…Integrating a BIM system with passive sensors to collect site data by considering sensing technology has been a notably relevant approach [ 18 ]. Considering various types of pipeline material, improving the model by using novel sensing technology, and optimizing outputs by changing the location and angle of sensors are on the agenda within this category in the future [ 200 ].…”

Energy Saving Benefit Analysis of the Compressor Short-Stop Adjustment Method Based on TGNET

“…MPRS, IGVOA, and CSSA regulation principle in the OTDS (ASU photograph is from the literature; low-pressure and medium-pressure relief valves are from the literature; the OTDS is from the literature; buffer unit is from the literature; the CC is from the literature; user photographs are from the literature , ).…”

Immersive technologies as a solution for general data protection regulation in Europe and impact on the COVID-19 pandemic

“…According to the European Commission, personal data is any information connected with a citizens private, professional, and/or public life [2]. These are, among others, data like names, surnames, photos, home address or social media activities [Article 2, Article 4(1) and (5) and Recitals (14), (15), (26), (27), (29) and (30)] [3] The second type of information, i.e., sensitive data are related to racial or ethnic origin, political opinions, religious or philosophical beliefs, genetic data, biometric data, health-related data as well as sexual orientation of individuals [Article 4 (13), (14) and (15) and Article 9 and Recitals (51) to (56)] [4]. GDPR is similar to US privacy law and Federal Trade Commission settlements with companies, but is more restrictive.…”

“…Mixed reality is a hybrid of both augmented and virtual realities. AR/VR/MR devices offer a new quality for art and entertainment [9,10], maintenance [11,12], architecture [13], industry [14] healthcare delivery and education in medicine [15]. Recently, the number of applications in the healthcare sector have systematically increased.…”