BIM-assisted object recognition for the on-site autonomous robotic assembly of discrete structures

Abstract

Robots-operating autonomous assembly applications in an unstructured environment require precise methods to locate the building components on site. However, the current available object detection systems are not well-optimised for construction applications, due to the tedious setups incorporated for referencing an object to a system and inability to cope with the elements imperfections. In this paper, we propose a flexible object pose estimation framework to enable robots to autonomously handle building components on-site with an error tolerance to build a specific design target without the need to sort or label them. We implemented an object recognition approach that uses the virtual representation model of all the objects found in a BIM model to autonomously search for the best-matched objects in a scene. The design layout is used to guide the robot to grasp and manipulate the found elements to build the desired structure. We verify our proposed framework by testing it in an automatic discrete wall assembly workflow. Although the precision is not as expected, we analyse the possible reasons that might cause this imprecision, which paves the path for future improvements. 3world. This criterion is often not the case in construction environments. These limitations reduce the flexibility and speed of systems in accommodating the significant creative demands of current building construction applications.

Evolutive Dataset for Social Housing Design Projects through Artificial Intelligence: From pixel to BIM through deep learning

“…The ensemble method of programming techniques aided by AI procedures is a tool that works on many levels (Dawod and Hanna, 2019;Abhilash and Ahmed, 2023). In this research, GH helped with the interoperability of the process, connecting Microsoft Excel, ArchiCAD, and Rhinoceros, in a digital production script to optimize exhaustive design tasks that become complex when combined in real-life situations, mostly due to the quantity of data to process.…”

Human-Organization-Technology Fit Model for BIM Adoption in Construction Project Organizations: Impact Factor Analysis Using SNA and Comparative Case Study

“…Note: References 1 (Singh et al, 2011), 2 (Becerik-Gerber et al, 2012, 3 (Chien et al, 2014), 4 (Lee et al, 2015), 5 (Sun et al, 2015), 6 (Charehzehi et al, 2017), 7 (Ghaffarianhoseini et al, 2017), 8 (Ahmed & Kassem, 2018), 9 (Dawod & Hanna, 2019), 10 (Kim et al, 2020, 11 (Lu et al, 2020)…”

Scan-vs-Bim for Real-Time Progress Monitoring of Bridge Construction Project

“…Czerniawski and Leite (2020)'s review reveals that current automatic object recognition methodologies based on machine learning can only recognize the main structures of the buildings accurately and it is vulnerable to the components with various features, such as window. Hence, Dawod and Hanna (2019) explores the feasibility of introducing as-design BIM into object recognition via geometric features fitting. The mainstream of Scan-vs-BIM methodologies includes point-to-surface and pointto-point comparison.…”