Towards Autonomous Robotic In-Situ Assembly on Unstructured Construction Sites Using Monocular Vision

Abstract

-Unlike robotics in the manufacturing industry, on-site construction robotics has to consider and address two unique challenges: 1) the rugged, evolving, and unstructured environment of typical work sites; 2) the reversed spatial relationship between the product and the manipulator, i.e. the manipulator has to travel to and localize itself at the work face, rather than a partially complete product arriving at an anchored manipulator. The presented research designed and implemented algorithms that address these challenges and enable autonomous robotic assembly of freeform modular structures on construction sites. Building on the authors' previous work in computer-vision-based pose estimation, the designed algorithms enable a mobile robotic manipulator to: 1) autonomously identify and grasp prismatic building components (e.g., bricks, blocks) that are typically non-unique and arbitrarily stored on-site; and 2) assemble these components into predesigned modular structures. The algorithms use a single camera and a visual marker-based metrology to rapidly establish local reference frames and to detect staged building components. Based on the design of the structure being assembled, the algorithms automatically determine the assembly sequence. Implemented using a 7-axis KUKA KR100 robotic manipulator, the presented robotic system has successfully assembled various structures autonomously as shown in Figure 1, demonstrating the designed algorithms' effectiveness in autonomous on-site construction robotics applications.

Virtual Training for a Real Application: Accurate Object-Robot Relative Localization Without Calibration

“…Another approach is to place one or several fiducial markers, such as ArUco (Garrido-Jurado et al, 2014, on the objects of the scene to facilitate their detection and fine localization in images. This method was successfully used in Feng et al (2014). It however is less flexible as it requires carefully positioning these markers on visible flat surfaces of the objects at well defined locations.…”

Una revisión de plataformas robóticas para el sector de la construcción

“…Existen sistemas robustos donde interactúan robots de 6 GDL, los cuales a su vez son integrados a una base con movimiento en tres ejes que ensamblan estructuras de ma-jetos (Bueno, Arteaga y Candea, 2013), así como ensamblar cada uno de estos en una estructura prediseñada (Feng et al, 2014;Feng et al, 2015).…”

“…Fuente: Ajustado de (Feng et al, 2014) y (Kayser et al, 2018. ) así como una rotación en el eje z, la cual está asociada a la pinza.…”

Autonomous robotic stone stacking with online next best object target pose planning

“…Research in architecture and digital fabrication investigates novel production techniques in which material behavior is linked to fabrication and assembly tasks [5]. Recently, it has been shown that robots bring new capabilities to construction sites, an uncontrolled environment full of uncertainties [3].…”