Three Dimentional Reconstruction of Large Cultural Heritage Objects Based on Uav Video and TLS Data

Abstract

Special Session, CIPA KEY WORDS: 3D reconstruction, cultural heritage, video image sequences, terrestrial laser scanning, unmanned aerial vehicle ABSTRACT:This paper investigates the synergetic use of unmanned aerial vehicle (UAV) and terrestrial laser scanner (TLS) in 3D reconstruction of cultural heritage objects. Rather than capturing still images, the UAV that equips a consumer digital camera is used to collect dynamic videos to overcome its limited endurance capacity. Then, a set of 3D point-cloud is generated from video image sequences using the automated structure-from-motion (SfM) and patch-based multi-view stereo (PMVS) methods. The TLS is used to collect the information that beyond the reachability of UAV imaging e.g., partial building facades. A coarse to fine method is introduced to integrate the two sets of point clouds UAV image-reconstruction and TLS scanning for completed 3D reconstruction. For increased reliability, a variant of ICP algorithm is introduced using local terrain invariant regions in the combined designation. The experimental study is conducted in the Tulou culture heritage building in Fujian province, China, which is focused on one of the TuLou clusters built several hundred years ago. Results show a digital 3D model of the Tulou cluster with complete coverage and textural information. This paper demonstrates the usability of the proposed method for efficient 3D reconstruction of heritage object based on UAV video and TLS data.

Usability of aerial video footage for 3D-scene reconstruction and structural damage assessment

“…Here the method used to select the highest-quality video frames (i.e. WFS) produced low-density point clouds, in contrast to Xu et al (2016) who claimed that the reduction of motion-blur frames generated denser 3DPCs. The authors, however, did not consider redundancy whose reduction implies the elimination of a large number of frames.…”

“…Alternatively, aerial video footage typically obtained by civil defense forces, police, fire services or news media is less subjected to the legal regulations. Those data optimize the endurance flight time capacity and can even be streamed 25 straight to the operator to be available in near real-time, making them a potentially powerful information source for damage mapping (FSD, 2016;Xu et al, 2016). Video data are in essence a combination of still frames that can be easily extracted and used as aerial images for post-disaster SDA.…”

“…(2014) used video sequences for 3D City modeling and later Alsadik et al (2015) and Xu et al (2016) treated video data for the detection of cultural heritage objects. In general, processing pipelines were focused on an effective selection of good quality and non-redundant video frames and their automated and accurate geo-registration (Ahmed et al, 2010;Clift and Clark, 2016;Eugster and Nebiker, 2007).…”

Usability of aerial video footage for 3-D scene reconstruction and structural damage assessment

“…Alternatively, aerial video footage typically obtained by civil defense forces, police, fire services, or news media is less subjected to the legal regulations. Those data optimize the endurance flight time capacity and can even be streamed straight to the operator to be available in near-real time, making them a potentially powerful information source for damage mapping (FSD, 2016;Xu et al, 2016). Video data are in essence a combination of still frames that can be easily extracted and used as aerial images for post-disaster SDA.…”

“…Only a few mono-temporal SDA methods using 3-D data have been developed, typically based on point neighborhoods and segment-level extracted geometric features. Khoshelham et al (2013) Singh et al (2014) used video sequences for 3-D city modeling, and later Alsadik et al (2015) and Xu et al (2016) treated video data for the detection of cultural heritage objects. In general, processing pipelines were focused on an effective selection of good-quality and non-redundant video frames and their automated and accurate geo-registration (Ahmed et al, 2010;Clift and Clark, 2016;Eugster and Nebiker, 2007).…”