A Hierarchical Building Segmentation in Digital Surface Models for 3D Reconstruction

Abstract

Abstract:In this study, a hierarchical method for segmenting buildings in a digital surface model (DSM), which is used in a novel framework for 3D reconstruction, is proposed. Most 3D reconstructions of buildings are model-based. However, the limitations of these methods are overreliance on completeness of the offline-constructed models of buildings, and the completeness is not easily guaranteed since in modern cities buildings can be of a variety of types. Therefore, a model-free framework using high precision DSM and texture-images buildings was introduced. There are two key problems with this framework. The first one is how to accurately extract the buildings from the DSM. Most segmentation methods are limited by either the terrain factors or the difficult choice of parameter-settings. A level-set method are employed to roughly find the building regions in the DSM, and then a recently proposed 'occlusions of random textures model' are used to enhance the local segmentation of the buildings. The second problem is how to generate the facades of buildings. Synergizing with the corresponding texture-images, we propose a roof-contour guided interpolation of building facades. The 3D reconstruction results achieved by airborne-like images and satellites are compared. Experiments show that the segmentation method has good performance, and 3D reconstruction is easily performed by our framework, and better visualization results can be obtained by airborne-like images, which can be further replaced by UAV images.

Building Extraction Based on an Optimized Stacked Sparse Autoencoder of Structure and Training Samples Using LIDAR DSM and Optical Images

“…As the most typical features of artificial landscapes, buildings play an important role in urban planning, urban development and military affairs [ 5 ].…”

A Critical Review of Unmanned Aerial Vehicles (UAVs) Use in Architecture and Urbanism: Scientometric and Bibliometric Analysis

“…For this reason, new methods have been designed to extract more information from remote sensing data in a reliable and automated way [43]. Segmentation techniques and object-based approaches were subsequently applied to the three-dimensional models to detect vectors, shapes, textures and segments of the photographed buildings [42,[73][74][75]. Methods such as object-based image analysis (OBIA) became popular because of their ability to incorporate image elements such as colours, sizes, shapes, textures and patterns in the segmentation process [76].…”

Y-Shaped Convolutional Neural Network for 3d Roof Elements Extraction to Reconstruct Building Models From a Single Aerial Image

“…Hence, a considerable number of researches is dedicated to automatic building detection, localization, and reconstruction in photogrammetry and remote sensing. As a general categorization, current algorithms for 3D Building Reconstruction (3DBR) can be divided into three basic methods: data-driven (Awrangjeb et al, 2018;Cheng et al, 2011;Kim and Shan, 2011;Sampath and Shan, 2010;Yan et al, 2017), modeldriven (Huang et al, 2011;Partovi et al, 2015;Zhang et al, 2014;Zheng et al, 2017), and hybrid methods (Wang et al, 2016;Xiong et al, 2015). The differences between the data-driven and model-driven methods have been discussed in previous studies (Tarsha-Kurdi et al, 2006;R.…”