A Review of Point Cloud Segmentation of Architectural Cultural Heritage

Zhao, J.; Hua, X.; Yang, J.; Yin, L.; Liu, Z.; Wang, X.

doi:10.5194/isprs-annals-x-1-w1-2023-247-2023

Cited by 4 publications

(1 citation statement)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Presently, the acquisition and processing of 3D data have become key technologies [ 1 , 2 ]. These technologies play a crucial role in various fields, including innovative basic surveying and mapping [ 3 , 4 , 5 ], the creation of high-precision maps for autonomous driving [ 6 , 7 , 8 , 9 ], geological landslide monitoring [ 10 , 11 ], and the preservation of cultural heritage [ 12 , 13 , 14 , 15 , 16 ]. Point cloud data, as a primary form of 3D data, are highly favored for their ability to precisely depict the physical space’s shape and structure.…”

Section: Introductionmentioning

confidence: 99%

Point Cloud Denoising and Feature Preservation: An Adaptive Kernel Approach Based on Local Density and Global Statistics

Wang,

Chen,

Song

et al. 2024

Sensors

View full text Add to dashboard Cite

Noise removal is a critical stage in the preprocessing of point clouds, exerting a significant impact on subsequent processes such as point cloud classification, segmentation, feature extraction, and 3D reconstruction. The exploration of methods capable of adapting to and effectively handling the noise in point clouds from real-world outdoor scenes remains an open and practically significant issue. Addressing this issue, this study proposes an adaptive kernel approach based on local density and global statistics (AKA-LDGS). This method constructs the overall framework for point cloud denoising using Bayesian estimation theory. It dynamically sets the prior probabilities of real and noise points according to the spatial function relationship, which varies with the distance from the points to the center of the LiDAR. The probability density function (PDF) for real points is constructed using a multivariate Gaussian distribution, while the PDF for noise points is established using a data-driven, non-parametric adaptive kernel density estimation (KDE) approach. Experimental results demonstrate that this method can effectively remove noise from point clouds in real-world outdoor scenes while maintaining the overall structural features of the point cloud.

show abstract

Section: Introductionmentioning

confidence: 99%

Point Cloud Denoising and Feature Preservation: An Adaptive Kernel Approach Based on Local Density and Global Statistics

Wang,

Chen,

Song

et al. 2024

Sensors

View full text Add to dashboard Cite

show abstract

DSC-Net: learning discriminative spatial contextual features for semantic segmentation of large-scale ancient architecture point clouds

Zhao,

Liu,

Hua

et al. 2024

Herit Sci

View full text Add to dashboard Cite

Semantic segmentation of point cloud data of architectural cultural heritage is of significant importance for HBIM modeling, disease extraction and analysis, and heritage restoration research fields. In the semantic segmentation task of architectural point cloud data, especially for the protection and analysis of architectural cultural heritage, the previous deep learning methods have poor segmentation effects due to the complexity and unevenness of the data, the high geometric feature similarity between different components, and the large scale changes. To this end, this paper proposes a novel encoder-decoder architecture called DSC-Net. It consists of an encoder-decoder structure based on point random sampling and several fully connected layers for semantic segmentation. To overcome the loss of key features caused by random downsampling, DSC-Net has developed two new feature aggregation schemes: the enhanced dual attention pooling module and the global context feature module, to learn discriminative features for the challenging scenes mentioned above. The former fully considers the topology and semantic similarity of neighboring points, generating attention features that can distinguish categories with similar structures. The latter uses spatial location and neighboring volume ratio to provide an overall view of different types of architectural scenes, helping the network understand the spatial relationships and hierarchical structures between different architectural elements. The proposed modules can be easily embedded into various network architectures for point cloud semantic segmentation. We conducted experiments on multiple datasets, including the ancient architecture dataset, the ArCH architectural cultural heritage dataset, and the publicly available architectural segmentation dataset S3DIS. The results show that the mIoU reached 63.56%, 55.84%, and 71.03% respectively. The experimental results prove that our method has the best segmentation effect in dealing with challenging architectural cultural heritage data and also demonstrates its practicality in a wider range of architectural point cloud segmentation applications.

show abstract

Historic Built Environment Assessment and Management by Deep Learning Techniques: A Scoping Review

Giannuzzi,

Fatiguso

2024

Applied Sciences

View full text Add to dashboard Cite

Recent advancements in digital technologies and automated analysis techniques applied to Historic Built Environment (HBE) demonstrate significant advantages in efficiently collecting and interpreting data for building conservation activities. Integrating digital image processing through Artificial Intelligence approaches further streamlines data analysis for diagnostic assessments. In this context, this paper presents a scoping review based on Scopus and Web of Science databases, following the PRISMA protocol, focusing on applying Deep Learning (DL) architectures for image-based classification of decay phenomena in the HBE, aiming to explore potential implementations in decision support system. From the literature screening process, 29 selected articles were analyzed according to methods for identifying buildings’ surface deterioration, cracks, and post-disaster damage at a district scale, with a particular focus on the innovative DL architectures developed, the accuracy of results obtained, and the classification methods adopted to understand limitations and strengths. The results highlight current research trends and the potential of DL approaches for diagnostic purposes in the built heritage conservation field, evaluating methods and tools for data acquisition and real-time monitoring, and emphasizing the advantages of implementing the adopted techniques in interoperable environments for information sharing among stakeholders. Future challenges involve implementing DL models in mobile apps, using sensors and IoT systems for on-site defect detection and long-term monitoring, integrating multimodal data from non-destructive inspection techniques, and establishing direct connections between data, intervention strategies, timing, and costs, thereby improving heritage diagnosis and management practices.

show abstract

A Review of Point Cloud Segmentation of Architectural Cultural Heritage

Cited by 4 publications

References 21 publications

Point Cloud Denoising and Feature Preservation: An Adaptive Kernel Approach Based on Local Density and Global Statistics

Point Cloud Denoising and Feature Preservation: An Adaptive Kernel Approach Based on Local Density and Global Statistics

DSC-Net: learning discriminative spatial contextual features for semantic segmentation of large-scale ancient architecture point clouds

Historic Built Environment Assessment and Management by Deep Learning Techniques: A Scoping Review

Contact Info

Product

Resources

About