3d Surveying, Semantic Enrichment and Virtual Access of Large Cultural Heritage

Abstract

Abstract. In recent years, Artificial Intelligence (AI) methods for 3D point cloud classification has assumed an essential role in the heritage field. The association of semantic information to 3D representations became a valuable instrument for measurement, analysis, education or maintenance, in particular in the Cultural Heritage (CH) sector. Moreover, the recent availability and reliability of head-mounted displays and glasses are allowing extraordinary immersive virtual experiences. This paper presents an end-to-end framework to handle large and complex 3D point clouds, from acquisition to semantic segmentation and final access in a Mixed Reality (MR) environment. Three completely different heritage scenarios are considered: the Temple of Neptune in Paestum, the Milan Cathedral and a large portion of Bologna’s porticoes. Mixed Reality experiences are described and shown based on the Microsoft HoloLens 2 device. A video of the results is available at https://youtu.be/Kd_3s0tIX04.

The Augmented Museum: A Multimodal, Game-Based, Augmented Reality Narrative for Cultural Heritage

“…Head Mounted Displays (HMDs) have been recently employed to display interactive entertainment experiences in Virtual Reality (VR), communicating a strong sense of immersion [9]. Head-worn AR displays have been installed in museums, interactively communicating cultural narratives with visitors [17], [5], [19]. Digital information such as 3D replicas of archaeological artefacts have been integrated and manipulated in AR, superimposed onto the real-world [6], [20].…”

“…Digital information such as 3D replicas of archaeological artefacts have been integrated and manipulated in AR, superimposed onto the real-world [6], [20]. Users wearing AR displays either compare real-world sculptures with replicas existing in remote locations [6], interact with cultural artefacts [17], explore excavations [20] or even extract individual elements of 3D buildings such as a pillar or a foor, modifying their size and position [19]. AR has been deployed in the form of virtual guides helping users to explore cultural information in a museum [5].…”

“…The user can walk in the Athens Olympic Games Museum and be transported back to 173 AD, surrounded by sights, sounds and 3D reconstructions of monuments. AR experiences including playful elements are shown to be efective and engaging [17], [19].…”

Hololens 2 Spatial Mapping Capabilities in Vast Monumental Heritage Environments

“…Having the possibility to see the maintenance and inspection data as holograms, in real time and directly on site, would be a valuable asset to enhance and support the virtual understanding and the decision-making process inside the monumental heritage buildings. It allows for better information management and communication exchange between all actors involved and for an enhanced rationalization of the building site activities (Teruggi et al 2021c).…”

3D Surveying of Underground Built Heritage: Opportunities and Challenges of Mobile Technologies

“…The 3D digitization of Cultural Heritage (CH) is also considered a common practice for documentation, conservation, preservation, valorization, and visualization purposes [1][2][3]. Moreover, 3D data are an efficient medium for tourist attractions [4,5], for digital archiving and dissemination of artefacts and monuments to future generations [6][7][8], or for allowing VR/AR (Virtual Reality/Augmented Reality) access with mobile devices [9][10][11][12][13][14].…”