Integration of 3D and multispectral data for cultural heritage applications: Survey and perspectives

Abstract

Cultural heritage is increasingly put through imaging systems such as multispectral cameras and 3D scanners. Though these acquisition systems are often used independently, they collect complementary information (spectral vs. spatial) used for the study, archiving and visualization of cultural heritage. Recording 3D and multispectral data in a single coordinate system enhances the potential insights in data analysis.We present the state of the art of such acquisition systems and their applications for the study of cultural heritage. We also describe existing registration techniques that can be used to obtain 3D models with multispectral texture and explore the idea of optically tracking acquisition systems to ensure an easy and precise registration.

Review of Methods for Documentation, Management, and Sustainability of Cultural Heritage. Case Study: Museum of King Jan III’s Palace at Wilanów

“…However, the scope of information possible to obtain increases if the spectral information is combined with 3D shape reconstruction. The integration of spectral and geometric data was a subject of many works [17,40,83,[138][139][140][141][142]. Nevertheless, this issue remains a challenge in the near future.…”

Let's Get Virtual: An Examination of Best Practices to Provide Public Access to Digital Versions of Three-Dimensional Objects

“…Multispectral imaging, however, is very expensive and, despite some researchers' attempts to create affordable systems (e.g., Novati, Pellegri, and Schettini 2005), the acquisition of multispectral images is generally limited to large institutions with considerable funding (Chane et al 2013). …”

“…Chane et al (2013), for example, examined methods of combining three-dimensional digitization with multispectral photography in order to obtain enhanced information concerning the physical object in question. The researchers explained that combining the two processes is difficult because, in order to obtain multispectral textural data that is mapped to geometric positions, the object must be imaged from identical locations by multiple scanners/cameras or else the data processing that combines the two types of data becomes extremely complex.…”

“…As a compromise, the researchers created a system of optical tracking based on photogrammetry techniques that permits the collection and integration of geometric positioning data and multispectral textures utilizing precise targeting procedures. However, the researchers noted that most systems integrating multispectral photography with threedimensional digitization tended to be quite bulky, did not adapt easily to different types of objects, and needed better processing algorithms for more complex three-dimensional objects (Chane et al 2013).…”

Three-dimensional maps of human skin properties on full face with shadows using 3-D hyperspectral imaging

“…The above constraints have led us to develop the 3-D hyperspectral measurement setup and the method of analysis presented in this paper. Our approach differs from existing methods for imaging still objects, 17 by combining several elements into a unique solution in the field of skin measurement. The novelty of our acquisition method is that it allows for a short acquisition time with optimal spatial and spectral resolutions using a single camera, making it suited to wide-field in vivo measurements.…”