FFT-Based Filtering Approach to Fuse Photogrammetry and Photometric Stereo 3d Data

Abstract

Abstract. Image-based 3D reconstruction has been successfully employed for micro-measurements and industrial quality control purposes. However, obtaining a highly-detailed and reliable 3D reconstruction and inspection of non-collaborative surfaces is still an open issue. Photometric stereo (PS) offers the high spatial frequencies of the surface, but the low frequency is erroneous due to the mathematical model's assumptions and simplifications on how light interacts with the object surface. Photogrammetry, on the other hand, gives precise low-frequency information but fails to utilize high frequencies. As a result, in this research, we present a fusion strategy in Fourier domain to replace the low spatial frequencies of PS with the corresponding photogrammetric frequencies in order to have correct low frequencies while maintaining high frequencies from PS. The proposed method was tested on three different objects. Different cloud-to-cloud comparisons were provided between reference data and the 3D points derived from the proposed method to evaluate high and low frequency information. The obtained 3D findings demonstrated how the proposed methodology generates a high-detail 3D reconstruction of the surface topography (below 20 µm) while maintaining low-frequency information (0.09 µm on average for three different testing objects) by fusing photogrammetric and PS depth data with the proposed FFT-based method.

A Critical Analysis of NeRF-Based 3D Reconstruction

“…Other methods like cross polarisation [7,45] and image pre-processing [46,47] have been used for reflective or non-collaborative surfaces, but some techniques can potentially smooth off surface roughness and affect texture consistency across views [48,49]. Photogrammetry is also utilized in hybrid methods [50][51][52][53], where MVS approaches are used to generate a sparse 3D shape that can serve as a base for high-resolution measurements using Photometric Stereo (PS). Conventional [52,54,55] and learning-based [56][57][58] PS methods are also used to understand the image irradiance equation and retrieve the geometry of the imaged object but specular surfaces are still challenging for all image-based methods.…”

Critical Examination of 3D Building Modelling through UAV Frame and Video Imaging

“…The field of photogrammetry is witnessing significant advancements in 3D modelling (Yalcin and Selcuk, 2015), a process that involves creating a three-dimensional representation of an object from two-dimensional images (Karami et al, 2023). This technology has found applications across various domains, including surveying engineering, road pavement monitoring, digital terrain modelling, as-built surveying, quality control, building information models (BIM), and computer-aided design (CAD) (Alsadik and Khalaf, 2022).…”

The Flatness Error Evaluation of Metal Workpieces Based on Line Laser Scanning Digital Imaging Technology

“…Zhu proposed a method based on enhanced polarization and Gray-Code fringe structured light to reconstruct high dynamic range objects [20]. Karami et al proposed a fusion method to replace the low spatial frequencies of photometric stereo with the corresponding photogrammetric frequencies to correct the low frequencies based on the Fourier domain [21]. These studies captured lots of images and used the image fusion method to deal with the reflective problem and realize the 3D reconstruction and measurement.…”