Three-dimensional reconstruction based on multi-view photometric stereo fusion technology in movies special-effect

Xie, Xiaolu

doi:10.1007/s11042-019-08034-w

Cited by 9 publications

(6 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although these systems can achieve high accuracy performances, the use of costly instrumentation limits the technique only to specialized laboratories and projects with unique metrological specifications. Multi-view stereo approaches were also used to create sparse 3D shape reconstruction, free of global deformation, of objects with Lambertian surfaces (Vlasic et al, 2009;Park et al, 2013;Grochulla et al, 2015;Park et al, 2016;Logothetis et al, 2019;Li et al, 2020;Xie et al, 2020). These were then used as a base for high-resolution measurements produced using photogrammetry.…”

Section: Combined Methodsmentioning

confidence: 99%

“…In particular, Park et al (2013) used a single stereo camera to acquire stereo images for 3D reconstruction, which can be limiting and may negatively impact the final 3D results when the surface is non-collaborative. A common solution used to mitigate this issue is to increase the number of synchronized cameras (Vlasic et al, 2009;Xie et al, 2020), although it might be unsuitable for low-budget industrial inspection projects. Another alternative is to increase the number of image stations (Grochulla et al, 2015;Park et al, 2016;Logothetis et al, 2019), which is a time-consuming procedure, unsuitable for real-time 3D inspection.…”

Section: Combined Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Investigating 3d Reconstruction of Non-Collaborative Surfaces Through Photogrammetry and Photometric Stereo

Karami

Menna

Remondino

2021

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

Abstract. 3D digital reconstruction techniques are extensively used for quality control purposes. Among them, photogrammetry and photometric stereo methods have been for a long time used with success in several application fields. However, generating highly-detailed and reliable micro-measurements of non-collaborative surfaces is still an open issue. In these cases, photogrammetry can provide accurate low-frequency 3D information, whereas it struggles to extract reliable high-frequency details. Conversely, photometric stereo can recover a very detailed surface topography, although global surface deformation is often present. In this paper, we present the preliminary results of an ongoing project aiming to combine photogrammetry and photometric stereo in a synergetic fusion of the two techniques. Particularly, hereafter, we introduce the main concept design behind an image acquisition system we developed to capture images from different positions and under different lighting conditions as required by photogrammetry and photometric stereo techniques. We show the benefit of such a combination through some experimental tests. The experiments showed that the proposed method recovers the surface topography at the same high-resolution achievable with photometric stereo while preserving the photogrammetric accuracy. Furthermore, we exploit light directionality and multiple light sources to improve the quality of dense image matching in poorly textured surfaces.

show abstract

Section: Combined Methodsmentioning

confidence: 99%

Section: Combined Methodsmentioning

confidence: 99%

Investigating 3d Reconstruction of Non-Collaborative Surfaces Through Photogrammetry and Photometric Stereo

Karami

Menna

Remondino

2021

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…Photogrammetry has also been used in hybrid systems (Lim et al., 2005; Wu et al., 2009; Park et al., 2013, 2016; Grochulla and Thormählen, 2015; Logothetis et al., 2019; Li et al., 2020; Xie, 2020; Karami et al., 2021). MVS approaches are used to create a sparse 3D shape of an object, free from global deformation, used as a base for high‐resolution measurements produced using the PS concept.…”

Section: Related Workmentioning

confidence: 99%

Exploiting Light Directionality for Image‐Based 3D Reconstruction of Non‐Collaborative Surfaces

Karami

Menna

Remondino

et al. 2022

The Photogrammetric Record

View full text Add to dashboard Cite

Three-dimensional (3D) measurement of non-collaborative surfaces is still an open research topic. This paper investigates and quantifies for the first time the effect of light directionality and fusion of multiple images as a method to improve the quality of photogrammetric 3D reconstruction. For this aim, an image acquisition system that employs multiple light sources was developed to highlight the roughness and microstructures of the object under investigation. Images were captured at various grazing angles to highlight the local surface roughness and microstructures. Individual point clouds, created using images taken at different grazing angles, were produced using dense image-matching techniques. These point clouds were then compared against different 3D photogrammetric reconstructions obtained from a pre-processing of the acquired images based on diffuse lighting, median and average images. Experiments showed that exploiting light directionality significantly improves image-matching quality. Furthermore, depending on the light direction, the root mean square (RMS) error of the 3D surfaces obtained using the proposed system were up to 50% less than those created by traditional diffuse lighting.

show abstract

“…At the same time, this algorithm can also be applied to face recognition, which can improve the accuracy of face recognition to a large extent; the disadvantage is that the accuracy and authenticity of the reconstructed 3D model need to be improved. 25,26 A complete stereo vision system based on 2D image can be divided into image processing, camera calibration, stereo matching, 3D point reconstruction, and model reconstruction. The purpose of image processing is to eliminate the influence of various adverse factors on the image acquired by the camera, so as to obtain the image that can reflect the original scene most truly and to prepare for the subsequent feature extraction and matching work.…”

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Three-dimensional mechanical parts reconstruction technology based on two-dimensional image

Huo

2020

International Journal of Advanced Robotic Systems

View full text Add to dashboard Cite

With the development of computer technology and three-dimensional reconstruction technology, three-dimensional reconstruction based on visual images has become one of the research hotspots in computer graphics. Three-dimensional reconstruction based on visual image can be divided into three-dimensional reconstruction based on single photo and video. As an indirect three-dimensional modeling technology, this method is widely used in the fields of film and television production, cultural relics restoration, mechanical manufacturing, and medical health. This article studies and designs a stereo vision system based on two-dimensional image modeling technology. The system can be divided into image processing, camera calibration, stereo matching, three-dimensional point reconstruction, and model reconstruction.In the part of image processing, common image processing methods, feature point extraction algorithm, and edge extraction algorithm are studied. On this basis, interactive local corner extraction algorithm and interactive local edge detection algorithm are proposed. It is found that the Harris algorithm can effectively remove the features of less information and easy to generate clustering phenomenon. At the same time, the method of limit constraints is used to match the feature points extracted from the image. This method has high matching accuracy and short time. The experimental research has achieved good matching results. Using the platform of binocular stereo vision system, each step in the process of three-dimensional reconstruction has achieved high accuracy, thus achieving the three-dimensional reconstruction of the target object. Finally, based on the research of three-dimensional reconstruction of mechanical parts and the designed binocular stereo vision system platform, the experimental results of edge detection, camera calibration, stereo matching, and three-dimensional model reconstruction in the process of three-dimensional reconstruction are obtained, and the full text is summarized, analyzed, and prospected.

show abstract

Three-dimensional reconstruction based on multi-view photometric stereo fusion technology in movies special-effect

Cited by 9 publications

References 13 publications

Investigating 3d Reconstruction of Non-Collaborative Surfaces Through Photogrammetry and Photometric Stereo

Investigating 3d Reconstruction of Non-Collaborative Surfaces Through Photogrammetry and Photometric Stereo

Exploiting Light Directionality for Image‐Based 3D Reconstruction of Non‐Collaborative Surfaces

Three-dimensional mechanical parts reconstruction technology based on two-dimensional image

Contact Info

Product

Resources

About