Photometric stereo with only two images: A theoretical study and numerical resolution

Quau, Yvain; Mecca, Roberto; Durou, Jean‐Denis; Descombes, Xavier

doi:10.1016/j.imavis.2016.11.006

Cited by 17 publications

(19 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Many PS methods assume that a light arrives from a distant source, which forms parallel light rays. This leads to the same incident light direction and radiance for each scene point [QMDD17]. This assumption degenerates, if the distance to the light source is not much larger than the scene dimensions.…”

Section: Related Workmentioning

confidence: 99%

Normal‐Based Bas‐Relief Modelling via Near‐Lighting Photometric Stereo

Wei

Song

Nie

et al. 2019

Computer Graphics Forum

View full text Add to dashboard Cite

We present a near‐lighting photometric stereo (NL‐PS) system to produce digital bas‐reliefs from a physical object (set) directly. Unlike both the 2D image and 3D model‐based modelling methods that require complicated interactions and transformations, the technique using NL‐PS is easy to use with cost‐effective hardware, providing users with a trade‐off between abstract and representation when creating bas‐reliefs. Our algorithm consists of two steps: normal map acquisition and constrained 3D reconstruction. First, we introduce a lighting model, named the quasi‐point lighting model (QPLM), and provide a two‐step calibration solution in our NL‐PS system to generate a dense normal map. Second, we filter the normal map into a detail layer and a structure layer, and formulate detail‐ or structure‐preserving bas‐relief modelling as a constrained surface reconstruction problem of solving a sparse linear system. The main contribution is a WYSIWYG (i.e. what you see is what you get) way of building new solvers that produces multi‐style bas‐reliefs with their geometric structures and/or details preserved. The performance of our approach is experimentally validated via comparisons with the state‐of‐the‐art methods.

show abstract

Section: Related Workmentioning

confidence: 99%

Normal‐Based Bas‐Relief Modelling via Near‐Lighting Photometric Stereo

Wei

Song

Nie

et al. 2019

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…The intensity ratio (21) provides one equation per pixel relating unpolarised intensities, surface gradient and light source directions. Given two polarisation images with different light directions, we have one such equation per pixel and six unknowns in total.…”

Section: Two Source Lighting Estimationmentioning

confidence: 99%

“…Given two polarisation images with different light directions, we have one such equation per pixel and six unknowns in total. We assume that ambiguous surface gradient estimates are known from ρ and φ, and then use (21) to estimate the light source directions.…”

Section: Two Source Lighting Estimationmentioning

confidence: 99%

“…Photometric stereo with three or more light sources is a very well studied problem with robust solutions available under a range of different assumptions. Two source photometric stereo is still considered a difficult problem [21] even when the illumination is calibrated and albedo is known. We show that various formulations of one and two source photo-polarimetric stereo lead to the same general problem (in terms of surface height), that illumination can be estimated and that certain combinations of constraints lead to an albedo invariant formulation.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Linear Differential Constraints for Photo-Polarimetric Height Estimation

Tozza

Smith

Zhu

et al. 2017

2017 IEEE International Conference on Computer Vision (ICCV)

View full text Add to dashboard Cite

show abstract

“…The original PS assumes Lambertian surface, thus not dealing with shiny materials, and estimates the normal using the so-called "Bidirectional Reflectance Distribution Function" [5] with known light-source parameters. However, several modifications, see [6], [7], have been proposed since then, making it more accurate and applicable to various materials.…”

Section: Introductionmentioning

confidence: 99%

Optimal Multi-View Surface Normal Estimation Using Affine Correspondences

Baráth

Eichhardt

Hajder

2019

IEEE Trans. on Image Process.

View full text Add to dashboard Cite

An optimal, in the least squares sense, method is proposed to estimate surface normals in both stereo and multi-view cases. The proposed algorithm exploits exclusively photometric information via affine correspondences and estimates the normal for each correspondence independently. The normal is obtained as a root of a quartic polynomial. Therefore, the processing time is negligible. Eliminating the outliers, we propose a robust extension of the algorithm that combines maximum likelihood estimation and iteratively re-weighted least squares. The method has been validated on both synthetic and publicly available real-world datasets. It is superior to the state of the art in terms of accuracy and processing time. Besides, we demonstrate two possible applications: 1) using our algorithm as the seed-point generation step of patch-based multi-view stereo method, the obtained reconstruction is more accurate, and the error of the 3D points is reduced by 30% on average and 2) multiplane fitting becomes more accurate applied to the resulting oriented point cloud.

show abstract

Photometric stereo with only two images: A theoretical study and numerical resolution

Cited by 17 publications

References 44 publications

Normal‐Based Bas‐Relief Modelling via Near‐Lighting Photometric Stereo

Normal‐Based Bas‐Relief Modelling via Near‐Lighting Photometric Stereo

Linear Differential Constraints for Photo-Polarimetric Height Estimation

Optimal Multi-View Surface Normal Estimation Using Affine Correspondences

Contact Info

Product

Resources

About