Light Field Rendering for non-Lambertian Objects

Fachada, Sarah; Bonatto, Daniele; Teratani, Mehrdad; Lafruit, Gauthier

doi:10.2352/issn.2470-1173.2021.2.sda-054

Cited by 10 publications

(13 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When such objects, socalled non-Lambertian, are present in the scene, the linear hypothesis in pixel displacement in the function of the camera displacement is not valid anymore. Adapting the DIBR principles to non-Lambertian objects is nevertheless possible by exploiting additional information, such as structure, normal, and indexes of refraction [28], or a more accurate approximation of the pixel displacement [29][30][31] (chosen solution in RVS).…”

Section: Frequent Artifactsmentioning

confidence: 99%

“…Alternatively, to model the non-Lambertian surface in itself, it is possible to track its feature movements on the surface [29,33,34]. DIBR can be generalized to non-Lambertian objects by replacing the usual depth maps with the coefficients of a polynomial approximating the non-Lambertian features displacement [30,31]. To clearly understand what this means, let us start with what happens for diffuse objects, where for a lateral camera movement x, y ðÞ , the new position u, v ðÞ of a pixel u 0 , v 0 ðÞ is given by:…”

Section: Non-lambertian Casementioning

confidence: 99%

See 1 more Smart Citation

View Synthesis Tool for VR Immersive Video

Fachada¹,

Bonatto²,

Teratani³

et al. 2022

Computer Game Development

Self Cite

View full text Add to dashboard Cite

This chapter addresses the view synthesis of natural scenes in virtual reality (VR) using depth image-based rendering (DIBR). This method reaches photorealistic results as it directly warps photos to obtain the output, avoiding the need to photograph every possible viewpoint or to make a 3D reconstruction of a scene followed by a ray-tracing rendering. An overview of the DIBR approach and frequently encountered challenges (disocclusion and ghosting artifacts, multi-view blending, handling of non-Lambertian objects) are described. Such technology finds applications in VR immersive displays and holography. Finally, a comprehensive manual of the Reference View Synthesis software (RVS), an open-source tool tested on open datasets and recognized by the MPEG-I standardization activities (where”I″ refers to”immersive”) is described for hands-on practicing.

show abstract

Section: Frequent Artifactsmentioning

confidence: 99%

Section: Non-lambertian Casementioning

confidence: 99%

View Synthesis Tool for VR Immersive Video

Fachada¹,

Bonatto²,

Teratani³

et al. 2022

Computer Game Development

Self Cite

View full text Add to dashboard Cite

show abstract

“…Since tensor displays describe linear relationships, they are well suited to represent Lambertian objects. However, non-Lambertian materials present a unique challenge since they show non-linear movement in the EPI [20,21].…”

Section: Tensor Display For Non-lambertian Contentmentioning

confidence: 99%

Towards Non-Lambertian Scenes for Tensor Displays

Soetens¹,

Losfeld²,

Bonatto³

et al. 2022

lim

Self Cite

View full text Add to dashboard Cite

Tensor displays are screens able to render a light field with correct depth perception without wearing glasses. Such devices have already been shown to be able to accurately render a scene composed of Lambertian objects. This paper presents the model and prototyping of a tensor display with three layers, using repurposed computer monitors, and extends the light field factorization method to non-Lambertian objects. Furthermore, we examine the relation and limitations between the depth-of-field and the depth range with Lambertian and non-Lambertian scenes. Non-Lambertian scenes contain out-of-range disparities that can not be properly rendered with the usual optimization method. We propose to artificially compress the disparity range of the scene by using two light fields focused on different depths, effectively solving the problem and allowing to render the scene clearly on both simulated and prototyped tensor display.

show abstract

“…Applying the shearlet transform [23] on epipolar plane images (EPI) allows to render scenes with non-Lambertian objects and semi-transparency, by implicitly segmenting them [24], but does not approximate curved feature paths in the 4D light field. Indeed, non-Lambertian features are not constrained to a plane, hence, even locally, they have to be described with more complex models, using the general linear cameras approximation [25], [26], a local linear approximation [27] or global approximation with Bezier curves [28]. Multiplane Images (MPI) rendering approximates the straight lines visible in EPI by segmenting the scene in layered depth [29], [30] and seems to be resistant to artifacts created by non-Lambertian objects present in the scene [6].…”

Section: Related Workmentioning

confidence: 99%

Polynomial Image-Based Rendering for non-Lambertian Objects

Fachada

Bonatto

Teratani

et al. 2021

2021 International Conference on Visual Communications and Image Processing (VCIP)

Self Cite

View full text Add to dashboard Cite

Non-Lambertian objects present an aspect which depends on the viewer's position towards the surrounding scene. Contrary to diffuse objects, their features move non-linearly with the camera, preventing rendering them with existing Depth Image-Based Rendering (DIBR) approaches, or to triangulate their surface with Structure-from-Motion (SfM). In this paper, we propose an extension of the DIBR paradigm to describe these non-linearities, by replacing the depth maps by more complete multi-channel "non-Lambertian maps", without attempting a 3D reconstruction of the scene. We provide a study of the importance of each coefficient of the proposed map, measuring the tradeoff between visual quality and data volume to optimally render non-Lambertian objects. We compare our method to other stateof-the-art image based rendering methods and outperform them with promising subjective and objective results on a challenging dataset.

show abstract

Light Field Rendering for non-Lambertian Objects

Abstract: Fast track article for IS&T International Symposium on Electronic Imaging 2021: Stereoscopic Displays and Applications XXXII proceedings.

Cited by 10 publications

References 29 publications

View Synthesis Tool for VR Immersive Video

View Synthesis Tool for VR Immersive Video

Towards Non-Lambertian Scenes for Tensor Displays

Polynomial Image-Based Rendering for non-Lambertian Objects

Contact Info

Product

Resources

About