A Survey of Inverse Rendering Problems

Abstract

Inverse rendering problems usually represent extremely complex and costly processes, but their importance in many research areas is well known. In particular, they are of extreme importance in lighting engineering, where potentially costly mistakes usually make it unfeasible to test design decisions on a model. In this survey we present the main ideas behind these kinds of problems, characterize them, and summarize work developed in the area, revealing problems that remain unsolved and possible areas of further research. ACM CSS: I.3.6 Computer Graphics Methodology and Techniques I.3.7 Computer Graphics—Three‐Dimensional Graphics and Realism I.4.1 Image Processing and Computer Vision Digitization and Image Capture I.4.7 Image Processing and Computer Vision Feature Measurement I.4.8 Image Processing and Computer Vision Scene Analysis

OpenDR: An Approximate Differentiable Renderer

“…In graphics, "inverse rendering" typically refers to recovering the illumination, reflectance, and material properties from an image (e.g. the estimation of BRDFs); see [26] for a review. When we talk about inverting the rendering process we mean something more general, involving the recovery of object shape, camera parameters, motion, and illumination.…”

Looking around the corner using transient imaging

“…[4] proposed a modification of the rendering equation via a transient rendering framework. Accurate measurement of physical scene properties is called inverse-rendering [5]. Complex models have been developed for reconstructing specular [6], transparent [7], Lambertian [8] scenes and joint lighting and reflectance [9].…”

Real-time lens blur effects and focus control

“…Nowadays, intuitive interaction for lighting design is common and a survey can be found in [Patow and Pueyo 2003]. But other areas have been explored, including highlights and shadows [Poulin and Fournier 1992;Pellacini et al 2002], camera placement [Gleicher and Witkin 1992], materials [Pellacini and Lawrence 2007], or indirect illumination [Schoeneman et al 1993].…”