Depicting procedural caustics in single images

Gutiérrez, Diego; Serón, Francisco J.; López‐Moreno, Jorge; Sánchez, María Teresa Lavado; Fandos, Jorge; Reinhard, Erik

doi:10.1145/1409060.1409073

Cited by 19 publications

(6 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Estimating shape : Estimating shape from a single image of an opaque object is an under‐constrained problem by itself. Previous works, however, have shown how rough approximations can work well in the context of material editing [KRFB06] or the simulation of caustics [GSLM*08]. We note that this estimation is even harder if the object is translucent, given the softening effects of subsurface scattering; we aim to find a similar approximation that works well for our purposes.…”

Section: Estimation From Uncontrolled Single Imagesmentioning

confidence: 93%

BSSRDF Estimation from Single Images

Muñoz

Echevarria

Serón

et al. 2011

Computer Graphics Forum

Self Cite

View full text Add to dashboard Cite

We present a novel method to estimate an approximation of the reflectance characteristics of optically thick, homogeneous translucent materials using only a single photograph as input. First, we approximate the diffusion profile as a linear combination of piecewise constant functions, an approach that enables a linear system minimization and maximizes robustness in the presence of suboptimal input data inferred from the image. We then fit to a smoother monotonically decreasing model, ensuring continuity on its first derivative. We show the feasibility of our approach and validate it in controlled environments, comparing well against physical measurements from previous works. Next, we explore the performance of our method in uncontrolled scenarios, where neither lighting nor geometry are known. We show that these can be roughly approximated from the corresponding image by making two simple assumptions: that the object is lit by a distant light source and that it is globally convex, allowing us to capture the visual appearance of the photographed material. Compared with previous works, our technique offers an attractive balance between visual accuracy and ease of use, allowing its use in a wide range of scenarios including off‐the‐shelf, single images, thus extending the current repertoire of real‐world data acquisition techniques.

show abstract

Section: Estimation From Uncontrolled Single Imagesmentioning

confidence: 93%

BSSRDF Estimation from Single Images

Muñoz

Echevarria

Serón

et al. 2011

Computer Graphics Forum

Self Cite

View full text Add to dashboard Cite

show abstract

“…[KRFB06] exploits the fact that human vision is tolerant to many physical inaccuracies to propose a material editing framework requiring a single HDR image as input. Such approach was later extended to include global illumination [GSLM*08] or weathering effects [XWT*08]. Other methods are based on frequency‐domain analyses [BBPA15], visual goals [NSRS13], or use a light field as input [BSM*18, JMB*14].…”

Section: Related Workmentioning

confidence: 99%

A Generative Framework for Image‐based Editing of Material Appearance using Perceptual Attributes

Delanoy

Lagunas

Condor

et al. 2022

Computer Graphics Forum

View full text Add to dashboard Cite

Single‐image appearance editing is a challenging task, traditionally requiring the estimation of additional scene properties such as geometry or illumination. Moreover, the exact interaction of light, shape and material reflectance that elicits a given perceptual impression is still not well understood. We present an image‐based editing method that allows to modify the material appearance of an object by increasing or decreasing high‐level perceptual attributes, using a single image as input. Our framework relies on a two‐step generative network, where the first step drives the change in appearance and the second produces an image with high‐frequency details. For training, we augment an existing material appearance dataset with perceptual judgements of high‐level attributes, collected through crowd‐sourced experiments, and build upon training strategies that circumvent the cumbersome need for original‐edited image pairs. We demonstrate the editing capabilities of our framework on a variety of inputs, both synthetic and real, using two common perceptual attributes (Glossy and Metallic), and validate the perception of appearance in our edited images through a user study.

show abstract

“…In recent years, solutions to influence physics for the purpose of expressiveness have received increasing attention and there are several approaches to stylize natural phenomena. Modifications of the light transport [8], [9], [10], shadows [11], [12], [13], [14], caustics [15], motion blur [16], or depth of field [17], have been proposed to significantly influence the appearance of a scene and to guide the observer to specific regions of interest. Similarly, other stylization techniques have been demonstrated for focus control [18].…”

Section: General Stylizationmentioning

confidence: 99%

Expressive Single Scattering for Light Shaft Stylization

Kol

Klehm

Seidel

et al. 2017

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Light scattering in participating media is a natural phenomenon that is increasingly featured in movies and games, as it is visually pleasing and lends realism to a scene. In art, it may further be used to express a certain mood or emphasize objects. Here, artists often rely on stylization when creating scattering effects, not only because of the complexity of physically correct scattering, but also to increase expressiveness. Little research, however, focuses on artistically influencing the simulation of the scattering process in a virtual 3D scene. We propose novel stylization techniques, enabling artists to change the appearance of single scattering effects such as light shafts. Users can add, remove, or enhance light shafts using occluder manipulation. The colors of the light shafts can be stylized and animated using easily modifiable transfer functions. Alternatively, our system can optimize a light map given a simple user input for a number of desired views in the 3D world. Finally, we enable artists to control the heterogeneity of the underlying medium. Our stylized scattering solution is easy to use and compatible with standard rendering pipelines. It works for animated scenes and can be executed in real time to provide the artist with quick feedback.

show abstract

Depicting procedural caustics in single images

Cited by 19 publications

References 24 publications

BSSRDF Estimation from Single Images

BSSRDF Estimation from Single Images

A Generative Framework for Image‐based Editing of Material Appearance using Perceptual Attributes

Expressive Single Scattering for Light Shaft Stylization

Contact Info

Product

Resources

About