Multi-Layer Depth of Field Rendering with Tiled Splatting

Franke, Linus; Hofmann, Nikolai; Stamminger, Marc; Selgrad, Kai

doi:10.1145/3203200

Cited by 11 publications

(13 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Catmull (1984) solves for per-pixel visibility by performing depth sorting on overlapping polygons for each pixel. Following this, approaches based on multi-layer images like Franke et al (2018), Kraus and Strengert (2007), Lee et al (2008), Lee et al (2009) and Selgrad et al (2015) have also been introduced where the contributions from each layer are accumulated to produce the final image. Such layered approaches are computationally expensive although they can generate relatively accurate results in terms of semitransparencies.…”

Section: Dofmentioning

confidence: 99%

A Hybrid System for Real-time Rendering of Depth of Field Effect in Games

Tan,

Chua,

Biette

et al. 2022

Preprint

View full text Add to dashboard Cite

Real-time depth of field in game cinematics tends to approximate the semi-transparent silhouettes of out-offocus objects through post-processing techniques. We leverage ray tracing hardware acceleration and spatiotemporal reconstruction to improve the realism of such semi-transparent regions through hybrid rendering, while maintaining interactive frame rates for immersive gaming. This paper extends our previous work with a complete presentation of our technique and details on its design, implementation, and future work. Background InformationCurrent DoF implementations in game engines typically use the thin lens model (Potmesil and Chakravarty, 1982) to approximate the behaviour of cameras. The zone of focus is the part of the scene a https://orcid.

show abstract

Section: Dofmentioning

confidence: 99%

A Hybrid System for Real-time Rendering of Depth of Field Effect in Games

Tan,

Chua,

Biette

et al. 2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Runtime. The rendering stage relies on a tiled kernel splatting approach, based on the algorithm of Franke et al [FHSS18]. The , (c) we take a coarse set of parameters (comprised of depth, aperture diameter, focus, and light wavelength) and compute the PSFs for each unique combination using the estimated eye model.…”

Section: Pre-computationmentioning

confidence: 99%

“…Figure 9 provides an overview of our extended rendering algorithm. This section outlines the details of our main contributions involving vision simulation; the reader should consult the original work of Franke et al [FHSS18] for a more elaborate explanation of tiled splatting.…”

Section: Runtime: Kernel Splattingmentioning

confidence: 99%

Efficient Rendering of Ocular Wavefront Aberrations using Tiled Point‐Spread Function Splatting

Csoba

Kunkli

2021

Computer Graphics Forum

View full text Add to dashboard Cite

Visual aberrations are the imperfections in human vision, which play an important role in our everyday lives. Existing algorithms to simulate such conditions are either not suited for low-latency workloads or limit the kinds of supported aberrations. In this paper, we present a new simulation method that supports arbitrary visual aberrations and runs at interactive, near real-time performance on commodity hardware. Furthermore, our method only requires a single set of on-axis phase aberration coefficients as input and handles the dynamic change of pupil size and focus distance at runtime. We first describe a custom parametric eye model and parameter estimation method to find the physical properties of the simulated eye. Next, we talk about our parameter sampling strategy which we use with the estimated eye model to establish a coarse point-spread function (PSF) grid. We also propose a GPU-based interpolation scheme for the kernel grid which we use at runtime to obtain the final vision simulation by extending an existing tile-based convolution approach. We showcase the capabilities of our eye estimation and rendering processes using several different eye conditions and provide the corresponding performance metrics to demonstrate the applicability of our method for interactive environments.

show abstract

“…MFR has been deployed in a wide spectrum of rendering applications in order to generate compelling graphics effects at interactive frame rates. Top left to bottom right: order‐independent‐transparency [MBG16], shadow mapping [SDMS15], hair rendering [JCLR19] (https://github.com/CaffeineViking/vkhr), global illumination [VVP16b], trimming and CSG operations [RFV13], depth of field [FHSS18], hybrid visualisation [LFS∗15], and collision detection [ROW14]. …”

Section: Applicationsmentioning

confidence: 99%

“…Selgrad et al [SRP∗15] applied a similar multilayer filtering data structure that is used in the generation of soft shadows [SDMS15] to simulate depth‐of‐field effects at real‐time framerates, without any variance artefacts that may appear in ray tracing approaches. Recently, Franke et al [FHSS18] combined the observations of Lee at al. [LES10] with the minimum separation metric of Mara and McGuire [MMNL16] to generate a partial multilayer data structure of surfaces affected only by the circle of confusion.…”

Section: Applicationsmentioning

confidence: 99%

A Survey of Multifragment Rendering

Vasilakis

Vardis

Παπαϊωάννου

2020

Computer Graphics Forum

View full text Add to dashboard Cite

In the past few years, advances in graphics hardware have fuelled an explosion of research and development in the field of interactive and real‐time rendering in screen space. Following this trend, a rapidly increasing number of applications rely on multifragment rendering solutions to develop visually convincing graphics applications with dynamic content. The main advantage of these approaches is that they encompass additional rasterised geometry, by retaining more information from the fragment sampling domain, thus augmenting the visibility determination stage. With this survey, we provide an overview of and insight into the extensive, yet active research and respective literature on multifragment rendering. We formally present the multifragment rendering pipeline, clearly identifying the construction strategies, the core image operation categories and their mapping to the respective applications. We describe features and trade‐offs for each class of techniques, pointing out GPU optimisations and limitations and provide practical recommendations for choosing an appropriate method for each application. Finally, we offer fruitful context for discussion by outlining some existing problems and challenges as well as by presenting opportunities for impactful future research directions.

show abstract

Multi-Layer Depth of Field Rendering with Tiled Splatting

Cited by 11 publications

References 18 publications

A Hybrid System for Real-time Rendering of Depth of Field Effect in Games

A Hybrid System for Real-time Rendering of Depth of Field Effect in Games

Efficient Rendering of Ocular Wavefront Aberrations using Tiled Point‐Spread Function Splatting

A Survey of Multifragment Rendering

Contact Info

Product

Resources

About