Foveated Real-Time Path Tracing in Visual-Polar Space

Koskela, Matias; Lotvonen, Atro; Mäkitalo, Markku; Kivi, Petrus E. J.; Viitanen, Timo; Jääskeläinen, Pekka

doi:10.2312/sr.20191219

Cited by 6 publications

(3 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As shading is the most time-consuming operation in the rendering pipeline, certain works [2014; 2014; [n. d.]] vary the shading rate across the visual field, shading only once per several pixels in the peripheral region. Some recent works [Koskela et al 2019b;Meng et al 2018;Tursun et al 2019] also demonstrate varying resolution in a more continuous manner. These methods map the visual field to a non-linear space where a uniform rendering matches the visual acuity of human vision.…”

Section: Visual Factorsmentioning

confidence: 96%

Foveated Rendering: Motivation, Taxonomy, and Research Directions

Jabbireddy¹,

Sun²,

Meng³

et al. 2022

Preprint

View full text Add to dashboard Cite

With the recent interest in virtual reality and augmented reality, there is a newfound demand for displays that can provide high resolution with a wide field of view (FOV). However, such displays incur significantly higher costs for rendering the larger number of pixels. This poses the challenge of rendering realistic real-time images that have a wide FOV and high resolution using limited computing resources. The human visual system does not need every pixel to be rendered at a uniformly high quality. Foveated rendering methods provide perceptually high-quality images while reducing computational workload and are becoming a crucial component for large-scale rendering. In this paper, we present key motivations, research directions, and challenges for leveraging the limitations of the human visual system as they relate to foveated rendering. We provide a taxonomy to compare and contrast various foveated techniques based on key factors. We also review aliasing artifacts arising due to foveation methods and discuss several approaches that attempt to mitigate such effects. Finally, we present several open problems and possible future research directions that can further reduce computational costs while generating perceptually high-quality renderings.

show abstract

Section: Visual Factorsmentioning

confidence: 96%

Foveated Rendering: Motivation, Taxonomy, and Research Directions

Jabbireddy¹,

Sun²,

Meng³

et al. 2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Because path tracing works by tracing the rays back from the pixel to the light source in a limited number of bounces, it needs a certain number of samples per pixel in order to render an image while minimizing noise. Because of real-time constraints, using a high number of samples isn't always available, so there is a need for effective denoising solutions [Koskela et al, 2019].…”

Section: Path Tracingmentioning

confidence: 99%

“…Additionally, other methods such as geometry simplification involve manipulating meshes to render geometry more efficiently at the periphery, while color simplification accounts for the reduced color sensitivity in peripheral vision [Mohanto et al, 2022]. Depending on the render pipeline, path tracing techniques also introduce adaptations, such as reducing samples per pixel at the periphery of the screen [Koskela et al, 2019].…”

Section: Foveated Renderingmentioning

confidence: 99%

Foveated Path Culling: A mixed path tracing and radiance field approach for optimizing rendering in XR Displays

Henriques,

Oliveira,

Oliveira

et al. 2024

JIS

View full text Add to dashboard Cite

Real-time effects achieved by path tracing are essential for creating highly accurate illumination effects in interactive environments. However, due to its computational complexity, it is essential to explore optimization techniques like Foveated Rendering when considering Head Mounted Displays. In this paper we combine traditional Foveated Rendering approaches with recent advancements in the field of radiance fields, extending a previous work and including recent advancements based on Gaussian Splatting. The present paper proposes the usage of mixing real time path tracing at the fovea region of an HMD while replacing the images at the peripheral by pre-computed radiance fields, inferred by neural networks or rendered in real time due to Gaussian splats. We name our approach as Foveated Path Culling (FPC) due to the process of culling raycasts, diminishing the workload by replacing most of the screen raytracing tasks by a less costly approach. FPC allowed us for better frame rates when compared to purely path tracing while rendering scenes in real time, increasing the frame rate speedup proportionally to the display resolution. Our work contributes to the development of rendering techniques for XR experiences that demand low latency, high resolution and high visual quality through global illumination effects.

show abstract