Efficient Rendering for Light Field Displays using Tailored Projective Mappings

Fink, Laura; Strobel, S.; Franke, Linus; Stamminger, Marc

doi:10.1145/3585498

Cited by 5 publications

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

An event-driven light field, digital coded exposure imager architecture for per-pixel image regeneration in post processing

Mascarenas,

Green,

Silva

et al. 2023

Unconventional Imaging, Sensing, and Adaptive Optics 2023

View full text Add to dashboard Cite

This work presents an imager architecture capable of forming frames with varying exposure time and focus from event-based imager data, in post processing. Conventional photography dictates that once a frame has been captured the information associated with the frame is controlled by the aperture/depth-of-field, the exposure time, and the ISO. The advent of technologies such as integral photography and plenoptic cameras made it possible to change the depth-of-field and plane-of-focus in post-processing. Recently, the concept of the digital coded exposure for event-based imagery was introduced, which allowed the formation of frames from event-data that respected a per-pixel, digitally specified, exposure-vs-time function. The digitally coded exposure allowed the formation of frames with different exposure time characteristics, on a per-pixel basis, in post-processing, from event-based imager data. In this work we present an imager architecture that leverages both plenoptic imager principles, and digital coded exposure principles, to result in an imager that allows regeneration of frames in post processing, in such a way that modification of two sides of the standard exposure triangle is possible. The proposed architecture could potentially also work with alternative imaging modalities such as a photon counting imager.

show abstract

An event-driven light field, digital coded exposure imager architecture for per-pixel image regeneration in post processing

Mascarenas,

Green,

Silva

et al. 2023

Unconventional Imaging, Sensing, and Adaptive Optics 2023

View full text Add to dashboard Cite

show abstract

Light Field Display Point Rendering

Gavane,

Watson

2024

Proc. ACM Comput. Graph. Interact. Tech.

View full text Add to dashboard Cite

Rendering for light field displays (LFDs) requires rendering of dozens or hundreds of views, which must then be combined into a single image on the display, making real-time LFD rendering extremely difficult. We introduce light field display point rendering (LFDPR), which meets these challenges by improving eye-based point rendering [Gavane and Watson 2023] with texture-based splatting, which avoids oversampling of triangles mapped to only a few texels; and with LFD-biased sampling, which adjusts horizontal and vertical triangle sampling to match the sampling of the LFD itself. To improve image quality, we introduce multiview mipmapping, which reduces texture aliasing even though compute shaders do not support hardware mipmapping. We also introduce angular supersampling and reconstruction to combat LFD view aliasing and crosstalk. The resulting LFDPR is 2-8x times faster than multiview rendering, with similar comparable quality.

show abstract

DirectL: Efficient Radiance Fields Rendering for 3D Light Field Displays

Yang,

Liu,

Song

et al. 2024

ACM Trans. Graph.

View full text Add to dashboard Cite

Autostereoscopic display technology, despite decades of development, has not achieved extensive application, primarily due to the daunting challenge of three-dimensional (3D) content creation for non-specialists. The emergence of Radiance Field as an innovative 3D representation has markedly revolutionized the domains of 3D reconstruction and generation, simplifying 3D content creation for common users and broadening the applicability of Light Field Displays (LFDs). However, the combination of these two technologies remains largely unexplored. The standard paradigm to create optimal content for parallax-based light field displays demands rendering at least 45 slightly shifted views preferably at high resolution per frame, a substantial hurdle for real-time rendering. We introduce DirectL, a novel rendering paradigm for Radiance Fields on autostereoscopic displays with lenticular lens. By thoroughly analyzing the interleaved mapping of spatial rays to screen sub-pixels, we accurately render only the light rays entering the human eye and propose subpixel repurposing to significantly reduce the pixel count required for rendering. Tailored for the two predominant radiance fields---Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS), we propose corresponding optimized rendering pipelines that directly render the light field images instead of multi-view images, achieving state-of-the-art rendering speeds on autostereoscopic displays. Extensive experiments across various autostereoscopic displays and user visual perception assessments demonstrate that DirectL accelerates rendering by up to 40 times compared to the standard paradigm without sacrificing visual quality. Its rendering process-only modification allows seamless integration into subsequent radiance field tasks. Finally, we incorporate DirectL into diverse applications, showcasing the stunning visual experiences and the synergy between Light Field Displays and Radiance Fields, which reveals the immense potential for application prospects. DirectL Project Homepage: direct-l.github.io

show abstract

Efficient Rendering for Light Field Displays using Tailored Projective Mappings

Cited by 5 publications

References 17 publications

An event-driven light field, digital coded exposure imager architecture for per-pixel image regeneration in post processing

An event-driven light field, digital coded exposure imager architecture for per-pixel image regeneration in post processing

Light Field Display Point Rendering

DirectL: Efficient Radiance Fields Rendering for 3D Light Field Displays

Contact Info

Product

Resources

About