HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling

Abstract

real-world scenes. To address these issues, we present Hy-perReel -a novel 6-DoF video representation. The two core components of HyperReel are: (1) a ray-conditioned sample prediction network that enables high-fidelity, high frame rate rendering at high resolutions and (2) a compact and memoryefficient dynamic volume representation. Our 6-DoF video pipeline achieves the best performance compared to prior and contemporary approaches in terms of visual quality with small memory requirements, while also rendering at up to 18 frames-per-second at megapixel resolution without any custom CUDA code.

Ced-NeRF: A Compact and Efficient Method for Dynamic Neural Radiance Fields

“…However, this results in slower rendering times. HyperReel (Attal et al 2023) proposes a flexible sampling network combined with two planes for dynamic scene representation.…”