An integrative view of foveated rendering

Mohanto, Bipul; Islam, Abm Tariqul; Gobbetti, Enrico; Staadt, Oliver

doi:10.1016/j.cag.2021.10.010

Cited by 25 publications

(20 citation statements)

References 122 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Decrease α, the pixel density of points close to the fixation point increases, and the pixel density of points far away from the fixation point decreases. By modifying the two parameters of the kernel function, the pixel point allocation scheme, that is, most suitable for the distribution of human visual cells can be obtained according to various performance requirements (Mohanto et al, 2022). The rendering effect comparison is shown in Figure 7.…”

Section: K(u) σ • U αmentioning

confidence: 99%

Data and model hybrid-driven virtual reality robot operating system

Liu

Lin²,

Lin³

et al. 2022

Front. Energy Res.

View full text Add to dashboard Cite

To realize efficient remote human-computer interaction of robots, a robot remote operating system based on virtual reality and digital twin is proposed. The system builds a digital twin model based on the Unity 3D engine to establish a connection with the robot entity, assisting the online remote programming and real-time manipulation of the robot unit. The system uses HTC VIVE to build a virtual reality framework. To actualize the mutual drive between the real space and the virtual space, a mathematical model of the robot is constructed through the forward and inverse kinematics of the robot. Through the combination of eye-tracking-based eye movement interaction and the unique controller interaction of virtual reality system, a multi-sensory multi-input collaborative interaction method is accomplished. The method realizes the robot joints driving of users using multiple interaction methods simultaneously, simplifies the robot programming and control procedure, and optimizes the operation experience. Tests demonstrate that the system is capable of effectively providing monitoring, teleoperation and programming services for remote interaction of robots.

show abstract

Section: K(u) σ • U αmentioning

confidence: 99%

Data and model hybrid-driven virtual reality robot operating system

Liu

Lin²,

Lin³

et al. 2022

Front. Energy Res.

View full text Add to dashboard Cite

show abstract

“…Our method enhances the output of adaptive-resolution foveated rendering techniques [Mohanto et al 2021] by synthesizing novel image details whose spatial frequencies fall into the range of detectable but not resolvable frequencies by the HVS (Figure 3). We show that these details can be synthesized using carefully controlled procedural noise.…”

Section: Methods Overviewmentioning

confidence: 99%

“…Kaplanyan et al [2019] showed an application of neural networks on foveated image reconstruction with very sparse sampling but with a significant computational overhead similar to other neural reconstruction techniques. For a comprehensive survey of foveated rendering methods, please refer to the work of Mohanto et al [2021].…”

Section: Foveated Renderingmentioning

confidence: 99%

“…Significant computational savings can be achieved when the rendering quality is guided by the estimation of viewers' gaze location provided by an eye-tracking device. So-called foveated rendering techniques [Mohanto et al 2021] reduce the rendering quality according to the decay in the sensitivity of the human visual system (HVS) to image distortions in the periphery. The most common approach is to reduce the shading rate or spatial resolution for image regions distant from the gaze location.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Noise-based Enhancement for Foveated Rendering

Tariq¹,

Tursun²,

Didyk³

2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Further, we have classified several influential research papers along these dimensions. A similar review is also provided in a concurrent work by Mohanto et al [Mohanto et al 2022] with a different taxonomy of foveated rendering methods.…”

Section: Introductionmentioning

confidence: 97%

Foveated Rendering: Motivation, Taxonomy, and Research Directions

Jabbireddy¹,

Sun²,

Meng³

et al. 2022

Preprint

View full text Add to dashboard Cite

With the recent interest in virtual reality and augmented reality, there is a newfound demand for displays that can provide high resolution with a wide field of view (FOV). However, such displays incur significantly higher costs for rendering the larger number of pixels. This poses the challenge of rendering realistic real-time images that have a wide FOV and high resolution using limited computing resources. The human visual system does not need every pixel to be rendered at a uniformly high quality. Foveated rendering methods provide perceptually high-quality images while reducing computational workload and are becoming a crucial component for large-scale rendering. In this paper, we present key motivations, research directions, and challenges for leveraging the limitations of the human visual system as they relate to foveated rendering. We provide a taxonomy to compare and contrast various foveated techniques based on key factors. We also review aliasing artifacts arising due to foveation methods and discuss several approaches that attempt to mitigate such effects. Finally, we present several open problems and possible future research directions that can further reduce computational costs while generating perceptually high-quality renderings.

show abstract

An integrative view of foveated rendering

Cited by 25 publications

References 122 publications

Data and model hybrid-driven virtual reality robot operating system

Data and model hybrid-driven virtual reality robot operating system

Noise-based Enhancement for Foveated Rendering

Foveated Rendering: Motivation, Taxonomy, and Research Directions

Contact Info

Product

Resources

About