Manufacturing Application-Driven Foveated Near-Eye Displays

Akşit, Kaan; Chakravarthula, Praneeth; Rathinavel, Kishore; Jeong, Youngmo; Albert, Rachel; Fuchs, Henry; Luebke, David

doi:10.1109/tvcg.2019.2898781

Cited by 51 publications

(26 citation statements)

References 75 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Such techniques exploit the limited spatial resolution of the eye in the periphery [Guenter et al 2012]. Non-uniform sampling at different eccentricities can be reversed by novel optical design [Akşit et al 2019], or deep-learning methods [Kaplanyan et al 2019]. As the per-frame sample count in such schemes is fixed, and we concentrate on motion perception in the fovea, we consider our work orthogonal to foveated rendering.…”

Section: Perceptual Rendering Methodsmentioning

confidence: 99%

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

et al. 2020

View full text Add to dashboard Cite

Limited GPU performance budgets and transmission bandwidths mean that real-time rendering often has to compromise on the spatial resolution or temporal resolution (refresh rate). A common practice is to keep either the resolution or the refresh rate constant and dynamically control the other variable. But this strategy is non-optimal when the velocity of displayed content varies. To find the best trade-off between the spatial resolution and refresh rate, we propose a perceptual visual model that predicts the quality of motion given an object velocity and predictability of motion. The model considers two motion artifacts to establish an overall quality score: non-smooth (juddery) motion, and blur. Blur is modeled as a combined effect of eye motion, finite refresh rate and display resolution. To fit the free parameters of the proposed visual model, we measured eye movement for predictable and unpredictable motion, and conducted psychophysical experiments to measure the quality of motion from 50 Hz to 165 Hz. We demonstrate the utility of the model with our on-the-fly motion-adaptive rendering algorithm that adjusts the refresh rate of a G-Sync-capable monitor based on a given rendering budget and observed object motion. Our psychophysical validation experiments demonstrate that the proposed algorithm performs better than constant-refresh-rate solutions, showing that motion-adaptive rendering is an attractive technique for driving variable-refresh-rate displays.

show abstract

Section: Perceptual Rendering Methodsmentioning

confidence: 99%

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

et al. 2020

View full text Add to dashboard Cite

show abstract

“…To circumvent this issue, the concept of the foveated display is proposed [9][10][11][12][13] . The idea is based on that the human eye only has high visual acuity in the central fovea region, which accounts for about 10°FoV.…”

Section: Tradeoffs and Potential Solutionsmentioning

confidence: 99%

Augmented reality and virtual reality displays: emerging technologies and future perspectives

et al. 2021

View full text Add to dashboard Cite

With rapid advances in high-speed communication and computation, augmented reality (AR) and virtual reality (VR) are emerging as next-generation display platforms for deeper human-digital interactions. Nonetheless, to simultaneously match the exceptional performance of human vision and keep the near-eye display module compact and lightweight imposes unprecedented challenges on optical engineering. Fortunately, recent progress in holographic optical elements (HOEs) and lithography-enabled devices provide innovative ways to tackle these obstacles in AR and VR that are otherwise difficult with traditional optics. In this review, we begin with introducing the basic structures of AR and VR headsets, and then describing the operation principles of various HOEs and lithography-enabled devices. Their properties are analyzed in detail, including strong selectivity on wavelength and incident angle, and multiplexing ability of volume HOEs, polarization dependency and active switching of liquid crystal HOEs, device fabrication, and properties of micro-LEDs (light-emitting diodes), and large design freedoms of metasurfaces. Afterwards, we discuss how these devices help enhance the AR and VR performance, with detailed description and analysis of some state-of-the-art architectures. Finally, we cast a perspective on potential developments and research directions of these photonic devices for future AR and VR displays.

show abstract

“…Motivated by the different angular resolution of the human visual system in the central vision (around 60 pixels per degree) and the peripheral vision (around 30 pixels per degree) [23], the foveated displays present high-angular-resolution images only within the eye gaze area while maintaining a low angular resolution in the peripheral area, reducing the total system resolution requirement. Several techniques have been reported in 2019 to achieve the foveated image presentation and dynamic change of the foveated area according to the tracked eye gaze direction [13,[24][25][26], which are summarized in Table 2.…”

Section: Fov and Angular Resolutionmentioning

confidence: 99%

Progress of display performances: AR, VR, QLED, and OLED

Jang

Lee

Kim

et al. 2020

Journal of Information Display

View full text Add to dashboard Cite

In 2019, the device performances of the display technologies were largely advanced by the development of new materials and of the device architecture and driving scheme. The recent progress in the areas of virtual reality (VR), augmented reality (AR), quantum dot light-emitting diode (QLED), and organic light-emitting diode (OLED) is comprehensively summarized and discussed in this paper. ARTICLE HISTORY

show abstract

Manufacturing Application-Driven Foveated Near-Eye Displays

Cited by 51 publications

References 75 publications

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

Augmented reality and virtual reality displays: emerging technologies and future perspectives

Progress of display performances: AR, VR, QLED, and OLED

Contact Info

Product

Resources

About