Gaze-Contingent Spatio-temporal Filtering in a Head-Mounted Display

Dörr, Michael; Böhme, Martin; Martinetz, Thomas; Barth, Erhardt

doi:10.1007/11768029_24

Cited by 3 publications

(2 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…3.2). Early works in gaze‐contingent rendering primarily observed the general detectability and influence of the quality degradation on visual performance [PP99, PLN01, NNB*04, DBMB06]. However, those approaches have not boosted rendering performance.…”

Section: Measurement‐based Perceptual Approachesmentioning

confidence: 99%

Perception-driven Accelerated Rendering

Weier

Stengel

Roth

et al. 2017

Computer Graphics Forum

View full text Add to dashboard Cite

Advances in computer graphics enable us to create digital images of astonishing complexity and realism. However, processing resources are still a limiting factor. Hence, many costly but desirable aspects of realism are often not accounted for, including global illumination, accurate depth of field and motion blur, spectral effects, etc. especially in real-time rendering. At the same time, there is a strong trend towards more pixels per display due to larger displays, higher pixel densities or larger fields of view. Further observable trends in current display technology include more bits per pixel (high dynamic range, wider color gamut/fidelity), increasing refresh rates (better motion depiction), and an increasing number of displayed views per pixel (stereo, multi-view, all the way to holographic or lightfield displays). These developments cause significant unsolved technical challenges due to aspects such as limited compute power and bandwidth. Fortunately, the human visual system has certain limitations, which mean that providing the highest possible visual quality is not always necessary. In this report, we present the key research and models that exploit the limitations of perception to tackle visual quality and workload alike. Moreover, we present the open problems and promising future research targeting the question of how we can minimize the effort to compute and display only the necessary pixels while still offering a user full visual experience.

show abstract

Section: Measurement‐based Perceptual Approachesmentioning

confidence: 99%

Perception-driven Accelerated Rendering

Weier

Stengel

Roth

et al. 2017

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…During the workshop we will demonstrate the eye-tracking and display technology that we currently use and continue to develop [1,2]. In the remainder of this paper we report on a few results that address selected problems of gaze guidance.…”

Section: Introductionmentioning

confidence: 99%

Guiding Eye Movements for Better Communication and Augmented Vision

Barth

Dörr

Böhme

et al. 2006

Perception and Interactive Technologies

Self Cite

View full text Add to dashboard Cite

Abstract. This paper briefly summarises our results on gaze guidance such as to complement the demonstrations that we plan to present at the workshop. Our goal is to integrate gaze into visual communication systems by measuring and guiding eye movements. Our strategy is to predict a set of about ten salient locations and then change the probability for one of these candidates to be attended: for one candidate the probability is increased, for the others it is decreased. To increase saliency, in our current implementation, we show a natural-scene movie and overlay red dots very briefly such that they are hardly perceived consciously. To decrease the probability, for example, we locally reduce the temporal frequency content of the movie. We here present preliminary results, which show that the three steps of our above strategy are feasible. The long-term goal is to find the optimal real-time video transformation that minimises the difference between the actual and the desired eye movements without being obtrusive. Applications are in the area of vision-based communication, augmented vision, and learning.

show abstract