A stereo display prototype with multiple focal distances

Bazyluk

Computer Graphics Forum

2013

To efficiently deploy eye-tracking within 3D graphics applications, we present a new probabilistic method that predicts the patterns of user's eye fixations in animated 3D scenes from noisy eye-tracker data. The proposed method utilises both the eye-tracker data and the known information about the 3D scene to improve the accuracy, robustness and stability. Eye-tracking can thus be used, for example, to induce focal cues via gaze-contingent depth-of-field rendering, add intuitive controls to a video game, and create a highly reliable scene-aware saliency model. The computed probabilities rely on the consistency of the gaze scan-paths to the position and velocity of a moving or stationary target. The temporal characteristic of eye fixations is imposed by a Hidden Markov model, which steers the solution towards the most probable fixation patterns. The derivation of the algorithm is driven by the data from two eye-tracking experiments: the first experiment provides actual eye-tracker readings and the position of the target to be tracked. The second experiment is used to derive a JND-scaled (Just Noticeable Difference) quality metric that quantifies the perceived loss of quality due to the errors of the tracking algorithm. Data from both experiments are used to justify design choices, and to calibrate and validate the tracking algorithms. This novel method outperforms commonly used fixation algorithms and is able to track objects smaller then the nominal error of an eye-tracker.

Section: Focal-cues Inductionmentioning

confidence: 99%

“…However, if we could precisely predict the gaze position, we could not only gain a very effective pointing device, but also enhance display with gaze contingent capabilities. For example, accommodation related focal cues could be simulated to enhance the visual experience [HLCC08] without a need for multi-focal displays [AWGB04].…”

Section: Introductionmentioning

confidence: 99%

Gaze‐driven Object Tracking for Real Time Rendering

Bazyluk

Computer Graphics Forum

2013

IEEE J. Sel. Top. Signal Process.

“…This causes vergence-accommodation rivalry, where the eyes converge on an object but the lens accommodates on the screen level where the image is sharpest [36], [56]. When the cues are consistent the perception of depth on a stereoscopic display becomes significantly faster [62].…”

Section: B Portable Autostereoscopic Displaysmentioning

confidence: 99%

Stereoscopic Depth Cues Outperform Monocular Ones on Autostereoscopic Display

Mikkola

Jumisko-Pyykkö

Strohmeier

et al. 2012

The aim of this study is two-fold; first, to compare how certain visual aids contribute in depth estimation tasks on a portable autostereoscopic display; and second, how these depth cues impact on perceived quality. These were studied on a quantitative subjective study using a portable autostereoscopic display in controlled laboratory environment. Test participants evaluated object depths on three-dimensional images, where either 2D cues, 3D cues, or their combinations were provided. The study was conducted using three different compression levels in order to study how image quality affects the perception of depth. The results indicate that the depth estimation task is faster conducted when the participants relied on stereoscopic depth cues compared to situations where only monocular cues were present. Also, depth estimation task is faster conducted with higher quality images. Depth estimation accuracy was also higher with stereoscopic depth cues than with monocular ones. These results suggest that the human visual system can make more reliable depth estimates on portable autostereoscopic displays when stereoscopic cues are present. However, the results of the quality evaluations indicate that, as stated also on previous studies, the added stereoscopic depth does not seem to increase the subjective image quality.Index Terms-3D experience, autostereoscopic display, depth cues, mobile 3D display, stereoscopic 3D quality.

“…Recently, vari-focal and multi-focal plane stereo displays have been proposed as a remedy to the above-described focus cue problem [47][48][49][50][51][52][53][54][55][56][57] , either by providing dynamic control of the focal distance through an active optical method [47][48][49][50] presenting multiple focal planes at different focal distances [49][50][51][52][53][54][55][56] . Different from volumetric displays [57][58][59] in which all voxels within a volumetric space have to be rendered at a flicker-free rate regardless of the viewer's point-of-interest (PoI), these vari-focal or multi-focal approaches are relatively more computationally efficient, while being able to reduce the discrepancy artifacts to various extents.…”

Section: Emerging Technologies: Vari-focal and Multi-focal Plane Dispmentioning

confidence: 99%

“…For instance, Schowengerdt and Seibel demonstrated a dual-focal plane see-through retinal scanning display (RSD) implemented with a deformable membrane mirror (DMM) device 51 . Akeley et al presented a proof-of-concept display prototype by using a stack of three display planes, which were created by optically splitting an LCD panel into three sub-regions that appear to be placed along the visual axis with an equal spacing of 0.67 diopter53 . More recently, Lee et al demonstrated a depth-fused 3-D (DFD) display prototype by projecting 2-D images onto multiple immaterial FogScreens, with either a stack or an L-shaped configuration55 .…”

mentioning

confidence: 99%

Near-eye displays: state-of-the-art and emerging technologies

et al. 2010

This paper will start with a brief review of the recent advancements in near-eye displays, then focus on the development and results of two emerging technologies aiming to address two critical issues related to near-eye displays: (a) a freeform optical technology promising near-eye displays with an ultimately compact form factor, close to a pair of eyeglasses rather than a traditional helmet style; and (b) a vari-and multi-focal technology promising more accurate rendering of depth cues than conventional stereoscopic displays. INTRODUCTIONInterest in head-mounted display (HMD) technologies has endured and permeated for decades in several scientific domains. HMDs have become critical for many applications, spanning the fields of flight simulation, scientific visualization, medicine, engineering design and prototyping, education and training, tele-manipulation and tele-presence, wearable computing, and entertainment systems. Compared with other 3-D display methods, HMDs provide a good balance of affordability and unique capabilities. For instance, in the domain of augmented reality, see-through HMDs are one of the enabling technologies for merging virtual views with physical scenes, which may enable a physician to see the 3D rendering of the anatomical structures or CT images of a patient superimposed onto the patient's abdomen ( Fig. 1) 1 .The increased bandwidth of wireless networks and rapid expansion of digital information is pressing for a mobile display solution that offers much more attractive image quality and screen size than other popular mobile platforms such as smart phones and PDAs without compromising portability. The advancement of optical technology, improvements on microdisplays, and miniaturization of electronics have been pushing the design envelop of HMD systems to a point that we can envision that in the foreseeable future an HMD may evolve into a device as elegant as a pair of eyeglass and become an integral part of many people's daily activities to retrieve information and connect with people instantly. Given the evolving nature of this technology, we choose to use the term of near-eye displays in this article to cover the broad spectrum of this technology, while also occasionally using the historical term of head-mounted displays when appropriate. A near-eye display refers to a device that is typically attached in close proximity to the eye and requires an optical system to couple a miniature image source with the human visual system.Despite much significant advancement on near-eye displays over the past decades, there exist many technical and usability issues preventing the technology from being widely accepted for many demanding applications and daily usage. Driven by the limitations of existing technologies, this paper will focus on discussing two types of emerging display technologies aiming to address two critical issues related to near-eye displays: (a) a freeform optical technology promising near-eye displays with an ultimately compact form factor close to a pair of eyeglasses rather ...