Optimal presentation of imagery with focus cues on multi-plane displays

Abstract

Reproducing a real-world scene on a multi-plane display. Given a focus stack consisting of images of a scene focused at different distances, we use optimization to determine images to show on the presentation planes of the multi-plane display so that the image seen through the display when focusing at different distances matches the corresponding image of the input scene. The presentation planes combine additively in the viewer's eye to produce an image with realistic focus cues. AbstractWe present a technique for displaying three-dimensional imagery of general scenes with nearly correct focus cues on multi-plane displays. These displays present an additive combination of images at a discrete set of optical distances, allowing the viewer to focus at different distances in the simulated scene. Our proposed technique extends the capabilities of multi-plane displays to general scenes with occlusions and non-Lambertian effects by using a model of defocus in the eye of the viewer. Requiring no explicit knowledge of the scene geometry, our technique uses an optimization algorithm to compute the images to be displayed on the presentation planes so that the retinal images when accommodating to different distances match the corresponding retinal images of the input scene as closely as possible. We demonstrate the utility of the technique using imagery acquired from both synthetic and real-world scenes, and analyze the system's characteristics including bounds on achievable resolution.

10‐1: Towards Varifocal Augmented Reality Displays using Deformable Beamsplitter Membranes

“…Early on, Akeley et al [11] demonstrate the benefits of fixed-viewpoint volumetric desktop displays using multiple display planes and generate near-correct focus cues without tracking eye position. Recently such displays were revisited with improved scene decomposition, and gaze-contingent varifocal multi plane capabilities [12], [13]. However, these displays have large power and computational demands with a complex hardware that doesn't lead to a wearable form factor.…”

79‐1: Invited Paper: Accommodative AR HMD Using Birefringent Crystal

“…Therefore, the compressive light filed algorithm is adopted to proposed systems. Both of the proposed systems use the additive type compressive light field algorithm to interpolate the information of the two layers formed in space, and it has already been studied that accommodation of the mid-range between two layers is induced [11][12][13]. Therefore, both systems float two images with 0.3 diopter distance difference and it is generally known that mid-range depth can be expressed when two multilayer displays have a distance of about 0.3 diopter.…”

EyeAR: Refocusable Augmented Reality Content through Eye Measurements

“…A common approach to present depth cues is by displaying virtual content on multiple transparent planes [18][19][20]. Although MacKenzie et al [21] showed that five focal planes are enough to produce an acceptable range of real-time accommodative cues, multiple focal planes lead to a bulkier HMD design.…”