Resolution enhancement by vibrating displays

Berthouzoz, Floraine; Fattal, Raanan

doi:10.1145/2159516.2159521

Cited by 34 publications

(24 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Display PSFs Previous approaches either use box functions for the display's PSFs [Templin et al 2011;Didyk et al 2010a] or model the display's specific PSFs [Berthouzoz and Fattal 2012]. Our method falls into the second approach.…”

Section: Resultsmentioning

confidence: 99%

“…As we discussed in the Introduction, recent works in computer graphics also use the temporal and spatial integration properties of the eye to increase the resolution of displays spatially [Templin et al 2011;Didyk et al 2010a] as well as the temporal resolution of computer-generated videos [Didyk et al 2010b]. Berthouzoz and Fattal [2012] vibrate a display by a very small amplitude to obtain the sub-pixel offsets between several rapidly displayed low-resolution images. The viewer then merges these images into a single perceived image of higher resolution.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Apparent resolution enhancement for motion videos

Berthouzoz

Fattal

2012

Proceedings of the ACM Symposium on Applied Perception

Self Cite

View full text Add to dashboard Cite

In this work we increase the apparent resolution of videos when viewed on a high-refresh rate display by making use of perceptual properties of the visual system. We achieve this enhancement by exploiting the viewer's natural tendency to track moving objects in videos which causes the screen pixels to be projected at different sub-pixel offsets onto the retina. We estimate the eye motion using optical flow and use it to compute multiple low-resolution frames for each input frame. By watching these new frames at a high frame-rate, the viewer's eyes integrate them over time and merges them into a single perceived frame with a denser pixel layout. In this work we also advance the existing approaches for resolution enhancement in the following ways. We combine current display resolution enhancement with super-resolution methods to enhance input videos that are at the display resolution. We derive a new perceived video model that accounts for actual camera sensor and display pixel shapes in order to achieve optimal enhancement. We analyze the degeneracies that certain motion velocities introduce to super-resolution and resolution enhancement, and offer algorithmic solutions for handling these scenarios as well as other difficulties that arise when dealing with the optical flow of natural videos.A user study finds that our approach achieves a noticeable increase in the apparent resolution for videos even when viewed on regular hardware (60Hz), and further enhances resolution when viewed on higher refresh rate displays (120Hz).

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Apparent resolution enhancement for motion videos

Berthouzoz

Fattal

2012

Proceedings of the ACM Symposium on Applied Perception

Self Cite

View full text Add to dashboard Cite

show abstract

“…Similar methods have been applied to achieve super-resolution effects (e.g. [Berthouzoz and Fattal 2012;Sajadi et al 2012]). The methodology behind these methods is often based on non-negative matrix or tensor factorization, and related optimization problems.…”

Section: Related Workmentioning

confidence: 99%

Mix-and-match holography

et al. 2017

View full text Add to dashboard Cite

Fig. 1. Overview of mix-and-match holography. We computationally design pairs of diffractive optical elements that encode multiple holograms or target images under different geometric alignments or DOE pairings (top left: encoding scheme, bottom left: fabricated DOEs). By changing the geometric alignment or pairing different DOEs, the individual encoded holograms can be de-multiplexed. Illumination with a pre-determined lighting condition produces the corresponding target image, that can be generalized in a wide range of scenarios (selected results presented on the right: through offset layer pairing (a), combinational pairing (b), multiview images' encoding (c), and animated images through linear translation (d)). The design process makes use of a combination of iterative phase retrieval methods and complex matrix factorization.Computational caustics and light steering displays offer a wide range of interesting applications, ranging from art works and architectural installations to energy efficient HDR projection. In this work we expand on this concept by encoding several target images into pairs of front and rear phasedistorting surfaces. Different target holograms can be decoded by mixing and matching different front and rear surfaces under specific geometric alignments. Our approach, which we call mix-and-match holography, is made possible by moving from a refractive caustic image formation process to a diffractive, holographic one. This provides the extra bandwidth that is required to multiplex several images into pairing surfaces.We derive a detailed image formation model for the setting of holographic projection displays, as well as a multiplexing method based on a combination of phase retrieval methods and complex matrix factorization. We demonstrate several application scenarios in both simulation and physical prototypes.

show abstract

“…Examples include optical configurations that combine the contribution of multiple overlapping devices [Damera-Venkata and Chang 2009] or single devices with either two stacked liquid crystal displays (LCDs) [Sajadi et al 2012] or one LCD and a double-lens system [Sajadi et al 2013]. Superresolution display with monitors, as opposed to projectors, can be achieved by fast mechanical motion of the screen [Berthouzoz and Fattal 2012] or using two stacked LCDs with a diffuser mounted on top [Heide et al 2014]. In Section 7, we briefly outline that the proposed light field projector in combination with a conventional diffuse screen can achieve superresolution projection.…”

Section: Superlensesmentioning

confidence: 99%

A compressive light field projection system

Hirsch

Wetzstein

Raskar

2014

ACM SIGGRAPH 2014 Emerging Technologies

View full text Add to dashboard Cite

Figure 1: Compressive light field projection for glasses-free 3D display. The system comprises a single light field projector and a completely passive screen. The angular range of the light field emitted from the projector is limited to the size of the projection lens aperture, hence very small. Keplerian telescopes inspire our screen design-the angular range of incident light is expanded for an observer on the other side, creating a field of view that is suitable for glasses-free 3D display. A prototype projector was implemented from scratch using two high-speed spatial light modulators (SLMs); a prototype screen was fabricated from two lenticular sheets with different focal lengths, mounted backto-back. With the implemented system, we achieve high-rank light field synthesis (center) for human observers with a critical flicker fusion threshold that is smaller than the product of the SLM refresh rates and the rank of the synthesized light field. Note that color results above are composited from multiple images captured from our grayscale prototype. AbstractFor about a century, researchers and experimentalists have strived to bring glasses-free 3D experiences to the big screen. Much progress has been made and light field projection systems are now commercially available. Unfortunately, available display systems usually employ dozens of devices making such setups costly, energy inefficient, and bulky. We present a compressive approach to light field synthesis with projection devices. For this purpose, we propose a novel, passive screen design that is inspired by angle-expanding Keplerian telescopes. Combined with high-speed light field projection and nonnegative light field factorization, we demonstrate that compressive light field projection is possible with a single device. We build a prototype light field projector and angle-expanding screen from scratch, evaluate the system in simulation, present a variety of results, and demonstrate that the projector can alternatively achieve super-resolved and high dynamic range 2D image display when used with a conventional screen.

show abstract

Resolution enhancement by vibrating displays

Cited by 34 publications

References 21 publications

Apparent resolution enhancement for motion videos

Apparent resolution enhancement for motion videos

Mix-and-match holography

A compressive light field projection system

Contact Info

Product

Resources

About