3D touchable holographic light-field display

Abstract

We propose a new type of 3D user interface: interaction with a light field reproduced by a 3D display. The 3D display used in this work reproduces a 3D light field, and a real image can be reproduced in midair between the display and the user. When using a finger to touch the real image, the light field from the display will scatter. Then, the 3D touch sensing is realized by detecting the scattered light by a color camera. In the experiment, the light-field display is constructed with a holographic screen and a projector; thus, a preliminary implementation of a 3D touch is demonstrated.

Roadmap on 3D integral imaging: sensing, processing, and display

“…The eye-catching effect is another feature of the spatial display, which will facilitate its application in digital signage and kiosk terminals, where the application to a 3D human-machine interface is vastly promising. The combination of gesture recognition and 3D display enables a more intuitive "3D touch" interface [147,148]. The noncontact 3D interface is furthermore necessary in human interface situations for avoiding contamination.…”

“…Since holographic and integral technologies for spatial displays have different features, their combination facilitates the solution of various application challenges [150][151][152][153][154][155]. An example is the use of a holographic screen for an integral display, and the elemental images are projected, then 3D user interface with thin, transparent screen has been realized [147,148,151]. Another instance of the combination is the use of advanced rendering techniques for computer graphics in the computation of hologram [152][153][154][155].…”

Light Coded Language (LCL): Infrared-Thermography* based 3D Interactive Touch Sensing Display for Handling Medical Emergencies

“…In another approach, a 3D image floating in the air is reproduced by a 3D light field display using a holographic screen, and a 3D touch interface is implemented by detecting the touch to the reproduced real image. Since the holographic screen is transparent in the display, the light scattered by a fingertip is captured by the camera placed on the back of the holographic screen, and thus, the touch is detected [6].…”

Holographic Pepper’s Ghost: Upright Virtual-Image Screen Realized by Holographic Mirror

“…Many applications of HOEs exploit their flexibility in performing optical functions and their see-through characteristics. HOEs have been applied to head-up displays (HUDs) [4], head-mount displays (HMDs) [2,[4][5][6][7][8], bidirectional displays [9], see-through diffusive screens [10] projectiontype three-dimensional (3-D) displays [11][12][13][14], 3-D user interfaces [15], wearable eye-gaze detection systems [16], solar-power generation systems [17], vibration and temperature measurements [18,19], and 3-D telepresence systems [20].…”