Liquid lens based holographic camera for real 3D scene hologram acquisition using end-to-end physical model-driven network

Abstract

With the development of artificial intelligence, neural network provides unique opportunities for holography, such as high fidelity and dynamic calculation. How to obtain real 3D scene and generate high fidelity hologram in real time is an urgent problem. Here, we propose a liquid lens based holographic camera for real 3D scene hologram acquisition using an end-to-end physical model-driven network (EEPMD-Net). As the core component of the liquid camera, the first 10 mm large aperture electrowetting-based liquid lens is proposed by using specially fabricated solution. The design of the liquid camera ensures that the multi-layers of the real 3D scene can be obtained quickly and with great imaging performance. The EEPMD-Net takes the information of real 3D scene as the input, and uses two new structures of encoder and decoder networks to realize low-noise phase generation. By comparing the intensity information between the reconstructed image after depth fusion and the target scene, the composite loss function is constructed for phase optimization, and the high-fidelity training of hologram with true depth of the 3D scene is realized for the first time. The holographic camera achieves the high-fidelity and fast generation of the hologram of the real 3D scene, and the reconstructed experiment proves that the holographic image has the advantage of low noise. The proposed holographic camera is unique and can be used in 3D display, measurement, encryption and other fields.

Dual-view one-dimensional integral imaging display based on compound parallax barrier

“…An integral imaging display presents true three-dimensional (3D) images. [3][4][5][6][7][8][9][10][11] It was used to accomplish a dual-view integral imaging display. 12 Two sets of elemental images are alternately presented on one screen.…”

High-luminance one-dimensional integral imaging display based on gradient-width line light sources

“…Integral imaging provides three-dimensional (3D) images with realistic effects [ [1] , [2] , [3] , [4] , [5] , [6] , [7] , [8] ]. Recently, integral imaging has been used in dual-view fields to display two vivid 3D images [ [9] , [10] , [11] , [12] , [13] , [14] , [15] , [16] ].…”

Deep Learning Infrared Holography with Transformer for Crystal Material Characterization

“…18,19 Additionally, Wang et al proposed a new method for capturing real 3D scenes and generating high-fidelity holograms in real-time. 20,21 Regrettably, at this point in time, characterizing samples within a 3D framework remains a challenging endeavor. 22−24 Dyomin et al have endeavored to explore the distinctive properties of ZnGeP 2 crystals through the utilization of DH; nevertheless, achieving real-time reconstruction still presents a formidable challenge.…”