Real-time sensing and three-dimensional display of far outdoor scenes based on asymmetric integral imaging

Choi, Jae-Gwan; Choi, Hee-Min; Hwang, Yong Seok; Kim, Eun-Soo

doi:10.1016/j.optlaseng.2017.02.013

Cited by 6 publications

(4 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Integral imaging (II) has been researched to implement a realistic three-dimensional (3D) display for a providing full-color 3D images with full-parallax and continuous-viewing points [1][2][3][4][5][6][7][8][9][10]. II has consisted of two procedures of acquisition and reconstruction.…”

Section: Introductionmentioning

confidence: 99%

Fast Numerical Reconstruction of Integral Imaging Based on a Determined Interval Mapping

2023

View full text Add to dashboard Cite

In this paper, a fast numerical reconstruction of the integral imaging based on a determined interval mapping is proposed. To reduce the computation time, the proposed method employs the determined interval mapping instead of the use of magnification. In the numerical reconstruction procedure, the acquired elemental image array (EIA) from the 3D object is displayed. The flipped elemental image (EI)s are numerically formed by the virtual pinhole array. Then, the determined interval depending on the reconstruction plane is calculated and applied to each flipped EI. These flipped EIs are shifted to match the determined interval at the reconstruction plane and superimposed together. After this superimposed image is divided by the number of the superposition, the position error between the location of the shifted EI and the pixel position of the reconstruction plane is corrected by interpolation. As a result, the refocused image depending on the reconstruction plane can be reconstructed rapidly. From the experimental result, we confirmed that the proposed method largely decreased the computation time compared with the conventional method. In addition, we verified that the quality of the reconstruction by the proposed method is higher than the conventional method by the use of the structural similarity index method.

show abstract

Section: Introductionmentioning

confidence: 99%

Fast Numerical Reconstruction of Integral Imaging Based on a Determined Interval Mapping

2023

View full text Add to dashboard Cite

show abstract

“…(ii) Considering elemental images vary smoothly, a sparse virtual camera array can perform a fraction of viewpoints; elemental images with no cameras are interpolated [16][17][18]. The interpolation unavoidably sacrifices accuracy for a faster generation.…”

Section: Introductionmentioning

confidence: 99%

“…Concerning the tradeoff, this study revisits the very original EIA generation method-point retracing rendering (PRR) [22], which retraces from every point on a 3D object, also known as a voxel, to the lens array and then to the EIA. This method was thought inefficient and soon upgraded to viewpoint-based methods [6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21].…”

Section: Introductionmentioning

confidence: 99%

Real-time computer-generated integral imaging light field displays: revisiting the point retracing rendering method from a signal processing point of view

Qin¹,

Cheng²,

Dong³

et al. 2023

Preprint

View full text Add to dashboard Cite

Integral imaging light field displays (InIm-LFDs) can provide realistic 3D images by showing an elemental image array (EIA) under a lens array. However, it is always challenging to computationally generate an EIA in real-time with entry-level computing hardware because the current practice that projects many viewpoints to the EIA induces heavy computations. This study discards the viewpoint-based strategy and revisits the early point retracing rendering method, and then proposes that InIm-LFDs and regular 2D displays share two similar signal processing phases: sampling and reconstructing. An InIm-LFD is demonstrated to create a finite number of static voxels for signal sampling. And each voxel is invariantly formed by homogeneous pixels for signal reconstructing. We obtain the static voxel-pixel mapping through arbitrarily accurate raytracing in advance and store it as a lookup table (LUT). Our EIA rendering method first resamples input 3D data with the pre-defined voxels and then assigns every voxel’s value to its homogeneous pixels through the LUT. As s result, the proposed method reduces the computational complexity by several orders of magnitude. The experimental rendering speed is as fast as 7 ms for a full-HD EIA frame on an entry-level laptop. Finally, considering a voxel may not be perfectly integrated by its homogeneous pixels, called the sampling error, the proposed and conventional viewpoint-based methods are analyzed in the Fourier domain. We prove that even with severe sampling errors, the two methods negligibly differ in the output signal’s frequency spectrum. The proposed method breaks the long-standing tradeoff among rendering speed, accuracy, and system complexity for computer-generated integral imaging (CGII), expected to remove the hinder for real-time CGII.

show abstract

“…Advantages of the floating display is the simple structure, high reality, and precise image position. So, several approaches have been researched to achieve the floating display based on the use of gradient-index lens array, 1 and lens array 2 and other optical elements. 3 Aerial display is the kind of floating display and implemented based on the half mirror and the retro-reflective film.…”

Section: Introductionmentioning

confidence: 99%

Volume-reduced floating display based on a holographic optical element

Choi

Kim

Kang

et al. 2022

Holography, Diffractive Optics, and Applications XII

View full text Add to dashboard Cite

In this paper, we propose a volume-reduced floating display based on a holographic optical element (HOE). The critical problem of a conventional floating display is a huge size, and this drawback limits its practical application. To overcome this drawback, the proposed floating display used the HOE for a reduction of the volume instead of a half mirror. Generally, the HOE can control the diffraction angle of the propagating wavefield. Also, the suitable HOE can be designed depending on the structure or a requirement of the floating display. So, the volume of the proposed floating display can be reduced through the HOE when the HOE is designed to reduce the diffraction angle. In the proposed floating display, the HOE is inclined at a certain angle in front of the retroreflective film. And, the projector and diffuser are set up the bottom of the inclined HOE. Wavefields propagated from the projector are formed as an image on the diffuser and, diffracted by the HOE into the retroreflective film. These diffracted wavefields are reflected by the retroreflective film back toward the direction of the propagating wavefields. As a result, the floated image is formed in the real space. For the optical experiment, we designed a HOE and set up the proposed floating display. Experimental result shows that the image is formed in real space like the conventional floating display. Also, we confirm that the volume of the floating display is reduced by as much as 35.6 % compared with the conventional floating display.

show abstract

Real-time sensing and three-dimensional display of far outdoor scenes based on asymmetric integral imaging

Cited by 6 publications

References 24 publications

Fast Numerical Reconstruction of Integral Imaging Based on a Determined Interval Mapping

Fast Numerical Reconstruction of Integral Imaging Based on a Determined Interval Mapping

Real-time computer-generated integral imaging light field displays: revisiting the point retracing rendering method from a signal processing point of view

Volume-reduced floating display based on a holographic optical element

Contact Info

Product

Resources

About