Light field resampling method for elemental image array generation of integral imaging

“…Wang et al [13] analyzed mismatches between acquisition and display systems, performing a pixel remapping on the acquired pictures after they were cut and expanded. Liu et al [14] proposed a light field resampling method for generating EIA to break through the constraints between the record device and display device. Zhang et al [15] proposed an optical method to eliminate the pseudoscopic issue using a transmissive mirror device (TMD) and a light filter to eliminate the ghost images caused by the TMD.…”

Section: Introductionmentioning

confidence: 99%

Performance Enhanced Elemental Array Generation for Integral Image Display Using Pixel Fusion

Huang¹,

Zhan²,

Jiang³

et al. 2021

Front. Phys.

View full text Add to dashboard Cite

Integral imaging is an emerging three-dimensional display technology. However, some inherent issues such as depth inversion has restricted its development. As such, this paper proposes a pixel fusion technique to generate elemental image arrays and overcome pseudoscopic problems occurring in sparse imaging environments. The similarity between the aimed displayed rays and the two adjacent captured rays of an object in a parallel light field was measured by the ratio of the spatial distance of the displayed and captured rays to the interval of the adjacent captured light. Displayed pixel values were acquired for the parallel captured rays. Corresponding pixel position errors were determined in sparse capture conditions and the method was further improved by using the position errors to identify the correct pixel, resulting in higher image quality. The proposed technique does not require manual adjustment of reference planes or other parameters, even at low capturing densities. This provides added convenience and may reduce capturing costs in actual scenes. Experiments using two bricks in virtual scenes under 9 × 9 to 137 × 137 capture cameras were conducted, and the quality of the generated elemental image array was compared with smart pseudoscopic-to-orthoscopic conversion (SPOC). The peak signal-to-noize ratio (PSNR) and structural similarity (SSIM) values showed the effectiveness of the proposed technique. The optical reconstruction results from both real and virtual scenes demonstrated improvements in vision of reconstructed three-dimensional scenes.

show abstract

67‐1: Invited Paper: Elemental Image Array Generation Method Based on the Voxel Space of the InIm‐based LFD

Liu,

Li,

Deng

2024

Symp Digest of Tech Papers

Self Cite

View full text Add to dashboard Cite

In this paper, we propose a method of generating the elemental image array (EIA) for the integral imaging (InIm) based light field display (LFD). Firstly, we reveal the intrinsic voxel spatial distributions of the InIm‐based LFD and analyze how the voxel space affects the display performances such as spatial resolution, depth of field, and smoothness of parallax. Then, we present an algorithm to generate an EIA from a pair of RGB and depth (RGBD) images and an optimally selected voxel space. In the experiments, we tested the display performances of the voxels on different depth planes and obtained results consistent with the theoretical analyses. We also experimented with a computer 3D model and a real‐world scene on two InIm‐based LFD prototypes working in different modes, one in real mode and the other in virtual mode, and obtained favorable 3D display effects. The proposed method simplifies the light field data acquisition and image synthesis process, and supports handling both the virtual and the real‐world 3D scenes. We expect the proposed system to help the practical application of the InIm‐based LFD technology.

show abstract

Light field resampling method for elemental image array generation of integral imaging

Cited by 6 publications

References 18 publications

42‐3: Real‐time Rendering for Integral Imaging Light Field Displays Based on a Voxel‐Pixel Lookup Table

42‐3: Real‐time Rendering for Integral Imaging Light Field Displays Based on a Voxel‐Pixel Lookup Table

Performance Enhanced Elemental Array Generation for Integral Image Display Using Pixel Fusion

67‐1: Invited Paper: Elemental Image Array Generation Method Based on the Voxel Space of the InIm‐based LFD

Contact Info

Product

Resources

About