Snapshot compressive spectral - depth imaging based on light field

Ding, Xiaoming; Yan, Qiangqiang; Hu, Liang; Zhou, S. Kevin; Wei, Ruyi; Wang, Xiaocheng; Li, Yupeng

doi:10.1186/s13634-022-00834-x

Cited by 8 publications

(6 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the field of intelligent driving, Ding et al [94] combined a light field camera with a spectral think and applied it to distance measurement for unmanned vehicles, and the refocused object distances were in general agreement with the actual distances, with an estimated error between 1.5% and 2.7%. The good dynamic performance has also led to the good application of light field cameras in flow diagnostics [95], and the development and application of light field cameras in fluid measurement were described in great detail by S. Shi [22].…”

Section: Measurement Application Of Light Field Cameramentioning

confidence: 91%

“…Combining the monocular depth measurement capability of the light field camera, Shademan et al [ 13 ] applied it to surgical robot positioning and improved the accuracy from 0.5 mm to 0.18 mm compared to the previous use of a 2D camera for planar suturing tasks. In the field of intelligent driving, Ding et al [ 94 ] combined a light field camera with a spectral think and applied it to distance measurement for unmanned vehicles, and the refocused object distances were in general agreement with the actual distances, with an estimated error between 1.5% and 2.7%. The good dynamic performance has also led to the good application of light field cameras in flow diagnostics [ 95 ], and the development and application of light field cameras in fluid measurement were described in great detail by S. Shi [ 22 ].…”

Section: Measurement Application Of Light Field Cameramentioning

confidence: 94%

See 1 more Smart Citation

Measurement Technologies of Light Field Camera: An Overview

Hu,

Li,

Miao

et al. 2023

Sensors

View full text Add to dashboard Cite

Visual measurement methods are extensively used in various fields, such as aerospace, biomedicine, agricultural production, and social life, owing to their advantages of high speed, high accuracy, and non-contact. However, traditional camera-based measurement systems, relying on the pinhole imaging model, face challenges in achieving three-dimensional measurements using a single camera by one shot. Moreover, traditional visual systems struggle to meet the requirements of high precision, efficiency, and compact size simultaneously. With the development of light field theory, the light field camera has garnered significant attention as a novel measurement method. Due to its special structure, the light field camera enables high-precision three-dimensional measurements with a single camera through only one shot. This paper presents a comprehensive overview of light field camera measurement technologies, including the imaging principles, calibration methods, reconstruction algorithms, and measurement applications. Additionally, we explored future research directions and the potential application prospects of the light field camera.

show abstract

Section: Measurement Application Of Light Field Cameramentioning

confidence: 91%

Section: Measurement Application Of Light Field Cameramentioning

confidence: 94%

Measurement Technologies of Light Field Camera: An Overview

Hu,

Li,

Miao

et al. 2023

Sensors

View full text Add to dashboard Cite

show abstract

“…There are two categories to measure the depth information of targets. One is the active imaging strategy including structured light and Time-of-Flight (ToF) approaches, and the other is the passive imaging strategy including binocular vision and light field approaches [11,12]. To measure the spectral characteristics of each spatial point in real time, the snapshot spectral imaging techniques emerges in recent years including direct measurement strategy and computational imaging strategy.…”

Section: Introductionmentioning

confidence: 99%

Snapshot depth–spectral imaging based on image mapping and light field

Ding

Zhou

et al. 2023

EURASIP J. Adv. Signal Process.

Self Cite

View full text Add to dashboard Cite

Depth–spectral imaging (DSI) is an emerging technology which can obtain and reconstruct the spatial, spectral and depth information of a scene simultaneously. Conventionally, DSI system usually relies on scanning process, multi-sensors or compressed sensing framework to modulate and acquire the entire information. This paper proposes a novel snapshot DSI architecture based on image mapping and light field framework by using a single format detector. Specifically, we acquire the depth – spectral information in two steps. Firstly, an image mapper is utilized to slice and reflect the first image to different directions which is a spatial modulation processing. The modulated light wave is then dispersed by a direct vision prism. After re-collection, the sliced dispersed light wave is recorded by a light field sensor. Complimentary, we also propose a reconstruction strategy to recover the spatial depth – spectral hypercube effectively. We establish a mathematical model to describe the light wave distribution on every optical facet. Through simulations, we generate the aliasing raw spectral light field data. Under the reconstruction strategy, we design an algorithm to recover the hypercube accurately. Also, we make an analysis about the spatial and spectral resolution of the reconstructed data, the evaluation results conform the expectation.

show abstract

“…There are two categories to measure the depth information of targets. One is the active imaging strategy including structured light and Time -of -Flight (ToF) approaches, and the other is the passive imaging strategy including binocular vision and light field approaches [10,11]. To measure the spectral characteristics of each spatial point in real time, the snapshot spectral imaging techniques emerges in recent years including direct measurement strategy and computational imaging strategy.…”

Section: Introductionmentioning

confidence: 99%

Snapshot depth - spectral imaging based on image mapping and light field

Ding

Zhou

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

In recent years, the snapshot multi - dimensional imaging technology is emerging and becomes an increasing research focus. Especially, the spatial, spectral and depth information of scenes is particularly useful in target detection, recognition, tracking, scene classification et al. This paper proposes a snapshot depth - spectral imaging architecture based on image mapping and light field to realize the capture of depth - spectral information in a single snapshot. Specifically, we modulate the depth - spectral information of targets onto a two - dimensional sensor in three steps. Firstly, an image mapper is utilized to slice and reflect the first image to different directions and make void space between two adjacent strip images. This is a spatial modulation processing. Then, a direct vision prism is used to disperse the mapped and collimated light. Finally, the light field sensor with a micro - lens array captures the dispersed light field. Complimentary, we also proposed the reconstruction method under the remapping and digital refocus framework. Through simulations, we demonstrate that the proposed snapshot depth – spectral imaging system is effective to measure the depth - spectral information of scenes in a single snapshot time.

show abstract

Snapshot compressive spectral - depth imaging based on light field

Cited by 8 publications

References 33 publications

Measurement Technologies of Light Field Camera: An Overview

Measurement Technologies of Light Field Camera: An Overview

Snapshot depth–spectral imaging based on image mapping and light field

Snapshot depth - spectral imaging based on image mapping and light field

Contact Info

Product

Resources

About