On the fundamental comparison between unfocused and focused light field cameras

Zhu, Shuaishuai; Lai, Andy; Eaton, Katherine; Jin, Peng; Gao, Liang

doi:10.1364/ao.57.0000a1

Cited by 39 publications

(29 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…By measuring the local variance of coherence, phase-space imaging setups provide a computational method for 3D imaging, especially for partially coherent and incoherent conditions 27,30 . However, even with advanced algorithms 17,25,31 , the reconstructed lateral resolution without sacrificing the depth-of-field (DOF) is still limited to ~1 μm due to the failure of aperture synthesis in partially coherent and incoherent conditions such as fluorescence microscopy 10 . To mitigate the fundamental challenge, multiplexed phase-space measurements with coded aperture techniques have recently been employed 32,33 , but the intensity modulation with a small transmission ratio leads to low light efficiency and loses the robustness and flexibility of segmented apertures.…”

Section: Resultsmentioning

confidence: 99%

“…A few emerging imaging techniques 10 aiming at simultaneous 3D imaging have been developed recently, such as light field microscopy (LFM) 11,12 , multi-focus microscopy 13,14 , etc. Although LFM has achieved great success in high-speed large-scale 3D calcium imaging 12,15,16 with single-cell resolution, its resolution is typically limited to ~1 μm by the intrinsic trade-off between spatial and angular precision 17,18 , which is barely enough for subcellular structures. With holographic gratings, multi-focus images can be detected simultaneously at different areas on a large CCD camera 13,19 .…”

mentioning

confidence: 99%

See 1 more Smart Citation

3D observation of large-scale subcellular dynamics in vivo at the millisecond scale

Lü

Qiao

et al. 2019

Preprint

View full text Add to dashboard Cite

24Observing large-scale three-dimensional (3D) subcellular dynamics in vivo at high 1 spatiotemporal resolution has long been a pursuit for biology. However, both the 2 signal-to-noise ratio and resolution degradation in multicellular organisms pose 3 great challenges. Here, we propose a method, termed Digital Adaptive Optics 4 Scanning Lightfield Mutual Iterative Tomography (DAOSLIMIT), featuring both 5 3D incoherent synthetic aperture and tiled wavefront correction in post-processing. 6 We achieve aberration-free fluorescence imaging in vivo over a 150 × 150 × 16 µm 3 7 field-of-view with the spatiotemporal resolution up to 250 nm laterally and 320 nm 8 axially at 100 Hz, corresponding to a huge data throughput of over 15 Giga-voxels 9 per second. Various fast subcellular processes are observed, including 10 mitochondrial dynamics in cultured neurons, membrane dynamics in zebrafish 11 embryos, and calcium propagation in cardiac cells, human cerebral organoids, and 12 Drosophila larval neurons, enabling simultaneous in vivo studies of morphological 13 and functional dynamics in 3D. 14 Cells in living organs compose an exquisite microscopic world in which the logistics, 15plasticity, interaction, and migration of multiple subcellular organelles can only be 16 appreciated with high spatiotemporal resolution 1,2 . However, current microscopy 17 techniques only image a certain plane at one time, with three-dimensional (3D) imaging 18 obtained through movements of the focal plane relative to the specimen, such as 19 confocal 3,4 , structured illumination 5,6 , light sheet microscopy 7-9 , etc. A few emerging 20 imaging techniques 10 aiming at simultaneous 3D imaging have been developed recently, 21 such as light field microscopy (LFM) 11,12 , multi-focus microscopy 13,14 , etc. Although 22 LFM has achieved great success in high-speed large-scale 3D calcium imaging 12,15,16 with 23 single-cell resolution, its resolution is typically limited to ~1 µm by the intrinsic trade-off 24 between spatial and angular precision 17,18 , which is barely enough for subcellular 25 structures. With holographic gratings, multi-focus images can be detected simultaneously 26 at different areas on a large CCD camera 13,19 . However, they can only collect several

show abstract

Section: Resultsmentioning

confidence: 99%

mentioning

confidence: 99%

3D observation of large-scale subcellular dynamics in vivo at the millisecond scale

Lü

Qiao

et al. 2019

Preprint

View full text Add to dashboard Cite

show abstract

“…A focused light field (FLF) configuration also exists [6,7], which allows superior spatially resolved refocused images, and it is represented in Fig. 2.…”

Section: Focused Light Fieldmentioning

confidence: 99%

“…In the past years, a new configuration has been proposed, which operates in "focused" mode and that allows to obtain higher spatial resolutions compared to the unfocused mode [6,7].…”

Section: Introductionmentioning

confidence: 99%

Tomographic approach for the quantitative scene reconstruction from light field images

et al. 2018

View full text Add to dashboard Cite

Current computational methods for light field photography model the ray-tracing geometry inside the plenoptic camera. This representation of the problem, and some common approximations, can lead to errors in the estimation of object sizes and positions. We propose a representation that leads to the correct reconstruction of object sizes and distances to the camera, by showing that light field images can be interpreted as limited angle cone-beam tomography acquisitions. We then quantitatively analyze its impact on image refocusing, depth estimation and volumetric reconstructions, comparing it against other possible representations. Finally, we validate these results with numerical and real-world examples.

show abstract

“…The two experimental set-ups have been deeply compared in the literature 9,10,11,6 . But to the best of our knowledge, only Georgiev worked on the link between the two reconstruction approaches, with information spread in several publications 8,12,13 .…”

Section: Introductionmentioning

confidence: 99%

Comparison of reconstruction approaches for plenoptic imaging systems

Herzog

Dovillaire

Granier

et al. 2018

Unconventional Optical Imaging

View full text Add to dashboard Cite

Plenoptic cameras provide single-shot 3D imaging capabilities, based on the acquisition of the Light-Field, which corresponds to a spatial and directional sampling of all the rays of a scene reaching a detector. Specific algorithms applied on raw Light-Field data allow for the reconstruction of an object at different depths of the scene.Two different plenoptic imaging geometries have been reported, associated with two reconstruction algorithms: the traditional or unfocused plenoptic camera, also known as plenoptic camera 1.0, and the focused plenoptic camera, also called plenoptic camera 2.0. Both systems use the same optical elements, but placed at different locations: a main lens, a microlens array and a detector. These plenoptic systems have been presented as independent. Here we show the continuity between them, by simply moving the position of an object. We also compare the two reconstruction methods. We theoretically show that the two algorithms are intrinsically based on the same principle and could be applied to any LightField data. However, the resulting images resolution and quality depend on the chosen algorithm.

show abstract

On the fundamental comparison between unfocused and focused light field cameras

Cited by 39 publications

References 15 publications

3D observation of large-scale subcellular dynamics in vivo at the millisecond scale

3D observation of large-scale subcellular dynamics in vivo at the millisecond scale

Tomographic approach for the quantitative scene reconstruction from light field images

Comparison of reconstruction approaches for plenoptic imaging systems

Contact Info

Product

Resources

About