Recording and controlling the 4D light field in a microscope using microlens arrays

Levoy, Marc; Zhang, Z.; McDowall, Ian E.

doi:10.1111/j.1365-2818.2009.03195.x

Cited by 251 publications

(197 citation statements)

References 54 publications

Supporting

Mentioning

194

Contrasting

Order By: Relevance

“…Some examples of these are the visualization of 3D content and TV systems based on integral imaging [80][81][82], and the automatic recognition of 3D objects [83][84][85][86]. Other interesting applications are the 3D image and processing systems of poorly illuminated 3D scenes based on multi-perspective photon counting [87][88][89][90][91], the 3D imaging and pattern recognition of scenes that present partial occlusions or immersed in dispersive environments [92,93], and the 3D microscopy after a single shot [94][95][96][97][98][99].…”

Section: The Viewer Sees Point S Closer To Him Than the Other Pointmentioning

confidence: 99%

Three-Dimensional Imaging and Display through Integral Photography

Navarro

Dorado²,

Saavedra³

et al. 2014

Journal of information and communication convergence engineerin

View full text Add to dashboard Cite

Here, we present a review of the proposals and advances in the field of three-dimensional (3D) imaging acquisition and display made in the last century. The most popular techniques are based on the concept of stereoscopy. However, stereoscopy does not provide real 3D experience, and produces discomfort due to the conflict between convergence and accommodation. For this reason, we focus this paper on integral imaging, which is a technique that permits the codification of 3D information in an array of 2D images obtained from different perspectives. When this array of elemental images is placed in front of an array of microlenses, the perspectives are integrated producing 3D images with full parallax and free of the convergenceaccommodation conflict. In the paper we describe the principles of this technique, together with some new applications of integral imaging.

show abstract

Section: The Viewer Sees Point S Closer To Him Than the Other Pointmentioning

confidence: 99%

Three-Dimensional Imaging and Display through Integral Photography

Navarro

Dorado²,

Saavedra³

et al. 2014

Journal of information and communication convergence engineerin

View full text Add to dashboard Cite

show abstract

“…al in 2006 and [1,2] and further improved upon by Broxton et. al in 2013 [3], is a method for single-snapshot volumetric imaging that employs a microlens array in the optical path of a fluorescence microscope.…”

Section: Introductionmentioning

confidence: 99%

Enhancing the performance of the light field microscope using wavefront coding

et al. 2014

View full text Add to dashboard Cite

Light field microscopy has been proposed as a new high-speed volumetric computational imaging method that enables reconstruction of 3-D volumes from captured projections of the 4-D light field. Recently, a detailed physical optics model of the light field microscope has been derived, which led to the development of a deconvolution algorithm that reconstructs 3-D volumes with high spatial resolution. However, the spatial resolution of the reconstructions has been shown to be non-uniform across depth, with some z planes showing high resolution and others, particularly at the center of the imaged volume, showing very low resolution. In this paper, we enhance the performance of the light field microscope using wavefront coding techniques. By including phase masks in the optical path of the microscope we are able to address this non-uniform resolution limitation. We have also found that superior control over the performance of the light field microscope can be achieved by using two phase masks rather than one, placed at the objective's back focal plane and at the microscope's native image plane. We present an extended optical model for our wavefront coded light field microscope and develop a performance metric based on Fisher information, which we use to choose adequate phase masks parameters. We validate our approach using both simulated data and experimental resolution measurements of a USAF 1951 resolution target; and demonstrate the utility for biological applications with in vivo volumetric calcium imaging of larval zebrafish brain.

show abstract

“…Light field microscopy [1,2] is a new approach for rapid, scanless volumetric imaging using optical microscopy. By introducing a microlens array into the light path of a conventional microscope, it is possible to image both the lateral and angular distribution of light passing through the specimen volume.…”

Section: Introductionmentioning

confidence: 99%

Wave optics theory and 3-D deconvolution for the light field microscope

et al. 2013

View full text Add to dashboard Cite

Abstract:Light field microscopy is a new technique for high-speed volumetric imaging of weakly scattering or fluorescent specimens. It employs an array of microlenses to trade off spatial resolution against angular resolution, thereby allowing a 4-D light field to be captured using a single photographic exposure without the need for scanning. The recorded light field can then be used to computationally reconstruct a full volume. In this paper, we present an optical model for light field microscopy based on wave optics, instead of previously reported ray optics models. We also present a 3-D deconvolution method for light field microscopy that is able to reconstruct volumes at higher spatial resolution, and with better optical sectioning, than previously reported. To accomplish this, we take advantage of the dense spatio-angular sampling provided by a microlens array at axial positions away from the native object plane. This dense sampling permits us to decode aliasing present in the light field to reconstruct high-frequency information. We formulate our method as an inverse problem for reconstructing the 3-D volume, which we solve using a GPU-accelerated iterative algorithm. Theoretical limits on the depth-dependent lateral resolution of the reconstructed volumes are derived. We show that these limits are in good agreement with experimental results on a standard USAF 1951 resolution target. Finally, we present 3-D reconstructions of pollen grains that demonstrate the improvements in fidelity made possible by our method.

show abstract

Recording and controlling the 4D light field in a microscope using microlens arrays

Cited by 251 publications

References 54 publications

Three-Dimensional Imaging and Display through Integral Photography

Three-Dimensional Imaging and Display through Integral Photography

Enhancing the performance of the light field microscope using wavefront coding

Wave optics theory and 3-D deconvolution for the light field microscope

Contact Info

Product

Resources

About