High-Resolution Light-Field Microscopy

Lu, Chung-Chin; Muenzel, Stefan; Fleischer, Jason W.

doi:10.1364/cosi.2013.cth3b.2

Cited by 22 publications

(14 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Alternatively, a light field could be captured along with a normal, high-resolution widefield image. This would improve resolution at the native object plane and possibly at other planes as well if the two were combined as proposed in [24]. Finally, a lenslet array could be placed at the native image plane of a multi-focal microscope [25] to create many overlapping regions of high resolution and extend the useful axial extent of the 3-D reconstruction.…”

Section: Discussionmentioning

confidence: 99%

Wave optics theory and 3-D deconvolution for the light field microscope

et al. 2013

View full text Add to dashboard Cite

Abstract:Light field microscopy is a new technique for high-speed volumetric imaging of weakly scattering or fluorescent specimens. It employs an array of microlenses to trade off spatial resolution against angular resolution, thereby allowing a 4-D light field to be captured using a single photographic exposure without the need for scanning. The recorded light field can then be used to computationally reconstruct a full volume. In this paper, we present an optical model for light field microscopy based on wave optics, instead of previously reported ray optics models. We also present a 3-D deconvolution method for light field microscopy that is able to reconstruct volumes at higher spatial resolution, and with better optical sectioning, than previously reported. To accomplish this, we take advantage of the dense spatio-angular sampling provided by a microlens array at axial positions away from the native object plane. This dense sampling permits us to decode aliasing present in the light field to reconstruct high-frequency information. We formulate our method as an inverse problem for reconstructing the 3-D volume, which we solve using a GPU-accelerated iterative algorithm. Theoretical limits on the depth-dependent lateral resolution of the reconstructed volumes are derived. We show that these limits are in good agreement with experimental results on a standard USAF 1951 resolution target. Finally, we present 3-D reconstructions of pollen grains that demonstrate the improvements in fidelity made possible by our method.

show abstract

Section: Discussionmentioning

confidence: 99%

Wave optics theory and 3-D deconvolution for the light field microscope

et al. 2013

View full text Add to dashboard Cite

show abstract

“…A light field image could also be captured together with a widefield image, the latter providing high-resolution information about the native object plane as proposed in [13]. This method requires splitting the incoming light between two cameras or capturing the light field and widefield images sequentially, which is less suitable for imaging dynamic phenomena.…”

Section: Introductionmentioning

confidence: 99%

Enhancing the performance of the light field microscope using wavefront coding

et al. 2014

View full text Add to dashboard Cite

Light field microscopy has been proposed as a new high-speed volumetric computational imaging method that enables reconstruction of 3-D volumes from captured projections of the 4-D light field. Recently, a detailed physical optics model of the light field microscope has been derived, which led to the development of a deconvolution algorithm that reconstructs 3-D volumes with high spatial resolution. However, the spatial resolution of the reconstructions has been shown to be non-uniform across depth, with some z planes showing high resolution and others, particularly at the center of the imaged volume, showing very low resolution. In this paper, we enhance the performance of the light field microscope using wavefront coding techniques. By including phase masks in the optical path of the microscope we are able to address this non-uniform resolution limitation. We have also found that superior control over the performance of the light field microscope can be achieved by using two phase masks rather than one, placed at the objective's back focal plane and at the microscope's native image plane. We present an extended optical model for our wavefront coded light field microscope and develop a performance metric based on Fisher information, which we use to choose adequate phase masks parameters. We validate our approach using both simulated data and experimental resolution measurements of a USAF 1951 resolution target; and demonstrate the utility for biological applications with in vivo volumetric calcium imaging of larval zebrafish brain.

show abstract

“…Recently, addressing the large spatial resolution loss implicit in LFM, the group has shown that computational superresolution can be achieved outside the focal plane of the microscope [2,3]. Another super-resolution scheme is combining a Shack-Hartmann wavefront sensor and a standard 2D image to compute a high-resolution microscopic lightfield [14]. LFM has been applied to polarization studies of mineral samples [18] and initial studies for extracting depth maps from the light-field data have been performed in microscopic contexts [8,20].…”

Section: Related Workmentioning

confidence: 99%

Light-Field Microscopy with a Consumer Light-Field Camera

Mignard-Debise

Ihrke

2015

2015 International Conference on 3D Vision

View full text Add to dashboard Cite

We explore the use of inexpensive consumer lightfield camera technology for the purpose of light-field microscopy. Our experiments are based on the Lytro (first generation) camera. Unfortunately, the optical systems of the Lytro and those of microscopes are not compatible, leading to a loss of light-field information due to angular and spatial vignetting when directly recording microscopic pictures. We therefore consider an adaptation of the Lytro optical system.We demonstrate that using the Lytro directly as an ocular replacement, leads to unacceptable spatial vignetting. However, we also found a setting that allows the use of the Lytro camera in a virtual imaging mode which prevents the information loss to a large extent. We analyze the new virtual imaging mode and use it in two different setups for implementing light-field microscopy using a Lytro camera. As a practical result, we show that the camera can be used for low magnification work, as e.g. common in quality control, surface characterization, etc. We achieve a maximum spatial resolution of about 6.25µm, albeit at a limited SNR for the side views.

show abstract

High-Resolution Light-Field Microscopy

Abstract: By combining a high-resolution image from a standard camera with a low-resolution wavefront measurement from a Shack-Hartmann sensor, we numerically reconstruct a highresolution light field. We experimentally demonstrate the method with a commercially available microscope.

Cited by 22 publications

References 5 publications

Wave optics theory and 3-D deconvolution for the light field microscope

Wave optics theory and 3-D deconvolution for the light field microscope

Enhancing the performance of the light field microscope using wavefront coding

Light-Field Microscopy with a Consumer Light-Field Camera

Contact Info

Product

Resources

About