Digital image processing as an integral component of optical design

Harvey, Andrew R.; Vettenburg, Tom; Demenikov, Mads; Lucotte, Bertrand M.; Muyo, Gonzalo; Wood, Andrew; Bustin, Nicholas; Singh, Amritpal; Findlay, Ewan

doi:10.1117/12.798581

Cited by 6 publications

(5 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[3][4][5][6][7] Despite the notable advantages of light-sheet microscopy in comparison to other high-resolution techniques, its field-ofview can be further extended through a combination of beam shaping and digital deconvolution techniques. [8][9][10][11] However, an alternative scanning strategy is required for samples that extend beyond the working distance of objectives.…”

Section: Introductionmentioning

confidence: 99%

On-the-fly deconvolution of diagonally-scanned Airy lightsheet microscopy

Vettenburg,

Valantinas

2024

Three-Dimensional and Multidimensional Microscopy: Image Acquisition and Processing XXXI

Self Cite

View full text Add to dashboard Cite

Its subcellular resolution and minimal sample exposure make light-sheet microscopy the ideal tool to study biological specimen during their early development. A light-sheet microscope scans the sample with a plane of light and collects fluorescence with an objective orthogonal to the illumination. However, tightly focused Gaussian light-sheets suffer from a shallow depth of focus and are susceptible to scattering-induced aberrations. Light-sheets created by non-diffractive Airy beams can overcome this to yield isotropic sub-cellular resolution over a ten-fold larger field-of-view. Airy beam light-sheets have a characteristically curved structure and a broad transverse structure with side-lobes. Digital deconvolution of the raw data is thus essential to obtain highfidelity images. Provided that the scan is along the direction of the detection axis, and all recorded data fits within working memory, a simple and efficient Wiener filter can recover accurate 3D images. However, multimillimeter sized samples must be scanned with a light-sheet that is diagonal to the sample surface. The diagonal movement prevents the use of standard Wiener filtering. Moreover, the associated data sets can become too large to fit within the working memory of a consumer-grade GPU. This demands slow off-line processing, thus breaking a rapid experimental feedback-loop. Here, we investigate the potential of on-the-fly deconvolution of diagonally-scanned Airy light-sheet microscopy.

show abstract

Section: Introductionmentioning

confidence: 99%

On-the-fly deconvolution of diagonally-scanned Airy lightsheet microscopy

Vettenburg,

Valantinas

2024

Three-Dimensional and Multidimensional Microscopy: Image Acquisition and Processing XXXI

Self Cite

View full text Add to dashboard Cite

show abstract

“…A similar issue is encountered in classical imaging systems where the DoF can be improved by placing a phase mask in the pupil of the objective and by restoring the image with an appropriate deconvolution filter. [10][11][12] The phase function of the mask can be optimized to maximize the quality of the deconvolved image. 11,[13][14][15] This approach consisting in optimizing an imaging system while taking into account the image formation model, the properties of the optical system and the method of information extraction is called "co-design".…”

Section: Introductionmentioning

confidence: 99%

“…[10][11][12] The phase function of the mask can be optimized to maximize the quality of the deconvolved image. 11,[13][14][15] This approach consisting in optimizing an imaging system while taking into account the image formation model, the properties of the optical system and the method of information extraction is called "co-design". 16,17 Our purpose is to apply this approach to DoF enhancement of localization microscopy.…”

Section: Introductionmentioning

confidence: 99%

Can phase masks extend depth-of-field in localization microscopy?

Lévêque

Kulcsár

Sauer

et al. 2020

Unconventional Optical Imaging II

View full text Add to dashboard Cite

In localization microscopy, the position of isolated fluorescent emitters are estimated with a resolution better than the diffraction limit. In order to image thick samples, which are common in biological applications, there is considerable interest in extending the depth-of-field of such microscopes in order to make their accuracy as invariant as possible to defocus. For that purpose, we propose to optimize annular binary phase masks placed in the pupil of the microscope in order to generate a point spread function for which the localization accuracy is almost invariant along the optical axis. The optimization criterion is defined as the localization accuracy in the plane expressed in terms of the Cramér-Rao bound. We show that the optimal masks significantly increase the depth-of-field of single-molecule imaging techniques relatively to an usual microscope objective.

show abstract

“…With the blossom of emerging computing imaging technology, new types of optical design method emerge recently, among which Wave Front Coding (WFC) [1][2] [3] method and information-based method [4] [5] are very representative. To achieve the optimal performance, WFC method takes the integral optimization of optical system and image processing.…”

Section: Introductionmentioning

confidence: 99%

An integral design strategy combining optical system and image processing to obtain high resolution images

Wang

Yang

et al. 2016

SPIE Proceedings

View full text Add to dashboard Cite

In this paper, an integral design that combines optical system with image processing is introduced to obtain high resolution images, and the performance is evaluated and demonstrated. Traditional imaging methods often separate the two technical procedures of optical system design and imaging processing, resulting in the failures in efficient cooperation between the optical and digital elements. Therefore, an innovative approach is presented to combine the merit function during optical design together with the constraint conditions of image processing algorithms. Specifically, an optical imaging system with low resolution is designed to collect the image signals which are indispensable for imaging processing, while the ultimate goal is to obtain high resolution images from the final system. In order to optimize the global performance, the optimization function of ZEMAX software is utilized and the number of optimization cycles is controlled. Then Wiener filter algorithm is adopted to process the image simulation and mean squared error (MSE) is taken as evaluation criterion. The results show that, although the optical figures of merit for the optical imaging systems is not the best, it can provide image signals that are more suitable for image processing. In conclusion. The integral design of optical system and image processing can search out the overall optimal solution which is missed by the traditional design methods. Especially, when designing some complex optical system, this integral design strategy has obvious advantages to simplify structure and reduce cost, as well as to gain high resolution images simultaneously, which has a promising perspective of industrial application.

show abstract

Digital image processing as an integral component of optical design

Cited by 6 publications

References 13 publications

On-the-fly deconvolution of diagonally-scanned Airy lightsheet microscopy

On-the-fly deconvolution of diagonally-scanned Airy lightsheet microscopy

Can phase masks extend depth-of-field in localization microscopy?

An integral design strategy combining optical system and image processing to obtain high resolution images

Contact Info

Product

Resources

About