Confocal microscopy is a standard approach for obtaining volumetric images of a sample with high axial and lateral resolution, especially when dealing with scattering samples. Unfortunately, a confocal microscope is quite expensive compared to traditional microscopes. In addition, the point scanning in confocal microscopy leads to slow imaging speed and photobleaching due to the high dose of laser energy. In this paper, we demonstrate how the advances in machine learning can be exploited to teach a traditional wide-field microscope, one that’s available in every lab, into producing 3D volumetric images like a confocal microscope. The key idea is to obtain multiple images with different focus settings using a wide-field microscope and use a 3D generative adversarial network (GAN) based neural network to learn the mapping between the blurry low-contrast image stacks obtained using a wide-field microscope and the sharp, high-contrast image stacks obtained using a confocal microscope. After training the network with widefield-confocal stack pairs, the network can reliably and accurately reconstruct 3D volumetric images that rival confocal images in terms of its lateral resolution, z-sectioning and image contrast. Our experimental results demonstrate generalization ability to handle unseen data, stability in the reconstruction results, high spatial resolution even when imaging thick (∼40 microns) highly-scattering samples. We believe that such learning-based microscopes have the potential to bring confocal imaging quality to every lab that has a wide-field microscope.
There has been recent interest in the development of fluorescence microscopes that provide high-speed volumetric imaging for life-science applications. For example, multi-z confocal microscopy enables simultaneous optically-sectioned imaging at multiple depths over relatively large fields of view. However, to date, multi-z microscopy has been hampered by limited spatial resolution owing to its initial design. Here we present a variant of multi-z microscopy that recovers the full spatial resolution of a conventional confocal microscope while retaining the simplicity and ease of use of our initial design. By introducing a diffractive optical element in the illumination path of our microscope, we engineer the excitation beam into multiple tightly focused spots that are conjugated to axially distributed confocal pinholes. We discuss the performance of this multi-z microscope in terms of resolution and detectability and demonstrate its versatility by performing
- NSF-PAR ID:
- 10417553
- Publisher / Repository:
- Optical Society of America
- Date Published:
- Journal Name:
- Biomedical Optics Express
- Volume:
- 14
- Issue:
- 6
- ISSN:
- 2156-7085
- Format(s):
- Medium: X Size: Article No. 3057
- Size(s):
- Article No. 3057
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
more » « less
Spatial resolution is one of the most important specifications of an imaging system. Recent results in the quantum parameter estimation theory reveal that an arbitrarily small distance between two incoherent point sources can always be efficiently determined through the use of a spatial mode sorter. However, extending this procedure to a general object consisting of many incoherent point sources remains challenging, due to the intrinsic complexity of multi-parameter estimation problems. Here, we generalize the Richardson-Lucy (RL) deconvolution algorithm to address this challenge. We simulate its application to an incoherent confocal microscope, with a Zernike spatial mode sorter replacing the pinhole used in a conventional confocal microscope. We test different spatially incoherent objects of arbitrary geometry, and we find that the resolution enhancement of sorter-based microscopy is on average over 30% higher than that of a conventional confocal microscope using the standard RL deconvolution algorithm. Our method could potentially be used in diverse applications such as fluorescence microscopy and astronomical imaging.
-
more » « less
Open-top light-sheet (OTLS) microscopes have been developed for user-friendly and versatile high-throughput 3D microscopy of thick specimens. As with all imaging modalities, spatial resolution trades off with imaging and analysis times. A hierarchical multi-scale imaging workflow would therefore be of value for many volumetric microscopy applications. We describe a compact multi-resolution OTLS microscope, enabled by a novel solid immersion meniscus lens (SIMlens), which allows users to rapidly transition between air-based objectives for low- and high-resolution 3D imaging. We demonstrate the utility of this system by showcasing an efficient 3D analysis workflow for a diagnostic pathology application.
-
more » « less
Abstract Super-resolution fluorescence microscopy methods enable the characterization of nanostructures in living and fixed biological tissues. However, they require the adjustment of multiple imaging parameters while attempting to satisfy conflicting objectives, such as maximizing spatial and temporal resolution while minimizing light exposure. To overcome the limitations imposed by these trade-offs, post-acquisition algorithmic approaches have been proposed for resolution enhancement and image-quality improvement. Here we introduce the task-assisted generative adversarial network (TA-GAN), which incorporates an auxiliary task (for example, segmentation, localization) closely related to the observed biological nanostructure characterization. We evaluate how the TA-GAN improves generative accuracy over unassisted methods, using images acquired with different modalities such as confocal, bright-field, stimulated emission depletion and structured illumination microscopy. The TA-GAN is incorporated directly into the acquisition pipeline of the microscope to predict the nanometric content of the field of view without requiring the acquisition of a super-resolved image. This information is used to automatically select the imaging modality and regions of interest, optimizing the acquisition sequence by reducing light exposure. Data-driven microscopy methods like the TA-GAN will enable the observation of dynamic molecular processes with spatial and temporal resolutions that surpass the limits currently imposed by the trade-offs constraining super-resolution microscopy.
-
more » « less
Confocal microscopy provides optical sectioning that is invaluable for many applications, most notably imaging into thick samples. However, the high cost of commercial confocal microscopes limits uses to specialized research and clinical settings. We present a minimalistic line-scanning confocal microscope costing less than $6,500 with optical performance comparable to a commercial laser scanning system. The optical sectioning and imaging performance are shown through measurement of the axial line-spread function and imaging of biological samples of varying thickness. Comparison is made to commercial widefield and confocal microscopes. The low cost of goods and optical sectioning capability of this microscope will allow the use of confocal microscopy in additional research and educational settings.
