Confocal microscopy is a standard approach for obtaining volumetric images of a sample with high axial and lateral resolution, especially when dealing with scattering samples. Unfortunately, a confocal microscope is quite expensive compared to traditional microscopes. In addition, the point scanning in confocal microscopy leads to slow imaging speed and photobleaching due to the high dose of laser energy. In this paper, we demonstrate how the advances in machine learning can be exploited to teach a traditional wide-field microscope, one that’s available in every lab, into producing 3D volumetric images like a confocal microscope. The key idea is to obtain multiple images with different focus settings using a wide-field microscope and use a 3D generative adversarial network (GAN) based neural network to learn the mapping between the blurry low-contrast image stacks obtained using a wide-field microscope and the sharp, high-contrast image stacks obtained using a confocal microscope. After training the network with widefield-confocal stack pairs, the network can reliably and accurately reconstruct 3D volumetric images that rival confocal images in terms of its lateral resolution, z-sectioning and image contrast. Our experimental results demonstrate generalization ability to handle unseen data, stability in the reconstruction results, high spatial resolution even when imaging thick (∼40 microns) highly-scattering samples. We believe that such learning-based microscopes have the potential to bring confocal imaging quality to every lab that has a wide-field microscope.
We introduce wFLFM, an approach that enhances the resolution of Fourier light-field microscopy (FLFM) through a hybrid wide-field image. The system exploits the intrinsic compatibility of image formation between the on-axis FLFM elemental image and the wide-field image, allowing for minimal instrumental and computational complexity. The numerical and experimental results of wFLFM present a two- to three-fold improvement in the lateral resolution without compromising the 3D imaging capability in comparison with conventional FLFM.
more » « less- Award ID(s):
- 1830941
- NSF-PAR ID:
- 10209221
- Publisher / Repository:
- DOI PREFIX: 10.35848
- Date Published:
- Journal Name:
- Applied Physics Express
- Volume:
- 14
- Issue:
- 1
- ISSN:
- 1882-0778
- Page Range / eLocation ID:
- Article No. 012007
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
Optical imaging with nanoscale resolution and a large field of view is highly desirable in many research areas. Unfortunately, it is challenging to achieve these two features simultaneously while using a conventional microscope. An objective lens with a low numerical aperture (NA) has a large field of view but poor resolution. In contrast, a high NA objective lens will have a higher resolution but reduced field of view. In an effort to close the gap between these trade-offs, we introduce an acoustofluidic scanning nanoscope (AS-nanoscope) that can simultaneously achieve high resolution with a large field of view. The AS-nanoscope relies on acoustofluidic-assisted scanning of multiple microsized particles. A scanned 2D image is then compiled by processing the microparticle images using an automated big-data image algorithm. The AS-nanoscope has the potential to be integrated into a conventional microscope or could serve as a stand-alone instrument for a wide range of applications where both high resolution and large field of view are required.more » « less
-
We report a novel lensless on-chip microscopy platform based on near-field blind ptychographic modulation. In this platform, we place a thin diffuser in between the object and the image sensor for light wave modulation. By blindly scanning the unknown diffuser to different x – y positions, we acquire a sequence of modulated intensity images for quantitative object recovery. Different from previous ptychographic implementations, we employ a unit magnification configuration with a Fresnel number of ∼50 000, which is orders of magnitude higher than those of previous ptychographic setups. The unit magnification configuration allows us to have the entire sensor area, 6.4 mm by 4.6 mm, as the imaging field of view. The ultra-high Fresnel number enables us to directly recover the positional shift of the diffuser in the phase retrieval process, addressing the positioning accuracy issue plaguing regular ptychographic experiments. In our implementation, we use a low-cost, DIY scanning stage to perform blind diffuser modulation. Precise mechanical scanning that is critical in conventional ptychography experiments is no longer needed in our setup. We further employ an up-sampling phase retrieval scheme to bypass the resolution limit set by the imager pixel size and demonstrate a half-pitch resolution of 0.78 μm. We validate the imaging performance via in vitro cell cultures, transparent and stained tissue sections, and a thick biological sample. We show that the recovered quantitative phase map can be used to perform effective cell segmentation of a dense yeast culture. We also demonstrate 3D digital refocusing of the thick biological sample based on the recovered wavefront. The reported platform provides a cost-effective and turnkey solution for large field-of-view, high-resolution, and quantitative on-chip microscopy. It is adaptable for a wide range of point-of-care-, global-health-, and telemedicine-related applications.more » « less
-
more » « less
Abstract The Hobby–Eberly Telescope (HET) Dark Energy Experiment (HETDEX) is undertaking a blind wide-field low-resolution spectroscopic survey of 540 deg2of sky to identify and derive redshifts for a million Ly
α -emitting galaxies in the redshift range 1.9 <z < 3.5. The ultimate goal is to measure the expansion rate of the universe at this epoch, to sharply constrain cosmological parameters and thus the nature of dark energy. A major multiyear Wide-Field Upgrade (WFU) of the HET was completed in 2016 that substantially increased the field of view to 22′ diameter and the pupil to 10 m, by replacing the optical corrector, tracker, and Prime Focus Instrument Package and by developing a new telescope control system. The new, wide-field HET now feeds the Visible Integral-field Replicable Unit Spectrograph (VIRUS), a new low-resolution integral-field spectrograph (LRS2), and the Habitable Zone Planet Finder, a precision near-infrared radial velocity spectrograph. VIRUS consists of 156 identical spectrographs fed by almost 35,000 fibers in 78 integral-field units arrayed at the focus of the upgraded HET. VIRUS operates in a bandpass of 3500−5500 Å with resolving powerR ≃ 800. VIRUS is the first example of large-scale replication applied to instrumentation in optical astronomy to achieve spectroscopic surveys of very large areas of sky. This paper presents technical details of the HET WFU and VIRUS, as flowed down from the HETDEX science requirements, along with experience from commissioning this major telescope upgrade and the innovative instrumentation suite for HETDEX. -
more » « less
Abstract We report on the development of a wide-field near-infrared (0.9–2.5$\, \mu$m) camera built as a renewal of the existing classical Cassegrain 0.91 m telescope at Okayama Astrophysical Observatory. The optics system was replaced with fast hybrid optics (f/2.5) composed of forward Cassegrain optics and quasi-Schmidt optics, which results in an effective image circle of 52 mm diameter on the focal plane. The new camera, called the Okayama Astrophysical Observatory Wide-Field Camera (OAOWFC), has imaging capabilities in the $Y$, $J$, $H$, and $K_{\rm s}$ bands over a field of view of $0.^{\!\!\!\circ }47 \times 0.^{\!\!\!\circ }47$ with a HAWAII-1 HgCdTe PACE focal plane array. The primary purpose of OAOWFC is to search for variability in the Galactic plane in the $K_{\rm s}$ band and to promptly follow up transients. We have demonstrated a photometric repeatability of 2% in the densest field in the northern Galactic plane and successfully discovered previously unreported variable stars. The observations of OAOWFC are fully autonomous, and we started scientific operations in 2015 April.
