Confocal microscopy is a standard approach for obtaining volumetric images of a sample with high axial and lateral resolution, especially when dealing with scattering samples. Unfortunately, a confocal microscope is quite expensive compared to traditional microscopes. In addition, the point scanning in confocal microscopy leads to slow imaging speed and photobleaching due to the high dose of laser energy. In this paper, we demonstrate how the advances in machine learning can be exploited to teach a traditional wide-field microscope, one that’s available in every lab, into producing 3D volumetric images like a confocal microscope. The key idea is to obtain multiple images with different focus settings using a wide-field microscope and use a 3D generative adversarial network (GAN) based neural network to learn the mapping between the blurry low-contrast image stacks obtained using a wide-field microscope and the sharp, high-contrast image stacks obtained using a confocal microscope. After training the network with widefield-confocal stack pairs, the network can reliably and accurately reconstruct 3D volumetric images that rival confocal images in terms of its lateral resolution, z-sectioning and image contrast. Our experimental results demonstrate generalization ability to handle unseen data, stability in the reconstruction results, high spatial resolution even when imaging thick (∼40 microns) highly-scattering samples. We believe that such learning-based microscopes have the potential to bring confocal imaging quality to every lab that has a wide-field microscope.
more »
« less
ELVIS: A Correlated Light-Field and Digital Holographic Microscope for Field and Laboratory Investigations
This is the first of two articles on the Extant Life Volumetric Imaging System (ELVIS) describing a combined digital holographic microscope (DHM) and a fluorescence light-field microscope (FLFM). The instrument is modular and robust enough for field use. Each mode uses its own illumination source and camera, but both microscopes share a common objective lens and sample viewing chamber. This allows correlative volumetric imaging in amplitude, quantitative phase, and fluorescence modes. A detailed schematic and parts list is presented, as well as links to open-source software packages for data acquisition and analysis that permits interested researchers to duplicate the design. Instrument performance is quantified using test targets and beads. In the second article on ELVIS, to be published in the next issue of Microscopy Today , analysis of data from field tests and images of microorganisms will be presented.
more »
« less
- Award ID(s):
- 1828793
- PAR ID:
- 10185644
- Date Published:
- Journal Name:
- Microscopy Today
- Volume:
- 28
- Issue:
- 3
- ISSN:
- 1551-9295
- Page Range / eLocation ID:
- 18 to 25
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Optical imaging with nanoscale resolution and a large field of view is highly desirable in many research areas. Unfortunately, it is challenging to achieve these two features simultaneously while using a conventional microscope. An objective lens with a low numerical aperture (NA) has a large field of view but poor resolution. In contrast, a high NA objective lens will have a higher resolution but reduced field of view. In an effort to close the gap between these trade-offs, we introduce an acoustofluidic scanning nanoscope (AS-nanoscope) that can simultaneously achieve high resolution with a large field of view. The AS-nanoscope relies on acoustofluidic-assisted scanning of multiple microsized particles. A scanned 2D image is then compiled by processing the microparticle images using an automated big-data image algorithm. The AS-nanoscope has the potential to be integrated into a conventional microscope or could serve as a stand-alone instrument for a wide range of applications where both high resolution and large field of view are required.more » « less
-
Quantitative imaging of synaptic vesicle localization and abundance using fluorescently labeled synaptic vesicle associated proteins like GFP::SNB-1 is a well-established method for measuring changes in synapse structure at neuromuscular junctions (NMJ) in C. elegans. To date, however, the ability to easily and reproducibly measure key parameters at the NMJ – maximum intensity, size of GFP::SNB-1 puncta, density of puncta – has relied on the use of expensive, customizable software that requires coding skills to modify, precluding widespread access and thus preventing standardization within the field. We carried out a comparative evaluation of a new, open-source Fiji puncta plugin versus traditional Igor-based analysis of GFP::SNB-1 imaging data taken of cholinergic motor neurons in the dorsal nerve cord of loss of function mutants in fshr-1, which encodes a G protein-coupled receptor known to impact GFP::SNB-1 accumulation. We analyzed images taken on a widefield fluorescence microscope, as well as on a spinning disk confocal microscope. Our data demonstrate strong concordance between the differences in GFP::SNB-1 localization in fshr-1 mutants compared to wild type worms across both analysis platforms (Fiji and Igor), as well as across microscope types (widefield and confocal). These data also agree with previously published observations related to synapse number and GFP::SNB-1 intensity in fshr-1 and wild type worms. Based on these findings, we conclude that the Fiji platform is viable as a method for analyzing synaptic vesicle localization and abundance at cholinergic dorsal nerve cord motor NMJs and expect the Fiji puncta plugin to be of broad utility in imaging across a variety of imaging platforms and synaptic markers.more » « less
-
In the past two decades, spectral imaging technologies have expanded the capacity of fluorescence microscopy for accurate detection of multiple labels, separation of labels from cellular and tissue autofluorescence, and analysis of autofluorescence signatures. These technologies have been implemented using a range of optical techniques, such as tunable filters, diffraction gratings, prisms, interferometry, and custom Bayer filters. Each of these techniques has associated strengths and weaknesses with regard to spectral resolution, spatial resolution, temporal resolution, and signal-to-noise characteristics. We have previously shown that spectral scanning of the fluorescence excitation spectrum can provide greatly increased signal strength compared to traditional emission-scanning approaches. Here, we present results from utilizing a Hyperspectral Imaging Fluorescence Excitation Scanning (HIFEX) microscope system for live cell imaging. Live cell signaling studies were performed using HEK 293 and rat pulmonary microvascular endothelial cells (PMVECs), transfected with either a cAMP FRET reporter or a Ca2+ reporter. Cells were further labeled to visualize subcellular structures (nuclei, membrane, mitochondria, etc.). Spectral images were acquired using a custom inverted microscope (TE2000, Nikon Instruments) equipped with a 300W Xe arc lamp and tunable excitation filter (VF- 5, Sutter Instrument Co., equipped with VersaChrome filters, Semrock), and run through MicroManager. Timelapse spectral images were acquired from 350-550 nm, in 5 nm increments. Spectral image data were linearly unmixed using custom MATLAB scripts. Results indicate that the HIFEX microscope system can acquire live cell image data at acquisition speeds of 8 ms/wavelength band with minimal photobleaching, sufficient for studying moderate speed cAMP and Ca2+ events.more » « less
An official website of the United States government

