Point scanning imaging systems (e.g. scanning electron or laser scanning confocal microscopes) are perhaps the most widely used tools for high resolution cellular and tissue imaging. Like all other imaging modalities, the resolution, speed, sample preservation, and signal-to-noise ratio (SNR) of point scanning systems are difficult to optimize simultaneously. In particular, point scanning systems are uniquely constrained by an inverse relationship between imaging speed and pixel resolution. Here we show these limitations can be miti gated via the use of deep learning-based super-sampling of undersampled images acquired on a point-scanning system, which we termed point -scanning super-resolution (PSSR) imaging. Oversampled ground truth images acquired on scanning electron or Airyscan laser scanning confocal microscopes were used to generate semi-synthetictrain ing data for PSSR models that were then used to restore undersampled images. Remarkably, our EM PSSR model was able to restore undersampled images acquired with different optics, detectors, samples, or sample preparation methods in other labs . PSSR enabled previously unattainable xy resolution images with our serial block face scanning electron microscope system. For fluorescence, we show that undersampled confocal images combined with a multiframe PSSR model trained on Airyscan timelapses facilitates Airyscan-equivalent spati al resolution and SNR with ~100x lower laser dose and 16x higher frame rates than corresponding high-resolution acquisitions. In conclusion, PSSR facilitates point-scanning image acquisition with otherwise unattainable resolution, speed, and sensitivity.
more »
« less
Super-resolution computational saturated absorption microscopy
Imaging beyond the diffraction limit barrier has attracted wide attention due to the ability to resolve previously hidden image features. Of the various super-resolution microscopy techniques available, a particularly simple method called saturated excitation microscopy (SAX) requires only simple modification of a laser scanning microscope: The illumination beam power is sinusoidally modulated and driven into saturation. SAX images are extracted from the harmonics of the modulation frequency and exhibit improved spatial resolution. Unfortunately, this elegant strategy is hindered by the incursion of shot noise that prevents high-resolution imaging in many realistic scenarios. Here, we demonstrate a technique for super-resolution imaging that we call computational saturated absorption (CSA) in which a joint deconvolution is applied to a set of images with diversity in spatial frequency support among the point spread functions (PSFs) used in the image formation with saturated laser scanning fluorescence microscopy. CSA microscopy allows access to the high spatial frequency diversity in a set of saturated effective PSFs, while avoiding image degradation from shot noise.
more » « less- PAR ID:
- 10425217
- Publisher / Repository:
- Optical Society of America
- Date Published:
- Journal Name:
- Journal of the Optical Society of America A
- Volume:
- 40
- Issue:
- 7
- ISSN:
- 1084-7529; JOAOD6
- Format(s):
- Medium: X Size: Article No. 1409
- Size(s):
- Article No. 1409
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Unpaired data training enables super-resolution confocal microscopy from low-resolution acquisitionsmore » « less
Supervised deep-learning models have enabled super-resolution imaging in several microscopic imaging modalities, increasing the spatial lateral bandwidth of the original input images beyond the diffraction limit. Despite their success, their practical application poses several challenges in terms of the amount of training data and its quality, requiring the experimental acquisition of large, paired databases to generate an accurate generalized model whose performance remains invariant to unseen data. Cycle-consistent generative adversarial networks (cycleGANs) are unsupervised models for image-to-image translation tasks that are trained on unpaired datasets. This paper introduces a cycleGAN framework specifically designed to increase the lateral resolution limit in confocal microscopy by training a cycleGAN model using low- and high-resolution unpaired confocal images of human glioblastoma cells. Training and testing performances of the cycleGAN model have been assessed by measuring specific metrics such as background standard deviation, peak-to-noise ratio, and a customized frequency content measure. Our cycleGAN model has been evaluated in terms of image fidelity and resolution improvement using a paired dataset, showing superior performance than other reported methods. This work highlights the efficacy and promise of cycleGAN models in tackling super-resolution microscopic imaging without paired training, paving the path for turning home-built low-resolution microscopic systems into low-cost super-resolution instruments by means of unsupervised deep learning.
-
more » « less
Spectroscopic single-molecule localization microscopy (sSMLM) simultaneously provides spatial localization and spectral information of individual single-molecules emission, offering multicolor super-resolution imaging of multiple molecules in a single sample with the nanoscopic resolution. However, this technique is limited by the requirements of acquiring a large number of frames to reconstruct a super-resolution image. In addition, multicolor sSMLM imaging suffers from spectral cross-talk while using multiple dyes with relatively broad spectral bands that produce cross-color contamination. Here, we present a computational strategy to accelerate multicolor sSMLM imaging. Our method uses deep convolution neural networks to reconstruct high-density multicolor super-resolution images from low-density, contaminated multicolor images rendered using sSMLM datasets with much fewer frames, without compromising spatial resolution. High-quality, super-resolution images are reconstructed using up to 8-fold fewer frames than usually needed. Thus, our technique generates multicolor super-resolution images within a much shorter time, without any changes in the existing sSMLM hardware system. Two-color and three-color sSMLM experimental results demonstrate superior reconstructions of tubulin/mitochondria, peroxisome/mitochondria, and tubulin/mitochondria/peroxisome in fixed COS-7 and U2-OS cells with a significant reduction in acquisition time.
-
Over the past decade, the proliferation of pulsed laser sources with high repetition rates has facilitated a merger of ultrafast time-resolved spectroscopy with imaging microscopy. In transient absorption microscopy (TAM), the excited-state dynamics of a system are tracked by measuring changes in the transmission of a focused probe pulse following photoexcitation of a sample. Typically, these experiments are done using a photodiode detector and lock-in amplifier synchronized with the laser and images highlighting spatial heterogeneity in the TAM signal are constructed by scanning the probe across a sample. Performing TAM by instead imaging a spatially defocused widefield probe with a multipixel camera could dramatically accelerate the acquisition of spatially resolved dynamics, yet approaches for such widefield imaging generally suffer from reduced signal-to-noise due to an incompatibility of multipixel cameras with high-frequency lock-in detection. Herein, we describe implementation of a camera capable of high-frequency lock-in detection, thereby enabling widefield TAM imaging at rates matching those of high repetition rate lasers. Transient images using a widefield probe and two separate pump pulse configurations are highlighted. In the first, a widefield probe was used to image changes in the spatial distribution of photoexcited molecules prepared by a tightly focused pump pulse, while in the second, a widefield probe detected spatial variations in photoexcited dynamics within a heterogeneous organic crystal excited by a defocused pump pulse. These results highlight the ability of high-sensitivity lock-in detection to enable widefield TAM imaging, which can be leveraged to further our understanding of excited-state dynamics and excitation transport within spatially heterogeneous systems.more » « less
-
more » « less
Abstract The resolution of fluorescence microscopy images is limited by the physical properties of light. In the last decade, numerous super-resolution microscopy (SRM) approaches have been proposed to deal with such hindrance. Here we present Mean-Shift Super Resolution (MSSR), a new SRM algorithm based on the Mean Shift theory, which extends spatial resolution of single fluorescence images beyond the diffraction limit of light. MSSR works on low and high fluorophore densities, is not limited by the architecture of the optical setup and is applicable to single images as well as temporal series. The theoretical limit of spatial resolution, based on optimized real-world imaging conditions and analysis of temporal image stacks, has been measured to be 40 nm. Furthermore, MSSR has denoising capabilities that outperform other SRM approaches. Along with its wide accessibility, MSSR is a powerful, flexible, and generic tool for multidimensional and live cell imaging applications.
