skip to main content

Title: Accelerating multicolor spectroscopic single-molecule localization microscopy using deep learning

Spectroscopic single-molecule localization microscopy (sSMLM) simultaneously provides spatial localization and spectral information of individual single-molecules emission, offering multicolor super-resolution imaging of multiple molecules in a single sample with the nanoscopic resolution. However, this technique is limited by the requirements of acquiring a large number of frames to reconstruct a super-resolution image. In addition, multicolor sSMLM imaging suffers from spectral cross-talk while using multiple dyes with relatively broad spectral bands that produce cross-color contamination. Here, we present a computational strategy to accelerate multicolor sSMLM imaging. Our method uses deep convolution neural networks to reconstruct high-density multicolor super-resolution images from low-density, contaminated multicolor images rendered using sSMLM datasets with much fewer frames, without compromising spatial resolution. High-quality, super-resolution images are reconstructed using up to 8-fold fewer frames than usually needed. Thus, our technique generates multicolor super-resolution images within a much shorter time, without any changes in the existing sSMLM hardware system. Two-color and three-color sSMLM experimental results demonstrate superior reconstructions of tubulin/mitochondria, peroxisome/mitochondria, and tubulin/mitochondria/peroxisome in fixed COS-7 and U2-OS cells with a significant reduction in acquisition time.

more » « less
Award ID(s):
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Biomedical Optics Express
Page Range / eLocation ID:
Article No. 2705
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Single-molecule localization microscopy (SMLM) breaks the optical diffraction limit by numerically localizing sparse fluorescence emitters to achieve super-resolution imaging. Spectroscopic SMLM or sSMLM further allows simultaneous spectroscopy and super-resolution imaging of fluorescence molecules. Hence, sSMLM can extract spectral features with single-molecule sensitivity, higher precision, and higher multiplexity than traditional multicolor microscopy modalities. These new capabilities enabled advanced multiplexed and functional cellular imaging applications. While sSMLM suffers from reduced spatial precision compared to conventional SMLM due to splitting photons to form spatial and spectral images, several methods have been reported to mitigate these weaknesses through innovative optical design and image processing techniques. This review summarizes the recent progress in sSMLM, its applications, and our perspective on future work.

    Graphical Abstract

    more » « less
  2. By manipulating the spectral dispersion of detected photons, spectroscopic single-molecule localization microscopy (sSMLM) permits concurrent high-throughput single-molecular spectroscopic analysis and imaging. Despite its promising potential, using discrete optical components and managing the delicate balance between spectral dispersion and spatial localization compromise its performance, including non-uniform spectral dispersion, high transmission loss of grating, high optical alignment demands, and reduced precision. We designed a dual-wedge prism (DWP)-based monolithic imaging spectrometer to overcome these challenges. We optimized the DWP for spectrally dispersing focused beam without deviation and with minimal wavefront error. We integrated all components into a compact assembly, minimizing total transmission loss and significantly reducing optical alignment requirements. We show the feasibility of DWP using ray-tracing and numerical simulations. We validated our numerical simulations by experimentally imaging individual nanospheres and confirmed that DWP-sSMLM achieved much improved spatial and spectral precisions of grating-based sSMLM. We also demonstrated DWP-sSMLM in 3D multi-color imaging of cells. 
    more » « less
  3. Spectroscopic single-molecule localization microscopy (sSMLM) generates super-resolution images of single molecules while simultaneously capturing the spectra of their fluorescence emissions. However, sSMLM splits photons from single-molecule emissions into a spatial channel and a spectral channel, reducing both channels’ precisions. It is also challenging in transmission grating-based sSMLM to achieve a large field-of-view (FOV) and avoid overlap between the spatial and spectral channels. The challenge in FOV has further significance in single-molecule tracking applications. In this work, we analyzed the correlation between the spatial and spectral channels in sSMLM to improve its spatial precision, and we developed a split-mirror assembly to enlarge its FOV. We demonstrate the benefits of these improvements by tracking quantum dots. We also show that we can reduce particle-identification ambiguity by tagging each particle with its unique spectral characteristics.

    more » « less
  4. null (Ed.)
    Multicolor carbon dots (CDs) have been developed recently and demonstrate great potential in bio-imaging, sensing, and LEDs. However, the fluorescence mechanism of their tunable colors is still under debate, and efficient separation methods are still challenging. Herein, we synthesized multicolor polymeric CDs through solvothermal treatment of citric acid and urea in formamide. Automated reversed-phase column separation was used to achieve fractions with distinct colors, including blue, cyan, green, yellow, orange and red. This work explores the physicochemical properties and fluorescence origins of the red, green, and blue fractions in depth with combined experimental and computational methods. Three dominant fluorescence mechanism hypotheses were evaluated by comparing time-dependent density functional theory and molecular dynamics calculation results to measured characteristics. We find that blue fluorescence likely comes from embedded small molecules trapped in carbonaceous cages, while pyrene analogs are the most likely origin for emission at other wavelengths, especially in the red. Also important, upon interaction with live cells, different CD color fractions are trafficked to different sub-cellular locations. Super-resolution imaging shows that the blue CDs were found in a variety of organelles, such as mitochondria and lysosomes, while the red CDs were primarily localized in lysosomes. These findings significantly advance our understanding of the photoluminescence mechanism of multicolor CDs and help to guide future design and applications of these promising nanomaterials. 
    more » « less
  5. Abstract

    Spectroscopic single-molecule localization microscopy (sSMLM) was used to achieve simultaneous imaging and spectral analysis of single molecules for the first time. Current sSMLM fundamentally suffers from a reduced photon budget because the photons from individual stochastic emissions are divided into spatial and spectral channels. Therefore, both spatial localization and spectral analysis only use a portion of the total photons, leading to reduced precisions in both channels. To improve the spatial and spectral precisions, we present symmetrically dispersed sSMLM, or SDsSMLM, to fully utilize all photons from individual stochastic emissions in both spatial and spectral channels. SDsSMLM achieved 10-nm spatial and 0.8-nm spectral precisions at a total photon budget of 1000. Compared with the existing sSMLM using a 1:3 splitting ratio between spatial and spectral channels, SDsSMLM improved the spatial and spectral precisions by 42% and 10%, respectively, under the same photon budget. We also demonstrated multicolour imaging of fixed cells and three-dimensional single-particle tracking using SDsSMLM. SDsSMLM enables more precise spectroscopic single-molecule analysis in broader cell biology and material science applications.

    more » « less