skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Multicolor multifocal 3D microscopy using in-situ optimization of a spatial light modulator
Abstract Multifocal microscopy enables high-speed three-dimensional (3D) volume imaging by using a multifocal grating in the emission path. This grating is typically designed to afford a uniform illumination of multifocal subimages for a single emission wavelength. Using the same grating for multicolor imaging results in non-uniform subimage intensities in emission wavelengths for which the grating is not designed. This has restricted multifocal microscopy applications for samples having multicolored fluorophores. In this paper, we present a multicolor multifocal microscope implementation which uses a Spatial Light Modulator (SLM) as a single multifocal grating to realize near-uniform multifocal subimage intensities across multiple wavelength emission bands. Using real-time control of an in-situ-optimized SLM implemented as a multifocal grating, we demonstrate multicolor multifocal 3D imaging over three emission bands by imaging multicolored particles as well as Escherichia coli ( E. coli ) interacting with human liver cancer cells, at $$\sim 2.5$$ ∼ 2.5 multicolor 3D volumes per second acquisition speed. Our multicolor multifocal method is adaptable across SLM hardware, emission wavelength band locations and number of emission bands, making it particularly suited for researchers investigating fast processes occurring across a volume where multiple species are involved.  more » « less
Award ID(s):
1734030
PAR ID:
10429928
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Scientific Reports
Volume:
12
Issue:
1
ISSN:
2045-2322
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Brown, Thomas G.; Wilson, Tony; Waller, Laura (Ed.)
    Multifocal microscopes (MFMs) are becoming increasingly popular in fluorescence microscopy due to their high speed three-dimensional (3D) imaging capabilities. Conventional MFMs use a fixed fabricated grating as the multifocal grating but these are limited to a restricted wavelength range and a fixed object-plane separation. Spatial light modulators (SLMs) represent an alternative to fabricated gratings due to their real-time programmability, providing complete control over emission wavelength range and object plane separations. However, algorithms commonly used to obtain multifocal grating patterns which provide uniform intensity across the subimages are not directly applicable to SLM-based MFMs due to inherent pixel-to-pixel crosstalk effects present in the SLM chip. We recently developed an in-situ iterative algorithm which generates grating patterns that provide near-uniform illumination of the subimages in SLM-based MFMs. This algorithm is universal across wavelengths, object-plane separations, and SLM manufacturers. As part of our efforts to develop an SLM-based MFM that can respond rapidly to changing experimental parameters, we implement a gradient descent-based optimization method. We evaluate its performance in comparison with a grid search based routine. Experimental results obtained on a custom-made SLM-based MFM indicate that the grid-search optimized grating patterns provide superior subimage intensity uniformity versus the gradient-descent method. These experiments also provide an insight into the energy landscape involved in these optimizations. This study increases the utility of SLM-based MFMs in high-speed imaging. 
    more » « less
  2. Spectroscopic single-molecule localization microscopy (sSMLM) simultaneously provides spatial localization and spectral information of individual single-molecules emission, offering multicolor super-resolution imaging of multiple molecules in a single sample with the nanoscopic resolution. However, this technique is limited by the requirements of acquiring a large number of frames to reconstruct a super-resolution image. In addition, multicolor sSMLM imaging suffers from spectral cross-talk while using multiple dyes with relatively broad spectral bands that produce cross-color contamination. Here, we present a computational strategy to accelerate multicolor sSMLM imaging. Our method uses deep convolution neural networks to reconstruct high-density multicolor super-resolution images from low-density, contaminated multicolor images rendered using sSMLM datasets with much fewer frames, without compromising spatial resolution. High-quality, super-resolution images are reconstructed using up to 8-fold fewer frames than usually needed. Thus, our technique generates multicolor super-resolution images within a much shorter time, without any changes in the existing sSMLM hardware system. Two-color and three-color sSMLM experimental results demonstrate superior reconstructions of tubulin/mitochondria, peroxisome/mitochondria, and tubulin/mitochondria/peroxisome in fixed COS-7 and U2-OS cells with a significant reduction in acquisition time. 
    more » « less
  3. Single-shot 3D optical microscopy that can capture high-resolution information over a large volume has broad applications in biology. Existing 3D imaging methods using point-spread-function (PSF) engineering often have limited depth of field (DOF) or require custom and often complex design of phase masks. We propose a new, to the best of our knowledge, PSF approach that is easy to implement and offers a large DOF. The PSF appears to be axially V-shaped, engineered by replacing the conventional tube lens with a pair of axicon lenses behind the objective lens of a wide-field microscope. The 3D information can be reconstructed from a single-shot image using a deep neural network. Simulations in a 10× magnification wide-field microscope show the V-shaped PSF offers excellent 3D resolution (<2.5 µm lateral and ∼15 µm axial) over a ∼350 µm DOF at a 550 nm wavelength. Compared to other popular PSFs designed for 3D imaging, the V-shaped PSF is simple to deploy and provides high 3D reconstruction quality over an extended DOF. 
    more » « less
  4. The intrinsic fluorescence of bacterial samples has a proven potential for label-free bacterial characterization, monitoring bacterial metabolic functions, and as a mechanism for tracking the transport of relevant components through vesicles. The reduced scattering and axial confinement of the excitation offered by multiphoton imaging can be used to overcome some of the limitations of single-photon excitation (e.g., scattering and out-of-plane photobleaching) to the imaging of bacterial communities. In this work, we demonstrate in vivo multi-photon microscopy imaging of Streptomyces bacterial communities, based on the excitation of blue endogenous fluorophores, using an ultrafast Yb-fiber laser amplifier. Its parameters, such as the pulse energy, duration, wavelength, and repetition rate, enable in vivo multicolor imaging with a single source through the simultaneous two- and three-photon excitation of different fluorophores. Three-photon excitation at 1040 nm allows fluorophores with blue and green emission spectra to be addressed (and their corresponding ultraviolet and blue single-photon excitation wavelengths, respectively), and two-photon excitation at the same wavelength allows fluorophores with yellow, orange, or red emission spectra to be addressed (and their corresponding green, yellow, and orange single-photon excitation wavelengths). We demonstrate that three-photon excitation allows imaging over a depth range of more than 6 effective attenuation lengths to take place, corresponding to an 800 micrometer depth of imaging, in samples with a high density of fluorescent structures. 
    more » « less
  5. By manipulating the spectral dispersion of detected photons, spectroscopic single-molecule localization microscopy (sSMLM) permits concurrent high-throughput single-molecular spectroscopic analysis and imaging. Despite its promising potential, using discrete optical components and managing the delicate balance between spectral dispersion and spatial localization compromise its performance, including non-uniform spectral dispersion, high transmission loss of grating, high optical alignment demands, and reduced precision. We designed a dual-wedge prism (DWP)-based monolithic imaging spectrometer to overcome these challenges. We optimized the DWP for spectrally dispersing focused beam without deviation and with minimal wavefront error. We integrated all components into a compact assembly, minimizing total transmission loss and significantly reducing optical alignment requirements. We show the feasibility of DWP using ray-tracing and numerical simulations. We validated our numerical simulations by experimentally imaging individual nanospheres and confirmed that DWP-sSMLM achieved much improved spatial and spectral precisions of grating-based sSMLM. We also demonstrated DWP-sSMLM in 3D multi-color imaging of cells. 
    more » « less