skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging
Abstract Hyperspectral fluorescence imaging is widely used when multiple fluorescent probes with close emission peaks are required. In particular, Fourier transform imaging spectroscopy (FTIS) provides unrivaled spectral resolution; however, the imaging throughput is very low due to the amount of interferogram sampling required. In this work, we apply deep learning to FTIS and show that the interferogram sampling can be drastically reduced by an order of magnitude without noticeable degradation in the image quality. For the demonstration, we use bovine pulmonary artery endothelial cells stained with three fluorescent dyes and 10 types of fluorescent beads with close emission peaks. Further, we show that the deep learning approach is more robust to the translation stage error and environmental vibrations. Thereby, the He-Ne correction, which is typically required for FTIS, can be bypassed, thus reducing the cost, size, and complexity of the FTIS system. Finally, we construct neural network models using Hyperband, an automatic hyperparameter selection algorithm, and compare the performance with our manually-optimized model.  more » « less
Award ID(s):
1808331
PAR ID:
10319104
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Scientific Reports
Volume:
12
Issue:
1
ISSN:
2045-2322
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, Optica)
    Optical diffraction tomography (ODT) is an indispensable tool for studying objects in three dimensions. Until now, ODT has been limited to coherent light because spatial phase information is required to solve the inverse scattering problem. We introduce a method that enables ODT to be applied to imaging incoherent contrast mechanisms such as fluorescent emission. Our strategy mimics the coherent scattering process with two spatially coherent illumination beams. The interferometric illumination pattern encodes spatial phase in temporal variations of the fluorescent emission, thereby allowing incoherent fluorescent emission to mimic the behavior of coherent illumination. The temporal variations permit recovery of the spatial distribution of fluorescent emission with an inverse scattering model. Simulations and experiments demonstrate isotropic resolution in the 3D reconstruction of a fluorescent object. 
    more » « less
  2. ; ; (, SIAM journal on computing)
    In many situations, sample data is obtained from a noisy or imperfect source. In order to address such corruptions, this paper introduces the concept of a sampling corrector. Such algorithms use structure that the distribution is purported to have, in order to allow one to make “on-the-fly” corrections to samples drawn from probability distributions. These algorithms then act as filters between the noisy data and the end user. We show connections between sampling correctors, distribution learning algorithms, and distribution property testing algorithms. We show that these connections can be utilized to expand the applicability of known distribution learning and property testing algorithms as well as to achieve improved algorithms for those tasks. As a first step, we show how to design sampling correctors using proper learning algorithms. We then focus on the question of whether algorithms for sampling correctors can be more efficient in terms of sample complexity than learning algorithms for the analogous families of distributions. When correcting monotonicity, we show that this is indeed the case when also granted query access to the cumulative distribution function. We also obtain sampling correctors for monotonicity even without this stronger type of access, provided that the distribution be originally very close to monotone (namely, at a distance $$O(1/\log^2 n)$$). In addition to that, we consider a restricted error model that aims at capturing “missing data” corruptions. In this model, we show that distributions that are close to monotone have sampling correctors that are significantly more efficient than achievable by the learning approach. We consider the question of whether an additional source of independent random bits is required by sampling correctors to implement the correction process. We show that for correcting close-to-uniform distributions and close-to-monotone distributions, no additional source of random bits is required, as the samples from the input source itself can be used to produce this randomness. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; ; et al (, Optics Express)
    Multiplexed fluorescence detection has become increasingly important in the fields of biosensing and bioimaging. Although a variety of excitation/detection optical designs and fluorescence unmixing schemes have been proposed to allow for multiplexed imaging, rapid and reliable differentiation and quantification of multiple fluorescent species at each imaging pixel is still challenging. Here we present a pulsed interleaved excitation spectral fluorescence lifetime microscopic (PIE-sFLIM) system that can simultaneously image six fluorescent tags in live cells in a single hyperspectral snapshot. Using an alternating pulsed laser excitation scheme at two different wavelengths and a synchronized 16-channel time-resolved spectral detector, our PIE-sFLIM system can effectively excite multiple fluorophores and collect their emission over a broad spectrum for analysis. Combining our system with the advanced live-cell labeling techniques and the lifetime/spectral phasor analysis, our PIE-sFLIM approach can well unmix the fluorescence of six fluorophores acquired in a single measurement, thus improving the imaging speed in live-specimen investigation. 
    more » « less
  4. ; (, Proceedings of the AAAI Conference on Artificial Intelligence)
    Computational image reconstruction algorithms generally produce a single image without any measure of uncertainty or confidence. Regularized Maximum Likelihood (RML) and feed-forward deep learning approaches for inverse problems typically focus on recovering a point estimate. This is a serious limitation when working with under-determined imaging systems, where it is conceivable that multiple image modes would be consistent with the measured data. Characterizing the space of probable images that explain the observational data is therefore crucial. In this paper, we propose a variational deep probabilistic imaging approach to quantify reconstruction uncertainty. Deep Probabilistic Imaging (DPI) employs an untrained deep generative model to estimate a posterior distribution of an unobserved image. This approach does not require any training data; instead, it optimizes the weights of a neural network to generate image samples that fit a particular measurement dataset. Once the network weights have been learned, the posterior distribution can be efficiently sampled. We demonstrate this approach in the context of interferometric radio imaging, which is used for black hole imaging with the Event Horizon Telescope, and compressed sensing Magnetic Resonance Imaging (MRI). 
    more » « less
  5. ; ; ; ; ; ; ; (, Advanced Functional Materials)
    Abstract Traditional deep fluorescence imaging has primarily focused on red‐shifting imaging wavelengths into the near‐infrared (NIR) windows or implementation of multi‐photon excitation approaches. Here, the advantages of NIR and multiphoton imaging are combined by developing a dual‐infrared two‐photon microscope that enables high‐resolution deep imaging in biological tissues. This study first computationally identifies that photon absorption, as opposed to scattering, is the primary contributor to signal attenuation. A NIR two‐photon microscope is constructed next with a 1640 nm femtosecond pulsed laser and a NIR PMT detector to image biological tissues labeled with fluorescent single‐walled carbon nanotubes (SWNTs). Spatial imaging resolutions are achieved close to the Abbe resolution limit and eliminate blur and background autofluorescence of biomolecules, 300 µm deep into brain slices and through the full 120 µm thickness of aNicotiana benthamianaleaf. NIR‐II two‐photon microscopy can also measure tissue heterogeneity by quantifying how much the fluorescence power law function varies across tissues, a feature this study exploits to distinguish Huntington's Disease afflicted mouse brain tissues from wildtype. These results suggest dual‐infrared two‐photon microscopy can accomplish in‐tissue structural imaging and biochemical sensing with a minimal background, and with high spatial resolution, in optically opaque or highly autofluorescent biological tissues. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email