skip to main content


Title: Autonomous adaptive data acquisition for scanning hyperspectral imaging
Abstract

Non-invasive and label-free spectral microscopy (spectromicroscopy) techniques can provide quantitative biochemical information complementary to genomic sequencing, transcriptomic profiling, and proteomic analyses. However, spectromicroscopy techniques generate high-dimensional data; acquisition of a single spectral image can range from tens of minutes to hours, depending on the desired spatial resolution and the image size. This substantially limits the timescales of observable transient biological processes. To address this challenge and move spectromicroscopy towards efficient real-time spatiochemical imaging, we developed a grid-less autonomous adaptive sampling method. Our method substantially decreases image acquisition time while increasing sampling density in regions of steeper physico-chemical gradients. When implemented with scanning Fourier Transform infrared spectromicroscopy experiments, this grid-less adaptive sampling approach outperformed standard uniform grid sampling in a two-component chemical model system and in a complex biological sample,Caenorhabditis elegans. We quantitatively and qualitatively assess the efficiency of data acquisition using performance metrics and multivariate infrared spectral analysis, respectively.

 
more » « less
NSF-PAR ID:
10202160
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Communications Biology
Volume:
3
Issue:
1
ISSN:
2399-3642
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Substantial numerical difficulties associated with the computational modeling of multiscale global atmospheric chemical transport impose severe limitations on the spatial resolution of nonadaptive fixed grids. The crude spatial discretization introduces a large amount of numerical diffusion into the system, which, in combination with strong flow stretching, causes large numerical errors. To resolve this issue, we have developed an optimized wavelet‐based adaptive mesh refinement (OWAMR) method. The OWAMR is a three‐dimensional adaptive method that introduces a fine grid dynamically only in the regions where small spatial structures occur. The algorithm uses a new two‐parameter adaptation criterion that significantly (by factors between 1.5 and 2.7) reduces the number of grid points compared with the more conventional one‐parameter grid adaptation used by wavelet‐based adaptive techniques and high‐order upwind schemes, which enable one to increase the accuracy of approximation of the advection operator substantially. It has been shown that the method simulates the dynamics of a pollution plume that travels on a global scale, producing less than 3% error. To achieve such accuracy, conventional three‐dimensional nonadaptive techniques would require five orders of magnitude more computational resources. Therefore, the method provides a realistic opportunity to model accurately a variety of the most demanding multiscale problems in the area of atmospheric chemical transport, which are difficult or impossible to simulate on existing computational facilities with conventional fixed‐grid techniques.

     
    more » « less
  2. Traditional fluorescence microscopy is blind to molecular microenvironment information that is present in a fluorescence lifetime, which can be measured by fluorescence lifetime imaging microscopy (FLIM). However, most existing FLIM techniques are slow to acquire and process lifetime images, difficult to implement, and expensive. Here we present instant FLIM, an analog signal processing method that allows real-time streaming of fluorescence intensity, lifetime, and phasor imaging data through simultaneous image acquisition and instantaneous data processing. Instant FLIM can be easily implemented by upgrading an existing two-photon microscope using cost-effective components and our open-source software. We further improve the functionality, penetration depth, and resolution of instant FLIM using phasor segmentation, adaptive optics, and super-resolution techniques. We demonstrate through-skull intravital 3D FLIM of mouse brains to depths of 300 µm and present the firstin vivo4D FLIM of microglial dynamics in intact and injured zebrafish and mouse brains for up to 12 h.

     
    more » « less
  3. Cryogenic electron microscopy (cryo-EM) has become one of the most powerful techniques to reveal the atomic structures and working mechanisms of biological macromolecules. New designs of the cryo-EM grids—aimed at preserving thin, uniform vitrified ice and improving protein adsorption—have been considered a promising approach to achieving higher resolution with the minimal amount of materials and data. Here, we describe a method for preparing graphene cryo-EM grids with up to 99% monolayer graphene coverage that allows for more than 70% grid squares for effective data acquisition with improved image quality and protein density. Using our graphene grids, we have achieved 2.6-Å resolution for streptavidin, with a molecular weight of 52 kDa, from 11,000 particles. Our graphene grids increase the density of examined soluble, membrane, and lipoproteins by at least 5-fold, affording the opportunity for structural investigation of challenging proteins which cannot be produced in large quantity. In addition, our method employs only simple tools that most structural biology laboratories can access. Moreover, this approach supports customized grid designs targeting specific proteins, owing to its broad compatibility with a variety of nanomaterials.

     
    more » « less
  4. Abstract

    Soils with seasonal or continuous water saturation are characterized by unique redox‐related processes including Fe and Mn oxide reduction. Indicators of reduction in soils (IRIS) devices were created as low‐cost, direct sensors of such reduced chemistry. Such IRIS devices are painted with oxides of Fe or Mn, inserted into the soil, and then removed after a period of time; once removed, the paint lost due to reductive dissolution of these oxides is used to indicate the presence, location, and/or intensity of reducing conditions. However, quantifying the paint removal using existing methods can be subjective and time consuming. Here, we describe the use of the IRIS Imager, an image analysis program that calculates removal of paint from IRIS films inL*a*b* color space (whereL* is lightness,a* is red–green value, andb* is blue–yellow value) by comparing the change in lightness between initial and final IRIS film images. Paint removal from films deployed in flooded rice (Oryza sativaL.) paddy soils were quantified using the IRIS Imager, the grid method, and chemical extractions of IRIS films. All three methods were suitable for quantification of paint removal, but the IRIS Imager provided additional statistics to assess heterogeneity in paint removal on individual films and a less subjective approach to quantifying Mn oxide paint removal when Fe oxidation on Mn films was present. This free software can be used with IRIS devices to reproducibly measure paint removal from Fe oxide and Mn oxide IRIS and Fe oxide precipitation on Mn oxide IRIS.

     
    more » « less
  5. Abstract

    Label-free optical microscopy has matured as a noninvasive tool for biological imaging; yet, it is criticized for its lack of specificity, slow acquisition and processing times, and weak and noisy optical signals that lead to inaccuracies in quantification. We introduce FOCALS (Fast Optical Coherence, Autofluorescence Lifetime imaging, and Second harmonic generation) microscopy capable of generating NAD(P)H fluorescence lifetime, second harmonic generation (SHG), and polarization-sensitive optical coherence microscopy (OCM) images simultaneously. Multimodal imaging generates quantitative metabolic and morphological profiles of biological samples in vitro, ex vivo, and in vivo. Fast analog detection of fluorescence lifetime and real-time processing on a graphical processing unit enables longitudinal imaging of biological dynamics. We detail the effect of optical aberrations on the accuracy of FLIM beyond the context of undistorting image features. To compensate for the sample-induced aberrations, we implemented a closed-loop single-shot sensorless adaptive optics solution, which uses computational adaptive optics of OCM for wavefront estimation within 2 s and improves the quality of quantitative fluorescence imaging in thick tissues. Multimodal imaging with complementary contrasts improves the specificity and enables multidimensional quantification of the optical signatures in vitro, ex vivo, and in vivo, fast acquisition and real-time processing improve imaging speed by 4–40 × while maintaining enough signal for quantitative nonlinear microscopy, and adaptive optics improves the overall versatility, which enable FOCALS microscopy to overcome the limits of traditional label-free imaging techniques.

     
    more » « less