skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Multi-modal image sharpening in fourier transform infrared (FTIR) microscopy
Mid-infrared Spectroscopic Imaging (MIRSI) provides spatially-resolved molecular specificity by measuring wavelength-dependent mid-infrared absorbance. Infrared microscopes use large numerical aperture objectives to obtain high-resolution images of heterogeneous samples. However, the optical resolution is fundamentally diffraction-limited, and therefore wavelength-dependent. This significantly limits resolution in infrared microscopy, which relies on long wavelengths (2.5 μm to 12.5 μm) for molecular specificity. The resolution is particularly restrictive in biomedical and materials applications, where molecular information is encoded in the fingerprint region (6 μm to 12 μm), limiting the maximum resolving power to between 3 μm and 6 μm. We present an unsupervised curvelet-based image fusion method that overcomes limitations in spatial resolution by augmenting infrared images with label-free visible microscopy. We demonstrate the effectiveness of this approach by fusing images of breast and ovarian tumor biopsies acquired using both infrared and dark-field microscopy. The proposed fusion algorithm generates a hyperspectral dataset that has both high spatial resolution and good molecular contrast. We validate this technique using multiple standard approaches and through comparisons to super-resolved experimentally measured photothermal spectroscopic images. We also propose a novel comparison method based on tissue classification accuracy.  more » « less
Award ID(s):
1943455
PAR ID:
10318972
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
The Analyst
Volume:
146
Issue:
15
ISSN:
0003-2654
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Chemical imaging, especially mid-infrared spectroscopic microscopy, enables label-free biomedical analyses while achieving expansive molecular sensitivity. However, its slow speed and poor image quality impede widespread adoption. We present a microscope that provides high-throughput recording, low noise, and high spatial resolution where the bottom-up design of its optical train facilitates dual-axis galvo laser scanning of a diffraction-limited focal point over large areas using custom, compound, infinity-corrected refractive objectives. We demonstrate whole-slide, speckle-free imaging in ~3 min per discrete wavelength at 10× magnification (2 μm/pixel) and high-resolution capability with its 20× counterpart (1 μm/pixel), both offering spatial quality at theoretical limits while maintaining high signal-to-noise ratios (>100:1). The data quality enables applications of modern machine learning and capabilities not previously feasible – 3D reconstructions using serial sections, comprehensive assessments of whole model organisms, and histological assessments of disease in time comparable to clinical workflows. Distinct from conventional approaches that focus on morphological investigations or immunostaining techniques, this development makes label-free imaging of minimally processed tissue practical. 
    more » « less
  2. Mid-infrared microscopy is an important tool for biological analyses, allowing a direct probe of molecular bonds in their low energy landscape. In addition to the label-free extraction of spectroscopic information, the application of broadband sources can provide a third dimension of chemical specificity. However, to enable widespread deployment, mid-infrared microscopy platforms need to be compact and robust while offering high speed, broad bandwidth, and high signal-to-noise ratio. In this study, we experimentally showcase the integration of a broadband, high-repetition-rate dual-comb spectrometer (DCS) in the mid-infrared range with a scanning microscope. We employ a set of 1-GHz mid-infrared frequency combs, demonstrating their capability for high-speed and broadband hyperspectral imaging of polymers and ovarian tissue. The system covers 1000 cm−1 at νc = 2941 cm−1 with 12.86 kHz spectra acquisition rate and 5 µm spatial resolution. Taken together, our experiments and analysis elucidate the trade-off between bandwidth and speed in DCS as it relates to microscopy. This provides a roadmap for the future advancement and application of high-repetition-rate DCS hyperspectral imaging. 
    more » « less
  3. We model laser filamentation in ZnSe in the mid-infrared (Mid-IR, wavelengths λ = 4 and 6 μm) and the long-wavelength infrared (LWIR, λ = 8 and 10 μm) using carrier-resolved unidirectional pulse propagation equations (UPPE). We predict an unprecedented propagation regime at λ = 8 μm that supports light bullets, which are spatio-temporally non-spreading electromagnetic pulses. Furthermore, in contrast to the previous report in air in the mid-IR, we predict that LWIR light bullets in solids critically rely on plasma-mediated dispersion, which dynamically evolves during multiphoton and tunneling ionization as peak plasma densities reach ρ 6.6 ×10^18 cm-3 . Finally, the plasma-assisted light bullets propagate with sub-cycle pulse durations and peak intensities I = 1.1 ×10^12 W /cm^2 , making them useful for high-harmonic generation and attosecond pulse generation. 
    more » « less
  4. Messinger, David W.; Velez-Reyes, Miguel (Ed.)
    Recently, multispectral and hyperspectral data fusion models based on deep learning have been proposed to generate images with a high spatial and spectral resolution. The general objective is to obtain images that improve spatial resolution while preserving high spectral content. In this work, two deep learning data fusion techniques are characterized in terms of classification accuracy. These methods fuse a high spatial resolution multispectral image with a lower spatial resolution hyperspectral image to generate a high spatial-spectral hyperspectral image. The first model is based on a multi-scale long short-term memory (LSTM) network. The LSTM approach performs the fusion using a multiple step process that transitions from low to high spatial resolution using an intermediate step capable of reducing spatial information loss while preserving spectral content. The second fusion model is based on a convolutional neural network (CNN) data fusion approach. We present fused images using four multi-source datasets with different spatial and spectral resolutions. Both models provide fused images with increased spatial resolution from 8m to 1m. The obtained fused images using the two models are evaluated in terms of classification accuracy on several classifiers: Minimum Distance, Support Vector Machines, Class-Dependent Sparse Representation and CNN classification. The classification results show better performance in both overall and average accuracy for the images generated with the multi-scale LSTM fusion over the CNN fusion 
    more » « less
  5. For decades, infrared (IR) spectroscopy has advanced on two distinct frontiers: enhancing spatial resolution and broadening spectroscopic information. Although atomic force microscopy (AFM)-based IR microscopy overcomes Abbe’s diffraction limit and reaches sub-10 nm spatial resolutions, time-domain two-dimensional IR spectroscopy (2DIR) provides insights into molecular structures, mode coupling and energy transfers. Here we bridge the boundary between these two techniques and develop AFM-2DIR nanospectroscopy. Our method offers the spatial precision of AFM in combination with the rich spectroscopic information provided by 2DIR. This approach mechanically detects the sample’s photothermal responses to a tip-enhanced femtosecond IR pulse sequence and extracts spatially resolved spectroscopic information via FFTs. In a proof-of-principle experiment, we elucidate the anharmonicity of a carbonyl vibrational mode. Further, leveraging the near-field photons’ high momenta from the tip enhancement for phase matching, we photothermally probe hyperbolic phonon polaritons in isotope-enriched h10BN. Our measurements unveil an energy transfer between phonon polaritons and phonons, as well as among different polariton modes, possibly aided by scattering at interfaces. The AFM-2DIR nanospectroscopy enables the in situ investigations of vibrational anharmonicity, coupling and energy transfers in heterogeneous materials and nanostructures, especially suitable for unravelling the relaxation process in two-dimensional materials at IR frequencies. 
    more » « less