skip to main content


Title: Multi-modal image sharpening in fourier transform infrared (FTIR) microscopy
Mid-infrared Spectroscopic Imaging (MIRSI) provides spatially-resolved molecular specificity by measuring wavelength-dependent mid-infrared absorbance. Infrared microscopes use large numerical aperture objectives to obtain high-resolution images of heterogeneous samples. However, the optical resolution is fundamentally diffraction-limited, and therefore wavelength-dependent. This significantly limits resolution in infrared microscopy, which relies on long wavelengths (2.5 μm to 12.5 μm) for molecular specificity. The resolution is particularly restrictive in biomedical and materials applications, where molecular information is encoded in the fingerprint region (6 μm to 12 μm), limiting the maximum resolving power to between 3 μm and 6 μm. We present an unsupervised curvelet-based image fusion method that overcomes limitations in spatial resolution by augmenting infrared images with label-free visible microscopy. We demonstrate the effectiveness of this approach by fusing images of breast and ovarian tumor biopsies acquired using both infrared and dark-field microscopy. The proposed fusion algorithm generates a hyperspectral dataset that has both high spatial resolution and good molecular contrast. We validate this technique using multiple standard approaches and through comparisons to super-resolved experimentally measured photothermal spectroscopic images. We also propose a novel comparison method based on tissue classification accuracy.  more » « less
Award ID(s):
1943455
NSF-PAR ID:
10318972
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
The Analyst
Volume:
146
Issue:
15
ISSN:
0003-2654
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Chemical imaging, especially mid-infrared spectroscopic microscopy, enables label-free biomedical analyses while achieving expansive molecular sensitivity. However, its slow speed and poor image quality impede widespread adoption. We present a microscope that provides high-throughput recording, low noise, and high spatial resolution where the bottom-up design of its optical train facilitates dual-axis galvo laser scanning of a diffraction-limited focal point over large areas using custom, compound, infinity-corrected refractive objectives. We demonstrate whole-slide, speckle-free imaging in ~3 min per discrete wavelength at 10× magnification (2 μm/pixel) and high-resolution capability with its 20× counterpart (1 μm/pixel), both offering spatial quality at theoretical limits while maintaining high signal-to-noise ratios (>100:1). The data quality enables applications of modern machine learning and capabilities not previously feasible – 3D reconstructions using serial sections, comprehensive assessments of whole model organisms, and histological assessments of disease in time comparable to clinical workflows. Distinct from conventional approaches that focus on morphological investigations or immunostaining techniques, this development makes label-free imaging of minimally processed tissue practical.

     
    more » « less
  2. Spectroscopic image data has provided molecular discrimination for numerous fields including: remote sensing, food safety and biomedical imaging. Despite the various technologies for acquiring spectral data, there remains a trade-off when acquiring data. Typically, spectral imaging either requires long acquisition times to collect an image stack with high spectral specificity or acquisition times are shortened at the expense of fewer spectral bands or reduced spatial sampling. Hence, new spectral imaging microscope platforms are needed to help mitigate these limitations. Fluorescence excitation-scanning spectral imaging is one such new technology, which allows more of the emitted signal to be detected than comparable emission-scanning spectral imaging systems. Here, we have developed a new optical geometry that provides spectral illumination for use in excitation-scanning spectral imaging microscope systems. This was accomplished using a wavelength-specific LED array to acquire spectral image data. Feasibility of the LED-based spectral illuminator was evaluated through simulation and benchtop testing and assessment of imaging performance when integrated with a widefield fluorescence microscope. Ray tracing simulations (TracePro) were used to determine optimal optical component selection and geometry. Spectral imaging feasibility was evaluated using a series of 6-label fluorescent slides. The LED-based system response was compared to a previously tested thin-film tunable filter (TFTF)-based system. Spectral unmixing successfully discriminated all fluorescent components in spectral image data acquired from both the LED and TFTF systems. Therefore, the LED-based spectral illuminator provided spectral image data sets with comparable information content so as to allow identification of each fluorescent component. These results provide proof-of-principle demonstration of the ability to combine output from many discrete wavelength LED sources using a double-mirror (Cassegrain style) optical configuration that can be further modified to allow for high speed, video-rate spectral image acquisition. Real-time spectral fluorescence microscopy would allow monitoring of rapid cell signaling processes (i.e., Ca2+and other second messenger signaling) and has potential to be translated to clinical imaging platforms.

     
    more » « less
  3. Collagen quantity and integrity play an important role in understanding diseases such as myelofibrosis (MF). Label-free mid-infrared spectroscopic imaging (MIRSI) has the potential to quantify collagen while minimizing the subjective variance observed with conventional histopathology. Infrared (IR) spectroscopy with polarization sensitivity provides chemical information while also estimating tissue dichroism. This can potentially aid MF grading by revealing the structure and orientation of collagen fibers. Simultaneous measurement of collagen structure and biochemical properties can translate clinically into improved diagnosis and enhance our understanding of disease progression. In this paper, we present the first report of polarization-dependent spectroscopic variations in collagen from human bone marrow samples. We build on prior work with animal models and extend it to human clinical biopsies with a practical method for high-resolution chemical and structural imaging of bone marrow on clinical glass slides. This is done using a new polarization-sensitive photothermal mid-infrared spectroscopic imaging scheme that enables sample and source independent polarization control. This technology provides 0.5 µm spatial resolution, enabling the identification of thin (≈1 µm) collagen fibers that were not separable using Fourier Transform Infrared (FT-IR) imaging in the fingerprint region at diffraction-limited resolution ( ≈ 5 µm). Finally, we propose quantitative metrics to identify fiber orientation from discrete band images (amide I and amide II) measured under three polarizations. Previous studies have used a pair of orthogonal polarization measurements, which is insufficient for clinical samples since human bone biopsies contain collagen fibers with multiple orientations. Here, we address this challenge and demonstrate that three polarization measurements are necessary to resolve orientation ambiguity in clinical bone marrow samples. This is also the first study to demonstrate the ability to spectroscopically identify thin collagen fibers (≈1 µm diameter) and their orientations, which is critical for accurate grading of human bone marrow fibrosis.

     
    more » « less
  4. Abstract

    Optical transmission and scattering spectroscopic microscopy at the visible and adjacent wavelengths denote one of the most informative and inclusive characterization methods in material research. Unfortunately, restricted by the diffraction limit of light, it cannot resolve the nanoscale variation in light absorption and scattering, diagnostics of the local inhomogeneity in material structure and properties. Moreover, a large quantity of nanomaterials has anisotropic optical properties that are appealing yet hard to characterize through conventional optical methods. There is an increasing demand to extend the optical hyperspectral imaging into the nanometer length scale. In this work, we report a super-resolution hyperspectral imaging technique that uses a nanoscale white light source generated by superfocusing the light from a tungsten-halogen lamp to simultaneously obtain optical transmission and scattering spectroscopic images. A 6-nm spatial resolution in the visible to near-infrared wavelength regime (415–980 nm) is demonstrated on an individual single-walled carbon nanotube (SW-CNT). Both the longitudinal and transverse optical electronic transitions are measured, and the SW-CNT chiral indices can be identified. The band structure modulation in a SW-CNT through strain engineering is mapped.

     
    more » « less
  5. Abstract

    The coupling of terahertz optical techniques to scattering-type scanning near-field microscopy (s-SNOM) has recently emerged as a valuable new paradigm for probing the properties of semiconductors and other materials on the nanoscale. Researchers have demonstrated a family of related techniques, including terahertz nanoscopy (elastic scattering, based on linear optics), time-resolved methods, and nanoscale terahertz emission spectroscopy. However, as with nearly all examples of s-SNOM since the technique’s inception in the mid-1990s, the wavelength of the optical source coupled to the near-field tip is long, usually at energies of 2.5 eV or less. Challenges in coupling of shorter wavelengths (i.e., blue light) to the nanotip has greatly inhibited the study of nanoscale phenomena in wide bandgap materials such as Si and GaN. Here, we describe the first experimental demonstration of s-SNOM using blue light. With femtosecond pulses at 410 nm, we generate terahertz pulses directly from bulk silicon, spatially resolved with nanoscale resolution, and show that these signals provide spectroscopic information that cannot be obtained using near-infrared excitation. We develop a new theoretical framework to account for this nonlinear interaction, which enables accurate extraction of material parameters. This work establishes a new realm of possibilities for the study of technologically relevant wide-bandgap materials using s-SNOM methods.

     
    more » « less