skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.
Attention:The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 7:00 AM ET to 7:30 AM ET on Friday, April 24 due to maintenance. We apologize for the inconvenience.


Title: Geometric super-resolution on push-broom hyperspectral imaging for plasma optical emission spectroscopy
Push-broom hyperspectral imaging (Pb-HSI) is a powerful technique for obtaining the spectral information along with the spatial information simultaneously for various applications, from remote sensing to chemical imaging. Spatial resolution improvement is beneficial in many instances; however, typical solutions suffer from the limitation of geometric extent, lowered light throughput, or reduced field-of-view (FOV). Sub-pixel shifting (SPS) acquires higher-resolution images, compared to typical imaging approaches, from the deconvolution of low-resolution images acquired with a higher sampling rate. Furthermore, SPS is particularly suited for Pb-HSI due to its scanning nature. In this study, an SPS approach is developed and implemented on a Pb-HSI system for plasma optical emission spectroscopy. The preliminary results showed that a periodic deconvolution error was generated in the final SPS Pb-HSI images. The periodic error was traced back to random noise present in the raw/convoluted SPS data and its frequency displays an inverse relationship with the number of sub-pixel samples acquired. Computer modelled data allows studying the effect of varying the relative standard deviation (RSD) in the raw/convoluted SPS data on the final reconstructed SPS images and optimization of noise filtering. The optimized SPS Pb-HSI technique was used to acquire the line-of-sight integrated optical emission maps from an atmospheric pressure micro-capillary dielectric barrier discharge (μDBD). The selected plasma species of interest (He, I, N 2 , N 2 + , and O) yield some insight into the underlying mechanisms. The SPS Pb-HSI technique developed here will allow implementing geometric super-resolution in many applications, for example, it will be used for extracting radially resolved information from Abel's inversion protocols, where improved fitting is expected due to the increase in resolution/data points.  more » « less
Award ID(s):
1610849
PAR ID:
10074762
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Journal of Analytical Atomic Spectrometry
ISSN:
0267-9477
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Optical emission spectroscopy (OES) imaging is often used for diagnostics for better understanding of the underlying mechanisms of plasmas. Typical spectral images, however, contain intensity maps that are integrated along the line-of-sight. A widespread method to extract the radial information is Abel's inversion, but most approaches result in accumulation of error toward the plasma axial position, which is often the region of most interest. Here, a Fourier-transform based Abel's inversion algorithm, which spreads the error evenly across the radial profile, is optimized for OES images collected on a push-broom hyperspectral imaging system (PbHSI). Furthermore, a sub-pixel shifting (SPS) sampling protocol is employed on the PbHSI in the direction of the radial reconstruction to allow improved fidelity from the increased number of data points. The accuracy and fidelity of the protocol are characterized and optimized with a software-based 3-dimensional hyperspectral model datacube. A systematic study of the effects of varying levels of representative added noise, different noise filters, number of data points and cosine expansions used in the inversion, as well as the spatial intensity distribution shapes of the radial profile are presented. A 3D median noise filter with 3-pixel radius, a minimum of 50 points and 8 cosine expansions is needed to keep the relative root mean squared error (rRMSE) <8%. The optimized protocol is implemented for the first time on OES images of a micro-capillary dielectric barrier discharge (μDBD) source obtained via SPS PbHSI system and the extracted radial emission of different plasma species (He, N 2 , N 2 + ) are shown. 
    more » « less
  2. Hyperspectral imaging (HSI) is a spectroscopic technique which captures images at a high contrast over a wide range of wavelengths to show pixel specific composition. Traditional uses of HSI include: satellite imagery, food distribution quality control and digital archaeological reconstruction. Our lab has focused on developing applications of HSI fluorescence imaging systems to study molecule-specific detection for rapid cell signaling events or real-time endoscopic screening. Previously, we have developed a prototype spectral light source, using our modified imaging technique, excitationscanning hyperspectral imaging (HIFEX), coupled to a commercial colonoscope for feasibility testing. The 16 wavelength LED array was combined, using a multi-branched solid light guide, to couple to the scope’s optical input. The prototype acquired a spectral scan at near video-rate speeds (~8 fps). The prototype could operate at very rapid wavelength switch speeds, limited to the on/off rates of the LEDs (~10 μs), but imaging speed was limited due to optical transmission losses (~98%) through the solid light guide. Here we present a continuation of our previous work in performing an in-depth analysis of the solid light guide to optimize the optical intensity throughput. The parameters evaluated include: LED intensity input, geometry (branch curvature and combination) and light propagation using outer claddings. Simulations were conducted using a Monte Carlo ray tracing software (TracePro). Results show that transmission within the branched light guide may be optimized through LED focusing lenses, bend radii and smooth tangential branch merges. Future work will test a new fabricated light guide from the optimized model framework. 
    more » « less
  3. Background Structured illumination microscopy (SIM) is a family of methods in optical fluorescence microscopy that can achieve both optical sectioning and super-resolution effects. SIM is a valuable method for high-resolution imaging of fixed cells or tissues labeled with conventional fluorophores, as well as for imaging the dynamics of live cells expressing fluorescent protein constructs. In SIM, one acquires a set of images with shifting illumination patterns. This set of images is subsequently treated with image analysis algorithms to produce an image with reduced out-of-focus light (optical sectioning) and/or with improved resolution (super-resolution). Findings Five complete, freely available SIM datasets are presented including raw and analyzed data. We report methods for image acquisition and analysis using open-source software along with examples of the resulting images when processed with different methods. We processed the data using established optical sectioning SIM and super-resolution SIM methods and with newer Bayesian restoration approaches that we are developing. Conclusions Various methods for SIM data acquisition and processing are actively being developed, but complete raw data from SIM experiments are not typically published. Publically available, high-quality raw data with examples of processed results will aid researchers when developing new methods in SIM. Biologists will also find interest in the high-resolution images of animal tissues and cells we acquired. All of the data were processed with SIMToolbox, an open-source and freely available software solution for SIM. 
    more » « less
  4. Point scanning imaging systems (e.g. scanning electron or laser scanning confocal microscopes) are perhaps the most widely used tools for high resolution cellular and tissue imaging. Like all other imaging modalities, the resolution, speed, sample preservation, and signal-to-noise ratio (SNR) of point scanning systems are difficult to optimize simultaneously. In particular, point scanning systems are uniquely constrained by an inverse relationship between imaging speed and pixel resolution. Here we show these limitations can be miti gated via the use of deep learning-based super-sampling of undersampled images acquired on a point-scanning system, which we termed point -scanning super-resolution (PSSR) imaging. Oversampled ground truth images acquired on scanning electron or Airyscan laser scanning confocal microscopes were used to generate semi-synthetictrain ing data for PSSR models that were then used to restore undersampled images. Remarkably, our EM PSSR model was able to restore undersampled images acquired with different optics, detectors, samples, or sample preparation methods in other labs . PSSR enabled previously unattainable xy resolution images with our serial block face scanning electron microscope system. For fluorescence, we show that undersampled confocal images combined with a multiframe PSSR model trained on Airyscan timelapses facilitates Airyscan-equivalent spati al resolution and SNR with ~100x lower laser dose and 16x higher frame rates than corresponding high-resolution acquisitions. In conclusion, PSSR facilitates point-scanning image acquisition with otherwise unattainable resolution, speed, and sensitivity. 
    more » « less
  5. Protein mass spectrometry imaging (MSI) with electrospray-based ambient ionization techniques, such as nanospray-desorption electrospray ionization (nano-DESI), generates datasets in which each pixel corresponds to a mass spectrum populated by peaks corresponding to multiply-charged protein ions. Importantly, the signal associated with each protein is split among multiple charge states. These peaks can be transformed into the mass domain by spectral deconvolution. When proteins are imaged under native/non-denaturing conditions to retain non-covalent interactions, deconvolution is particularly valuable in helping interpret the data. To improve acquisition speed, signal-to-noise ratio, and sensitivity, native MSI is usually performed using mass resolving powers that do not provide isotopic resolution, and conventional algorithms for deconvolution of lower-resolution data are not suitable for these large data sets. UniDec was originally developed to enable rapid deconvolution of complex protein mass spectra. Here, we developed an updated feature set harnessing the high-throughput module, MetaUniDec, to deconvolve each pixel of native MSI datasets and transform m/z-domain image files to the mass domain. New tools enable reading, processing, and output of open format .imzML files for downstream analysis. Transformation of data into the mass domain also provides greater accessibility, with mass information readily interpretable by users of established protein biology tools such as SDS-PAGE. 
    more » « less