Capturing fine spatial, spectral, and temporal information of the scene is highly desirable in many applications. However, recording data of such high dimensionality requires significant transmission bandwidth. Current computational imaging methods can partially address this challenge but are still limited in reducing input data throughput. In this paper, we report a video-rate hyperspectral imager based on a single-pixel photodetector which can achieve high-throughput hyperspectral video recording at a low bandwidth. We leverage the insight that 4-dimensional (4D) hyperspectral videos are considerably more compressible than 2D grayscale images. We propose a joint spatial-spectral capturing scheme encoding the scene into highly compressed measurements and obtaining temporal correlation at the same time. Furthermore, we propose a reconstruction method relying on a signal sparsity model in 4D space and a deep learning reconstruction approach greatly accelerating reconstruction. We demonstrate reconstruction of 128 × 128 hyperspectral images with 64 spectral bands at more than 4 frames per second offering a 900× data throughput compared to conventional imaging, which we believe is a first-of-its kind of a single-pixel-based hyperspectral imager.
Measuring the polarization response of a VNIR hyperspectral imager
As the applications of hyperspectral imaging rapidly diversify, the need for accurate radiometric calibration of these imaging systems is becoming increasingly important. When performing radiometric measurements, the polarization response of the imaging system can be of particular interest if the scene contains partially polarized objects. For example, when imaging a scene containing water, surface reflections from the water will be partially polarized, possibly affecting the response of the imaging system. In this paper, the polarization response of a Resonon, Inc. visible near-infrared (VNIR) hyperspectral imaging system is assessed across a spectral range of 400nm to 1000 nm, with a spectral resolution of 2.1 nm. Efforts are currently underway to correct for the observed polarization response of the imaging system.
more »
« less
- Award ID(s):
- 1757351
- NSF-PAR ID:
- 10158910
- Date Published:
- Journal Name:
- Polarization: Measurement, Analysis, and Remote Sensing XIV
- Page Range / eLocation ID:
- 22
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
Abstract -
more » « less
We demonstrate a kilohertz frame rate snapshot hyperspectral imaging system suitable for high-speed imaging, which we name snapshot hyperspectral imager for emission and reactions (SHEAR). This system splits the sensor of a single high-speed camera to simultaneously capture a conventional image and a spectrally sheared response of the scene under study. Given the small, point-source-like nature of burning metal micro-particles, the spectral response of the species is captured without the need for a slit, as is needed in conventional imaging spectrometers. We pair robust image registration techniques with sparse reconstruction algorithms to computationally disentangle overlapping spectra associated with many burning particles over the course of a combustion experiment. As a proof-of-concept experiment, representative physical vapor deposited Al:Zr composite particles are ignited, and their burn evolution is recorded at a frame rate of 2 kHz using this method. We demonstrate operation over two distinct wavelength ranges spanning hundreds of nanometers in wavelength and with sub-nanometer resolution. We are able to track hundreds of individual Al:Zr particles in a single high-speed video, providing ample statistics of burn time, temperature, and AlO emission timing in a high-throughput method. The demonstrated technology is high-throughput, flexible in wavelength, inexpensive, and relatively easy to implement, and provides a much needed tool for
in situ composite metal fuel diagnostics. -
Harmful and nuisance algal blooms are becoming a greater concern to public health, riverine ecosystems, and recreational uses of inland waterways. Algal bloom proliferation has increased in the Upper Clark Fork River due to a combination of warming water temperatures, naturally high phosphorus levels, and an influx of nitrogen from various sources. To improve understanding of bloom dynamics and how they affect water quality, often measured as algal biomass measured through pigment standing crops, a UAV-based hyperspectral imaging system was deployed to monitor several locations along the Upper Clark Fork River in western Montana. Image data were collected across the spectral range of 400–1000 nm with 2.1 nm spectral resolution during two field sampling campaigns in 2021. Included are methods to estimate chl a and phycocyanin standing crops using regression analysis of salient wavelength bands, before and after separating the pigments according to their growth form. Estimates of chl a and phycocyanin standing crops generated through a linear regression analysis are compared to in situ data, resulting in a maximum R2 of 0.96 for estimating fila/epip chl-a and 0.94 when estimating epiphytic phycocyanin. Estimates of pigment standing crops from total abundance, epiphytic, and the sum of filamentous and epiphytic sources are also included, resulting in a promising method for remotely estimating algal standing crops. This method addresses the shortcomings of current monitoring techniques, which are limited in spatial and temporal scale, by proposing a method for rapid collection of high-spatial-resolution pigment abundance estimates.more » « less
-
Rotational dynamics at the molecular level could provide additional data regarding protein diffusion and cytoskeleton formation at the cellular level. Due to the isotropic emission pattern of fluorescence molecules, it is challenging to extract rotational information from them during imaging. Metal nanoparticles show a polarization-dependent response and could be used for sensing rotational motion. Nanoparticles as an orientation sensing probe offer bio-compatibility and robustness against photo-blinking and photo-bleaching compared to conventional fluorescent molecules. Previously, asymmetric geometrical structures such as nanorods have been used for orientational imaging. Here, we show orientational imaging of symmetric geometrical structures such as 100 nm isolated silver nanocubes by coupling a hyperspectral detector and a focused ion beam (FIB)-fabricated correlating substrate. More than 100 nanocubes are analyzed to confirm spectral shifts in the scattering spectra due to variations in the orientation of the nanocubes with respect to the incoming light. Results are further validated using finite-difference time-domain simulations. Our observations suggest a novel strategy for high-throughput orientation imaging of nanoparticles.more » « less
-
Fluorescence imaging microscopy has traditionally been used because of the high specificity that is achievable through fluorescence labeling techniques and optical filtering. When combined with spectral imaging technologies, fluorescence microscopy can allow for quantitative identification of multiple fluorescent labels. We are working to develop a new approach for spectral imaging that samples the fluorescence excitation spectrum and may provide increased signal strength. The enhanced signal strength may be used to provide increased spectral sensitivity and spectral, spatial, and temporal sampling capabilities. A proof of concept excitation scanning system has shown over 10-fold increase in signal to noise ratio compared to emission scanning hyperspectral imaging. Traditional hyperspectral imaging fluorescence microscopy methods often require minutes of acquisition time. We are developing a new configuration that utilizes solid state LEDs to combine multiple illumination wavelengths in a 2-mirror assembly to overcome the temporal limitations of traditional hyperspectral imaging. We have previously reported on the theoretical performance of some of the aspects of this system by using optical ray trace modeling. Here, we present results from prototyping and benchtop testing of the system, including assembly, optical characterization, and data collection. This work required the assembly and characterization of a novel excitation scanning hyperspectral microscopy system, containing 12 LEDs ranging from 365- 425 nm, 12 lenses, a spherical mirror, and a flat mirror. This unique approach may reduce the long image acquisition times seen in traditional hyperspectral imaging while maintaining high specificity and sensitivity for multilabel identification and autofluorescence imaging in real time.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1117/12.2558257
