Capturing fine spatial, spectral, and temporal information of the scene is highly desirable in many applications. However, recording data of such high dimensionality requires significant transmission bandwidth. Current computational imaging methods can partially address this challenge but are still limited in reducing input data throughput. In this paper, we report a video-rate hyperspectral imager based on a single-pixel photodetector which can achieve high-throughput hyperspectral video recording at a low bandwidth. We leverage the insight that 4-dimensional (4D) hyperspectral videos are considerably more compressible than 2D grayscale images. We propose a joint spatial-spectral capturing scheme encoding the scene into highly compressed measurements and obtaining temporal correlation at the same time. Furthermore, we propose a reconstruction method relying on a signal sparsity model in 4D space and a deep learning reconstruction approach greatly accelerating reconstruction. We demonstrate reconstruction of 128 × 128 hyperspectral images with 64 spectral bands at more than 4 frames per second offering a 900× data throughput compared to conventional imaging, which we believe is a first-of-its kind of a single-pixel-based hyperspectral imager.
We introduce perturbative spatial frequency domain imaging (p-SFDI) for fast two-dimensional (2D) mapping of the optical properties and physiological characteristics of skin and cutaneous microcirculation using spatially modulated visible light. Compared to the traditional methods for recovering 2D maps through a pixel-by-pixel inversion, p-SFDI significantly shortens parameter retrieval time, largely avoids the random fitting errors caused by measurement noise, and enhances the image reconstruction quality. The efficacy of p-SFDI is demonstrated by
- NSF-PAR ID:
- 10304602
- Publisher / Repository:
- Optical Society of America
- Date Published:
- Journal Name:
- Biomedical Optics Express
- Volume:
- 12
- Issue:
- 10
- ISSN:
- 2156-7085
- Page Range / eLocation ID:
- Article No. 6143
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
Abstract -
more » « less
We present a dynamic microcirculation PIPE model for functional neuroimaging, non-neuroimaging, and coherent hemodynamics spectroscopy. The temporal evolution of the concentration and oxygen saturation of hemoglobin in tissue, comprised of the contributions from the arterioles, capillaries, and venules of microvasculature, is determined by time-resolved hemodynamic and metabolic variations in blood volume, flow velocity, and oxygen consumption with a fluid mechanics treatment. Key parameters regarding microcirculation can be assessed, including the effective blood transit times through the capillaries and the venules, and the rate constant of oxygen release from hemoglobin to tissue. The vascular autoregulation can further be quantified from the relationship between the resolved blood volume and flow velocity variations. The PIPE model shows excellent agreement with the experimental cerebral and cutaneous coherent hemodynamics spectroscopy (CHS) and fMRI-BOLD data. It further identifies the impaired cerebral autoregulation distinctively in hemodialysis patients compared to healthy subjects measured by CHS. This new dynamic microcirculation PIPE model provides a valuable tool for brain and other functional studies with hemodynamic-based techniques. It is instrumental in recovering physiological parameters from analyzing and interpreting the signals measured by hemodynamic-based neuroimaging and non-neuroimaging techniques such as functional near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI) in response to brain activation, physiological challenges, or physical maneuvers.
-
more » « less
Spatial frequency modulation imaging (SPIFI) provides a simple architecture for modulating an extended illumination source that is compatible with single pixel imaging. We demonstrate wavelength domain SPIFI (WD-SPIFI) by encoding time-varying spatial frequencies in the spectral domain that can produce enhanced resolution images, like its spatial domain counterpart, spatial domain (SD) SPIFI. However, contrary to SD-SPIFI, WD-SPIFI enables remote delivery by single mode fiber, which can be attractive for applications where free-space imaging is not practical. Finally, we demonstrate a cascaded system incorporating WD-SPIFI in-line with SD-SPIFI enabling single pixel 2D imaging without any beam or sample scanning.
-
more » « less
Camera-based physiological measurement enables vital signs to be captured unobtrusively without contact with the body. Remote, or imaging, photoplethysmography involves recovering peripheral blood flow from subtle variations in video pixel intensities. While the pulse signal might be easy to obtain from high quality uncompressed videos, the signal-to-noise ratio drops dramatically with video bitrate. Uncompressed videos incur large file storage and data transfer costs, making analysis, manipulation and sharing challenging. To help address these challenges, we use compression specific supervised models to mitigate the effect of temporal video compression on heart rate estimates. We perform a systematic evaluation of the performance of state-of-the-art algorithms across different levels, and formats, of compression. We demonstrate that networks trained on compressed videos consistently outperform other benchmark methods, both on stationary videos and videos with significant rigid head motions. By training on videos with the same, or higher compression factor than test videos, we achieve improvements in signal-to-noise ratio (SNR) of up to 3 dB and mean absolute error (MAE) of up to 6 beats per minute (BPM).
-
more » « less
Abstract Tissues and engineered biomaterials exhibit exquisite local variation in stiffness that defines their function. Conventional elastography quantifies stiffness in soft (e.g. brain, liver) tissue, but robust quantification in stiff (e.g. musculoskeletal) tissues is challenging due to dissipation of high frequency shear waves. We describe new development of
finite deformation elastography that utilizes magnetic resonance imaging of low frequency, physiological-level (large magnitude) displacements, coupled to an iterative topology optimization routine to investigate stiffness heterogeneity, including spatial gradients and inclusions. We reconstruct 2D and 3D stiffness distributions in bilayer agarose hydrogels and silicon materials that exhibit heterogeneous displacement/strain responses. We map stiffness in porcine and sheep articular cartilage deep within the bony articular joint spacein situ for the first time. Elevated cartilage stiffness localized to the superficial zone is further related to collagen fiber compaction and loss of water content during cyclic loading, as assessed by independentT 2measurements. We additionally describe technical challenges needed to achievein vivo elastography measurements. Our results introduce new functional imaging biomarkers, which can be assessed nondestructively, with clinical potential to diagnose and track progression of disease in early stages, including osteoarthritis or tissue degeneration.
