he Compressive Sensing (CS) framework has demonstrated improved acquisition efficiency on a variety of clinical applications. Of interest to this work is Reflectance Confocal Microscopy (RCM), where CS can influence a drastic reduction in instrumentation complexity and image acquisition times. However, CS introduces the disadvantage of requiring a time consuming and computationally intensive process for image recovery. To mitigate this, the current document details our preliminary work on expanding a Deep-Learning architecture for the acquisition and fast recovery of RCM images using CS. We show preliminary recoveries of RCM images of both a synthetic target and heterogeneous skin tissue using a state-of-the-art network architecture from compressive measurements at various undersampling rates. In addition, we propose an application-specific addition to an established network architecture, and evaluate its ability to further increase the accuracy of recovered CS RCM images and remove visual artifacts. Our initial results show that it is possible to recover compressively sampled images at near-real time rates with comparable quality to established computationally intensive and time-consuming optimization-based methods common in CS applications
more »
« less
A Framework For An Artificial Neural Network Enabled Single Pixel Hyperspectral Imager
Compressive Sensing enables improvement of acquisition of a variety of signals in various applications with little to no discernible loss in terms of recovered image quality. The current work proposes a signal processing framework for the acquisition and fast reconstruction of compressively sampled hyperspectral images using an artificial neural network architecture. This ANN-based approach is capable of performing a fast reconstruction by avoiding the requirement of solving a computationally intensive image-specific optimization problem. The proposed framework contributes to advance single-pixel hyperspectral imaging device methodologies, which enable a significant reduction in device mechanical complexity, imaging rate, and cost. Our experiments demonstrate that a hyperspectral image can be reconstructed using only 10% of the samples without compromising classification performance. Specifically, the results show that classification performance of the compressively sampled hyperspectral image recovered using artificial neural networks is equal or higher to that of those obtained using current scanning hyperspectral imaging platforms.
more »
« less
- Award ID(s):
- 1750970
- PAR ID:
- 10155758
- Date Published:
- Journal Name:
- 2019 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS)
- Page Range / eLocation ID:
- 1 to 5
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Colorectal cancer is one of the top contributors to cancer-related deaths in the United States, with over 100,000 estimated cases in 2020 and over 50,000 deaths. The most common screening technique is minimally invasive colonoscopy using either reflected white light endoscopy or narrow-band imaging. However, current imaging modalities have only moderate sensitivity and specificity for lesion detection. We have developed a novel fluorescence excitation-scanning hyperspectral imaging (HSI) approach to sample image and spectroscopic data simultaneously on microscope and endoscope platforms for enhanced diagnostic potential. Unfortunately, fluorescence excitation-scanning HSI datasets pose major challenges for data processing, interpretability, and classification due to their high dimensionality. Here, we present an end-to-end scalable Artificial Intelligence (AI) framework built for classification of excitation-scanning HSI microscopy data that provides accurate image classification and interpretability of the AI decision-making process. The developed AI framework is able to perform real-time HSI classification with different speed/classification performance trade-offs by tailoring the dimensionality of the dataset, supporting different dimensions of deep learning models, and varying the architecture of deep learning models. We have also incorporated tools to visualize the exact location of the lesion detected by the AI decision-making process and to provide heatmap-based pixel-by-pixel interpretability. In addition, our deep learning framework provides wavelength-dependent impact as a heatmap, which allows visualization of the contributions of HSI wavelength bands during the AI decision-making process. This framework is well-suited for HSI microscope and endoscope platforms, where real-time analysis and visualization of classification results are required by clinicians.more » « less
-
Hyperspectral imaging technologies have shown great promise for biomedical applications. These techniques have been especially useful for detection of molecular events and characterization of cell, tissue, and biomaterial composition. Unfortunately, hyperspectral imaging technologies have been slow to translate to clinical devices ā likely due to increased cost and complexity of the technology as well as long acquisition times often required to sample a spectral image. We have demonstrated that hyperspectral imaging approaches which scan the fluorescence excitation spectrum can provide increased signal strength and faster imaging, compared to traditional emission-scanning approaches. We have also demonstrated that excitation-scanning approaches may be able to detect spectral differences between colonic adenomas and adenocarcinomas and normal mucosa in flash-frozen tissues. Here, we report feasibility results from using excitation-scanning hyperspectral imaging to screen pairs of fresh tumoral and nontumoral colorectal tissues. Tissues were imaged using a novel hyperspectral imaging fluorescence excitation scanning microscope, sampling a wavelength range of 360-550 nm, at 5 nm increments. Image data were corrected to achieve a NIST-traceable flat spectral response. Image data were then analyzed using a range of supervised and unsupervised classification approaches within ENVI software (Harris Geospatial Solutions). Supervised classification resulted in >99% accuracy for single-patient image data, but only 64% accuracy for multi-patient classification (n=9 to date), with the drop in accuracy due to increased false-positive detection rates. Hence, initial data indicate that this approach may be a viable detection approach, but that larger patient sample sizes need to be evaluated and the effects of inter-patient variability studied.more » « less
-
Coded aperture imaging has emerged as a solution to enhance light sensitivity and enable imaging in challenging conditions. However, the computational expense of image reconstruction poses limitations in processing efficiency. To address this, we propose a direct classification method using convolutional neural networks. By leveraging raw coded measurements, our approach eliminates the need for explicit image reconstruction, reducing computational overhead. We evaluate the effectiveness of this approach compared to traditional methods on the MNIST and CIFAR10 datasets. Our results demonstrate that direct image classification using raw coded measurements achieves comparable performance to traditional methods while reducing computational overhead and enabling real-time processing. These findings highlight the potential of machine learning in enhancing the decoding process and improving the overall performance of coded aperture imaging systems.more » « less
-
null (Ed.)In this paper, we propose a fast and low-cost cylindrical microwave imaging system based on the use of arrays of transmitter and receiver antennas and a customized low-cost data acquisition circuit using off-the-shelf components. The complex-valued scattered data captured with the proposed system is processed using near-field holographic image reconstruction. To enhance this technique, standardized minimum norm (SMN) approach is employed to solve the relevant systems of equations. The performance of the proposed imaging technique and the data acquisition system is demonstrated via simulations and experiments.more » « less
An official website of the United States government

