skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Learnable-pattern scanning based deep compressed imaging
We present a new deep compressed imaging modality by scanning a learned illumination pattern on the sample and detecting the signal with a single-pixel detector. This new imaging modality allows a compressed sampling of the object, and thus a high imaging speed. The object is reconstructed through a deep neural network inspired by compressed sensing algorithm. We optimize the illumination pattern and the image reconstruction network by training an end-to-end auto-encoder framework. Comparing with the conventional single-pixel camera and point-scanning imaging system, we accomplish a high-speed imaging with a reduced light dosage, while preserving a high imaging quality.  more » « less
Award ID(s):
1847141
PAR ID:
10268494
Author(s) / Creator(s):
; ;
Editor(s):
Goda, Keisuke; Tsia, Kevin K.
Date Published:
Journal Name:
High-Speed Biomedical Imaging and Spectroscopy VI
Volume:
11654
Page Range / eLocation ID:
1165413
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The need for high-speed imaging in applications such as biomedicine, surveillance, and consumer electronics has called for new developments of imaging systems. While the industrial effort continuously pushes the advance of silicon focal plane array image sensors, imaging through a single-pixel detector has gained significant interest thanks to the development of computational algorithms. Here, we present a new imaging modality, deep compressed imaging via optimized-pattern scanning, which can significantly increase the acquisition speed for a single-detector-based imaging system. We project and scan an illumination pattern across the object and collect the sampling signal with a single-pixel detector. We develop an innovative end-to-end optimized auto-encoder, using a deep neural network and compressed sensing algorithm, to optimize the illumination pattern, which allows us to reconstruct faithfully the image from a small number of measurements, with a high frame rate. Compared with the conventional switching-mask-based single-pixel camera and point-scanning imaging systems, our method achieves a much higher imaging speed, while retaining a similar imaging quality. We experimentally validated this imaging modality in the settings of both continuous-wave illumination and pulsed light illumination and showed high-quality image reconstructions with a high compressed sampling rate. This new compressed sensing modality could be widely applied in different imaging systems, enabling new applications that require high imaging speeds. 
    more » « less
  2. null (Ed.)
    We propose a new imaging scheme of compressed sensing by scanning an illumination pattern on the object. Comparing with conventional single-pixel cameras, we expect a >50x increase in imaging speed with similar imaging quality. 
    more » « less
  3. Abstract We present a two-photon fluorescence microscope designed for high-speed imaging of neural activity in cellular resolution. Our microscope uses a new adaptive sampling scheme with line illumination. Instead of building images pixel by pixel via scanning a diffraction-limited spot across the sample, our scheme only illuminates the regions of interest (i.e., neuronal cell bodies), and samples a large area of them in a single measurement. Such a scheme significantly increases the imaging speed and reduces the overall laser power on the brain tissue. Using this approach, we performed high-speed imaging of the neural activity of mouse cortexin vivo. Our method provides a new sampling strategy in laser-scanning two-photon microscopy, and will be powerful for high-throughput imaging of neural activity. 
    more » « less
  4. We present a two-photon fluorescence microscope designed for high-speed imaging of neural activity at cellular resolution. Our microscope uses an adaptive sampling scheme with line illumination. Instead of building images pixel by pixel via scanning a diffraction-limited spot across the sample, our scheme only illuminates the regions of interest (i.e., neuronal cell bodies) and samples a large area of them in a single measurement. Such a scheme significantly increases the imaging speed and reduces the overall laser power on the brain tissue. Using this approach, we performed high-speed imaging of the neuronal activity in mouse cortexin vivo. Our method provides a sampling strategy in laser-scanning two-photon microscopy and will be powerful for high-throughput imaging of neural activity. 
    more » « less
  5. We present a two-photon fluorescence microscope designed for high-speed imaging of neural activity in cellular resolution. Our microscope uses line illumination with an adaptive sampling scheme. Instead of building images pixel by pixel via scanning a diffraction-limited spot across the tissue, our scheme only illuminates the regions of interest (i.e., neuronal cell bodies), and samples a large area of them in a single measurement. This significantly increases the imaging speed and reduces the overall laser power on the sample. We characterized the imaging resolution and verified the concept of adaptive sampling through phantom samples. Our approach holds great promise for high-throughput neural activity imaging. 
    more » « less