skip to main content


Title: Compressive ghost imaging through scattering media with deep learning

Imaging through scattering media is challenging since the signal to noise ratio (SNR) of the reflection can be heavily reduced by scatterers. Single-pixel detectors (SPD) with high sensitivities offer compelling advantages for sensing such weak signals. In this paper, we focus on the use of ghost imaging to resolve 2D spatial information using just an SPD. We prototype a polarimetric ghost imaging system that suppresses backscattering from volumetric media and leverages deep learning for fast reconstructions. In this work, we implement ghost imaging by projecting Hadamard patterns that are optimized for imaging through scattering media. We demonstrate good quality reconstructions in highly scattering conditions using a 1.6% sampling rate.

 
more » « less
NSF-PAR ID:
10156470
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Optics Express
Volume:
28
Issue:
12
ISSN:
1094-4087; OPEXFF
Page Range / eLocation ID:
Article No. 17395
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Diffraction-limited optical imaging through scattering media has the potential to transform many applications such as airborne and space-based imaging (through the atmosphere), bioimaging (through skin and human tissue), and fiber-based imaging (through fiber bundles). Existing wavefront shaping methods can image through scattering media and other obscurants by optically correcting wavefront aberrations using high-resolution spatial light modulators—but these methods generally require (i) guidestars, (ii) controlled illumination, (iii) point scanning, and/or (iv) statics scenes and aberrations. We propose neural wavefront shaping (NeuWS), a scanning-free wavefront shaping technique that integrates maximum likelihood estimation, measurement modulation, and neural signal representations to reconstruct diffraction-limited images through strong static and dynamic scattering media without guidestars, sparse targets, controlled illumination, nor specialized image sensors. We experimentally demonstrate guidestar-free, wide field-of-view, high-resolution, diffraction-limited imaging of extended, nonsparse, and static/dynamic scenes captured through static/dynamic aberrations.

     
    more » « less
  2. Optical imaging through scattering media has long been a challenge. Many approaches have been developed for focusing light or imaging objects through scattering media, but usually, they are either invasive, limited to stationary or slow-moving media, or require high-resolution cameras and complex algorithms to retrieve the images. By utilizing spatial–temporal encoded patterns (STEPs), we introduce a technique for the computation of imaging that overcomes these restrictions. With a single-pixel photodetector, we demonstrate non-invasive imaging through scattering media. This technique is insensitive to the motion of the media. Furthermore, we demonstrate that our image reconstruction algorithm is much more efficient than correlation-based algorithms for single-pixel imaging, which may allow fast imaging for applications with limited computing resources.

     
    more » « less
  3. Abstract

    We demonstrate in situ non-invasive relay imaging through a medium without inserting physical optical components. We show that a virtual optical graded-index (GRIN) lens can be sculpted in the medium using in situ reconfigurable ultrasonic interference patterns to relay images through the medium. Ultrasonic wave patterns change the local density of the medium to sculpt a graded refractive index pattern normal to the direction of light propagation, which modulates the phase front of light, causing it to focus within the medium and effectively creating a virtual relay lens. We demonstrate the in situ relay imaging and resolving of small features (22 µm) through a turbid medium (optical thickness = 5.7 times the scattering mean free path), which is normally opaque. The focal distance and the numerical aperture of the sculpted optical GRIN lens can be tuned by changing the ultrasonic wave parameters. As an example, we experimentally demonstrate that the axial focal distance can be continuously scanned over a depth of 5.4 mm in the modulated medium and that the numerical aperture can be tuned up to 21.5%. The interaction of ultrasonic waves and light can be mediated through different physical media, including turbid media, such as biological tissue, in which the ultrasonically sculpted GRIN lens can be used for relaying images of the underlying structures through the turbid medium, thus providing a potential alternative to implanting invasive endoscopes.

     
    more » « less
  4. Abstract We present the first event-horizon-scale images and spatiotemporal analysis of Sgr A* taken with the Event Horizon Telescope in 2017 April at a wavelength of 1.3 mm. Imaging of Sgr A* has been conducted through surveys over a wide range of imaging assumptions using the classical CLEAN algorithm, regularized maximum likelihood methods, and a Bayesian posterior sampling method. Different prescriptions have been used to account for scattering effects by the interstellar medium toward the Galactic center. Mitigation of the rapid intraday variability that characterizes Sgr A* has been carried out through the addition of a “variability noise budget” in the observed visibilities, facilitating the reconstruction of static full-track images. Our static reconstructions of Sgr A* can be clustered into four representative morphologies that correspond to ring images with three different azimuthal brightness distributions and a small cluster that contains diverse nonring morphologies. Based on our extensive analysis of the effects of sparse ( u , v )-coverage, source variability, and interstellar scattering, as well as studies of simulated visibility data, we conclude that the Event Horizon Telescope Sgr A* data show compelling evidence for an image that is dominated by a bright ring of emission with a ring diameter of ∼50 μ as, consistent with the expected “shadow” of a 4 × 10 6 M ⊙ black hole in the Galactic center located at a distance of 8 kpc. 
    more » « less
  5. Abstract

    Optical imaging techniques, such as light detection and ranging (LiDAR), are essential tools in remote sensing, robotic vision, and autonomous driving. However, the presence of scattering places fundamental limits on our ability to image through fog, rain, dust, or the atmosphere. Conventional approaches for imaging through scattering media operate at microscopic scales or require a priori knowledge of the target location for 3D imaging. We introduce a technique that co-designs single-photon avalanche diodes, ultra-fast pulsed lasers, and a new inverse method to capture 3D shape through scattering media. We demonstrate acquisition of shape and position for objects hidden behind a thick diffuser (≈6 transport mean free paths) at macroscopic scales. Our technique, confocal diffuse tomography, may be of considerable value to the aforementioned applications.

     
    more » « less