Optical imaging through scattering media has long been a challenge. Many approaches have been developed for focusing light or imaging objects through scattering media, but usually, they are either invasive, limited to stationary or slow-moving media, or require high-resolution cameras and complex algorithms to retrieve the images. By utilizing spatial–temporal encoded patterns (STEPs), we introduce a technique for the computation of imaging that overcomes these restrictions. With a single-pixel photodetector, we demonstrate non-invasive imaging through scattering media. This technique is insensitive to the motion of the media. Furthermore, we demonstrate that our image reconstruction algorithm is much more efficient than correlation-based algorithms for single-pixel imaging, which may allow fast imaging for applications with limited computing resources.
Optical imaging techniques, such as light detection and ranging (LiDAR), are essential tools in remote sensing, robotic vision, and autonomous driving. However, the presence of scattering places fundamental limits on our ability to image through fog, rain, dust, or the atmosphere. Conventional approaches for imaging through scattering media operate at microscopic scales or require a priori knowledge of the target location for 3D imaging. We introduce a technique that co-designs single-photon avalanche diodes, ultra-fast pulsed lasers, and a new inverse method to capture 3D shape through scattering media. We demonstrate acquisition of shape and position for objects hidden behind a thick diffuser (≈6 transport mean free paths) at macroscopic scales. Our technique, confocal diffuse tomography, may be of considerable value to the aforementioned applications.
more » « less- NSF-PAR ID:
- 10191316
- Publisher / Repository:
- Nature Publishing Group
- Date Published:
- Journal Name:
- Nature Communications
- Volume:
- 11
- Issue:
- 1
- ISSN:
- 2041-1723
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
more » « less
Reflectance Mueller matrix (MM) polarimetry is being used to characterize biological media in multiple clinical applications. The origin of the reflectance polarimetric data is often unclear due to the impact of multiple scattering and tissue heterogeneity. We have developed a new, to the best of our knowledge, multimodal imaging technique combining MM reflectance, MM digital confocal imaging, and co-registered nonlinear microscopy techniques. The instrument unveils the origin of reflectance polarimetric signature in terms of confocal reflectance data. The reconstructed reflected MM demonstrates the capability of our method to provide depth-resolved 3D polarization response from complex biological media in terms of depolarization, retardance, and orientation parameters.
-
more » « less
Abstract Deep learning has been broadly applied to imaging in scattering applications. A common framework is to train a descattering network for image recovery by removing scattering artifacts. To achieve the best results on a broad spectrum of scattering conditions, individual “expert” networks need to be trained for each condition. However, the expert’s performance sharply degrades when the testing condition differs from the training. An alternative brute-force approach is to train a “generalist” network using data from diverse scattering conditions. It generally requires a larger network to encapsulate the diversity in the data and a sufficiently large training set to avoid overfitting. Here, we propose an
adaptive learning framework, termed dynamic synthesis network (DSN), whichdynamically adjusts the model weights andadapts to different scattering conditions. The adaptability is achieved by a novel “mixture of experts” architecture that enables dynamically synthesizing a network by blending multiple experts using a gating network. We demonstrate the DSN in holographic 3D particle imaging for a variety of scattering conditions. We show in simulation that our DSN provides generalization across acontinuum of scattering conditions. In addition, we show that by training the DSN entirely on simulated data, the network can generalize to experiments and achieve robust 3D descattering. We expect the same concept can find many other applications, such as denoising and imaging in scattering media. Broadly, our dynamic synthesis framework opens up a new paradigm for designing highlyadaptive deep learning and computational imaging techniques. -
more » « less
Abstract The diffusion model is used to calculate both the time-averaged flow of particles in stochastic media and the propagation of waves averaged over ensembles of disordered static configurations. For classical waves exciting static disordered samples, such as a layer of paint or a tissue sample, the flux transmitted through the sample may be dramatically enhanced or suppressed relative to predictions of diffusion theory when the sample is excited by a waveform corresponding to a transmission eigenchannel. Even so, it is widely assumed that the velocity of waves is irretrievably randomized in scattering media. Here we demonstrate in microwave measurements and numerical simulations that the statistics of velocity of different transmission eigenchannels are distinct and remains so on all length scales and are identical on the incident and output surfaces. The interplay between eigenchannel velocities and transmission eigenvalues determines the energy density within the medium, the diffusion coefficient, and the dynamics of propagation. The diffusion coefficient and all scattering parameters, including the scattering mean free path, oscillate with the width of the sample as the number and shape of the propagating channels in the medium change.
-
more » « less
Summary A fast pink‐beam X‐ray microtomography methodology was developed at the GSECARS 13‐BMD beamline at the Advanced Photon Source to study multiphase flow in porous media. The white beam X‐ray distribution of the Advanced Photon Source is modified using a 1‐mm copper filter and the beam is reflected off a platinum mirror angled at 1.5 mrad, resulting in a pink beam with X‐ray intensities predominately in the range of 40–60 keV. Bubble formation in the wetting phase and wettability alteration of the solid phase from x‐ray exposure can be a problem with high flux and high energy beams, but the suggested pink‐beam configuration mitigates these effects. With a 14‐second acquisition time for capturing a complete dataset, the evolving fluid‐fronts of nonequilibrium three‐dimensional multiphase flow can be studied in real‐time and the images contain adequate image contrast and quality to measure important multiphase quantities such as contact angles and interfacial areas.
Lay Description Understanding how fluids are transported through porous materials is pertinent to many important societal processes in the environment (e.g. groundwater flow for drinking water) and industry (e.g. drying of industrial materials such as pulp and paper). To develop accurate models and theories of this fluid transportation, experiments need to track fluids in 3‐dimensions quickly. This is difficult to do as most materials are opaque and therefore cameras cannot capture fluid movement directly. But, with the help of x‐rays, scientists can track fluids in 3D using an imaging technique called x‐ray microtomography (μCT). Standard μCT takes about 15 minutes for one image which can produce blurry images if fluids are flowing quickly through the material. We present a technique, fast μCT, which uses a larger spectrum of x‐rays than the standard technique and acquires a 3D image in 14 seconds. With the large amount of x‐rays utilized in this technique, bubbles can start to form in the fluids from x‐ray exposure. We optimized the utilized x‐ray spectrum to limit bubble formation while still achieving a rapid 3D image acquisition that has adequate image quality and contrast. With this technique, scientists can study fluid transport in 3D porous materials in near real‐time for the improvement of models used to ensure public and environmental health.
