skip to main content


Title: Deep correlated speckles: suppressing correlation fluctuation and optical diffraction

The generation of speckle patterns via random matrices, statistical definitions, or apertures may not always result in optimal outcomes. Issues such as correlation fluctuations in low ensemble numbers and diffraction in long-distance propagation can arise. Instead of improving results of specific applications, our solution is catching deep correlations of patterns with the framework, Speckle-Net, which is fundamental and universally applicable to various systems. We demonstrate this in computational ghost imaging (CGI) and structured illumination microscopy (SIM). In CGI with extremely low ensemble number, it customizes correlation width and minimizes correlation fluctuations in illuminating patterns to achieve higher-quality images. It also creates non-Rayleigh nondiffracting speckle patterns only through a phase mask modulation, which overcomes the power loss in the traditional ring-aperture method. Our approach provides new insights into the nontrivial speckle patterns and has great potential for a variety of applications including dynamic SIM, X-ray and photo-acoustic imaging, and disorder physics.

 
more » « less
Award ID(s):
2013771
NSF-PAR ID:
10497523
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Photonics Research
Volume:
12
Issue:
4
ISSN:
2327-9125
Format(s):
Medium: X Size: Article No. 804
Size(s):
Article No. 804
Sponsoring Org:
National Science Foundation
More Like this
  1. We present a novel method, to our knowledge, to synthesize non-trivial speckle patterns that can enable sub-Rayleigh second-order correlation imaging. The speckle patterns acquire a unique anti-correlation in the spatial intensity fluctuation by introducing the blue noise distribution on spatial Fourier power spectrum to the input light fields through amplitude modulation. Illuminating objects with the blue noise speckle patterns can lead to a sub-diffraction limit imaging system with a resolution more than three times higher than first-order imaging, which is comparable to the resolving power of ninth order correlation imaging with thermal light. Our method opens a new route towards non-trivial speckle pattern generation by tailoring amplitudes in spatial Fourier power spectrum of the input light fields and provides a versatile scheme for constructing sub-Rayleigh imaging and microscopy systems without invoking complicated higher-order correlations.

     
    more » « less
  2. Coherent images of scattering materials, such as biological tissue, typically exhibit high-frequency intensity fluctuations known as speckle. These seemingly noise-like speckle patterns have strong statistical correlation properties that have been successfully utilized by computational imaging systems in different application areas. Unfortunately, these properties are not well-understood, in part due to the difficulty of simulating physically-accurate speckle patterns. In this work, we propose a new model for speckle statistics based on a single scattering approximation, that is, the assumption that all light contributing to speckle correlation has scattered only once. Even though single-scattering models have been used in computer vision and graphics to approximate intensity images due to scattering, such models usually hold only for very optically thin materials, where light indeed does not scatter more than once. In contrast, we show that the single-scattering model for speckle correlation remains accurate for much thicker materials. We evaluate the accuracy of the single-scattering correlation model through exhaustive comparisons against an exact speckle correlation simulator. We additionally demonstrate the model's accuracy through comparisons with real lab measurements. We show, that for many practical application settings, predictions from the single-scattering model are more accurate than those from other approximate models popular in optics, such as the diffusion and Fokker-Planck models. We show how to use the single-scattering model to derive closed-form expressions for speckle correlation, and how these expressions can facilitate the study of statistical speckle properties. In particular, we demonstrate that these expressions provide simple explanations for previously reported speckle properties, and lead to the discovery of new ones. Finally, we discuss potential applications for future computational imaging systems. 
    more » « less
  3. Speckle patterns have been used widely in imaging techniques such as ghost imaging, dynamic speckle illumination microscopy, structured illumination microscopy, and photoacoustic fluctuation imaging. Recent advances in the ability to control the statistical properties of speckles has enabled the customization of speckle patterns for specific imaging applications. In this work, we design and create special speckle patterns for parallelized nonlinear pattern-illumination microscopy based on fluorescence photoswitching. We present a proof-of-principle experimental demonstration where we obtain a spatial resolution three times higher than the diffraction limit of the illumination optics in our setup. Furthermore, we show that tailored speckles vastly outperform standard speckles. Our work establishes that customized speckles are a potent tool in parallelized super-resolution microscopy.

     
    more » « less
  4. Recent advances in computational imaging have significantly expanded our ability to image through scattering layers such as biological tissues by exploiting the auto-correlation properties of captured speckle intensity patterns. However, most experimental demonstrations of this capability focus on the far-field imaging setting, where obscured light sources are very far from the scattering layer. By contrast, medical imaging applications such as fluorescent imaging operate in the near-field imaging setting, where sources are inside the scattering layer. We provide a theoretical and experimental study of the similarities and differences between the two settings, highlighting the increased challenges posed by the near-field setting. We then draw insights from this analysis to develop a new algorithm for imaging through scattering that is tailored to the near-field setting by taking advantage of unique properties of speckle patterns formed under this setting, such as their local support. We present a theoretical analysis of the advantages of our algorithm and perform real experiments in both far-field and near-field configurations, showing an order-of magnitude expansion in both the range and the density of the obscured patterns that can be recovered. 
    more » « less
  5. Artificial intelligence has recently been widely used in computational imaging. The deep neural network (DNN) improves the signal-to-noise ratio of the retrieved images, whose quality is otherwise corrupted due to the low sampling ratio or noisy environments. This work proposes a new computational imaging scheme based on the sequence transduction mechanism with the transformer network. The simulation database assists the network in achieving signal translation ability. The experimental single-pixel detector’s signal will be ‘translated’ into a 2D image in an end-to-end manner. High-quality images with no background noise can be retrieved at a sampling ratio as low as 2%. The illumination patterns can be either well-designed speckle patterns for sub-Nyquist imaging or random speckle patterns. Moreover, our method is robust to noise interference. This translation mechanism opens a new direction for DNN-assisted ghost imaging and can be used in various computational imaging scenarios.

     
    more » « less