An official website of the United States government
We propose a novel intensity diffraction tomography (IDT) reconstruction algorithm based on the split-step non-paraxial (SSNP) model for recovering the 3D refractive index (RI) distribution of multiple-scattering biological samples. High-quality IDT reconstruction requires high-angle illumination to encode both low- and high- spatial frequency information of the 3D biological sample. We show that our SSNP model can more accurately compute multiple scattering from high-angle illumination compared to paraxial approximation-based multiple-scattering models. We apply this SSNP model to both sequential and multiplexed IDT techniques. We develop a unified reconstruction algorithm for both IDT modalities that is highly computationally efficient and is implemented by a modular automatic differentiation framework. We demonstrate the capability of our reconstruction algorithm on both weakly scattering buccal epithelial cells and strongly scattering liveC. elegansworms and liveC. elegansembryos.
more »
« less
Model and learning-based computational 3D phase microscopy with intensity diffraction tomography
Intensity Diffraction Tomography (IDT) is a new computational microscopy technique providing quantitative, volumetric, large field-of-view (FOV) phase imaging of biological samples. This approach uses computationally efficient inverse scattering models to recover 3D phase volumes of weakly scattering objects from intensity measurements taken under diverse illumination at a single focal plane. IDT is easily implemented in a standard microscope equipped with an LED array source and requires no exogenous contrast agents, making the technology widely accessible for biological research.Here, we discuss model and learning-based approaches for complex 3D object recovery with IDT. We present two model-based computational illumination strategies, multiplexed IDT (mIDT) [1] and annular IDT (aIDT) [2], that achieve high-throughput quantitative 3D object phase recovery at hardware-limited 4Hz and 10Hz volume rates, respectively. We illustrate these techniques on living epithelial buccal cells and Caenorhabditis elegans worms. For strong scattering object recovery with IDT, we present an uncertainty quantification framework for assessing the reliability of deep learning-based phase recovery methods [3]. This framework provides per-pixel evaluation of a neural network predictions confidence level, allowing for efficient and reliable complex object recovery. This uncertainty learning framework is widely applicable for reliable deep learning-based biomedical imaging techniques and shows significant potential for IDT.
more »
« less
- PAR ID:
- 10209664
- Date Published:
- Journal Name:
- 2020 28th European Signal Processing Conference (EUSIPCO)
- Page Range / eLocation ID:
- 760 to 764
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Reflection phase imaging provides label-free, high-resolution characterization of biological samples, typically using interferometric-based techniques. Here, we investigate reflection phase microscopy fromintensity-only measurements under diverse illumination. We evaluate the forward and inverse scattering model based on the first Born approximation for imaging scattering objects above a glass slide. Under this design, the measured field combineslinearforward-scattering and height-dependentnonlinearback-scattering from the object that complicates object phase recovery. Using only the forward-scattering, we derive a linear inverse scattering model and evaluate this model’s validity range in simulation and experiment using a standard reflection microscope modified with a programmable light source. Our method provides enhanced contrast of thin, weakly scattering samples that complement transmission techniques. This model provides a promising development for creating simplified intensity-based reflection quantitative phase imaging systems easily adoptable for biological research.more » « less
-
Recovering 3D phase features of complex biological samples traditionally sacrifices computational efficiency and processing time for physical model accuracy and reconstruction quality. Here, we overcome this challenge using an approximant-guided deep learning framework in a high-speed intensity diffraction tomography system. Applying a physics model simulator-based learning strategy trained entirely on natural image datasets, we show our network can robustly reconstruct complex 3D biological samples. To achieve highly efficient training and prediction, we implement a lightweight 2D network structure that utilizes a multi-channel input for encoding the axial information. We demonstrate this framework on experimental measurements of weakly scattering epithelial buccal cells and strongly scatteringC. elegansworms. We benchmark the network’s performance against a state-of-the-art multiple-scattering model-based iterative reconstruction algorithm. We highlight the network’s robustness by reconstructing dynamic samples from a living worm video. We further emphasize the network’s generalization capabilities by recovering algae samples imaged from different experimental setups. To assess the prediction quality, we develop a quantitative evaluation metric to show that our predictions are consistent with both multiple-scattering physics and experimental measurements.more » « less
-
We present deep-ultraviolet Fourier ptychography (DUV-FP) for high-resolution chemical imaging of biological specimens in their native state without exogenous stains. This approach uses a customized 265-nm DUV LED array for angle-varied illumination, leveraging the unique DUV absorption properties of biomolecules at this wavelength region. We implemented a robust feature-domain optimization framework to overcome common challenges in Fourier ptychographic reconstruction, including vignetting, pupil aberrations, stray light problems, intensity variations, and other systematic errors. By using a 0.12 numerical aperture low-resolution objective lens, our DUV-FP prototype can resolve the 345-nm linewidth on a resolution target, demonstrating at least a four-fold resolution gain compared to the captured raw images. Testing on various biospecimens demonstrates that DUV-FP significantly enhances absorption-based chemical contrast and reveals detailed structural and molecular information. To further address the limitations of conventional FP in quantitative phase imaging, we developed a spatially coded DUV-FP system. This platform enables true quantitative phase imaging of biospecimens with DUV light, overcoming the non-uniform phase response inherent in traditional microscopy techniques. The demonstrated advancements in high-resolution, label-free chemical imaging may accelerate developments in digital pathology, potentially enabling rapid, on-site analysis of biopsy samples in clinical settings.more » « less
-
Optical diffraction tomography (ODT) is an indispensable tool for studying objects in three dimensions. Until now, ODT has been limited to coherent light because spatial phase information is required to solve the inverse scattering problem. We introduce a method that enables ODT to be applied to imaging incoherent contrast mechanisms such as fluorescent emission. Our strategy mimics the coherent scattering process with two spatially coherent illumination beams. The interferometric illumination pattern encodes spatial phase in temporal variations of the fluorescent emission, thereby allowing incoherent fluorescent emission to mimic the behavior of coherent illumination. The temporal variations permit recovery of the spatial distribution of fluorescent emission with an inverse scattering model. Simulations and experiments demonstrate isotropic resolution in the 3D reconstruction of a fluorescent object.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.23919/Eusipco47968.2020.9287407
