skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Friday, May 16 until 2:00 AM ET on Saturday, May 17 due to maintenance. We apologize for the inconvenience.


Title: Phase imaging with computational specificity (PICS) for measuring dry mass changes in sub-cellular compartments
Abstract Due to its specificity, fluorescence microscopy has become a quintessential imaging tool in cell biology. However, photobleaching, phototoxicity, and related artifacts continue to limit fluorescence microscopy’s utility. Recently, it has been shown that artificial intelligence (AI) can transform one form of contrast into another. We present phase imaging with computational specificity (PICS), a combination of quantitative phase imaging and AI, which provides information about unlabeled live cells with high specificity. Our imaging system allows for automatic training, while inference is built into the acquisition software and runs in real-time. Applying the computed fluorescence maps back to the quantitative phase imaging (QPI) data, we measured the growth of both nuclei and cytoplasm independently, over many days, without loss of viability. Using a QPI method that suppresses multiple scattering, we measured the dry mass content of individual cell nuclei within spheroids. In its current implementation, PICS offers a versatile quantitative technique for continuous simultaneous monitoring of individual cellular components in biological applications where long-term label-free imaging is desirable.  more » « less
Award ID(s):
1735252 1725729
PAR ID:
10204718
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Nature Communications
Volume:
11
Issue:
1
ISSN:
2041-1723
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The ability to evaluate sperm at the microscopic level, at high-throughput, would be useful for assisted reproductive technologies (ARTs), as it can allow specific selection of sperm cells for in vitro fertilization (IVF). The tradeoff between intrinsic imaging and external contrast agents is particularly acute in reproductive medicine. The use of fluorescence labels has enabled new cell-sorting strategies and given new insights into developmental biology. Nevertheless, using extrinsic contrast agents is often too invasive for routine clinical operation. Raising questions about cell viability, especially for single-cell selection, clinicians prefer intrinsic contrast in the form of phase-contrast, differential-interference contrast, or Hoffman modulation contrast. While such instruments are nondestructive, the resulting image suffers from a lack of specificity. In this work, we provide a template to circumvent the tradeoff between cell viability and specificity by combining high-sensitivity phase imaging with deep learning. In order to introduce specificity to label-free images, we trained a deep-convolutional neural network to perform semantic segmentation on quantitative phase maps. This approach, a form of phase imaging with computational specificity (PICS), allowed us to efficiently analyze thousands of sperm cells and identify correlations between dry-mass content and artificial-reproduction outcomes. Specifically, we found that the dry-mass content ratios between the head, midpiece, and tail of the cells can predict the percentages of success for zygote cleavage and embryo blastocyst formation. 
    more » « less
  2. In this paper, we review spatial light interference microscopy (SLIM), a common-path, phase-shifting interferometer, built onto a phase-contrast microscope, with white-light illumination. As one of the most sensitive quantitative phase imaging (QPI) methods, SLIM allows for speckle-free phase reconstruction with sub-nanometer path-length stability. We first review image formation in QPI, scattering, and full-field methods. Then, we outline SLIM imaging from theory and instrumentation to diffraction tomography. Zernike’s phase-contrast microscopy, phase retrieval in SLIM, and halo removal algorithms are discussed. Next, we discuss the requirements for operation, with a focus on software developed in-house for SLIM that enables high-throughput acquisition, whole slide scanning, mosaic tile registration, and imaging with a color camera. We introduce two methods for solving the inverse problem using SLIM, white-light tomography, and Wolf phase tomography. Lastly, we review the applications of SLIM in basic science and clinical studies. SLIM can study cell dynamics, cell growth and proliferation, cell migration, mass transport, etc. In clinical settings, SLIM can assist with cancer studies, reproductive technology, blood testing, etc. Finally, we review an emerging trend, where SLIM imaging in conjunction with artificial intelligence brings computational specificity and, in turn, offers new solutions to outstanding challenges in cell biology and pathology. 
    more » « less
  3. Abstract Quantitative phase imaging (QPI) recovers the exact wavefront of light from intensity measurements. Topographical and optical density maps of translucent microscopic bodies can be extracted from these quantified phase shifts. We demonstrate quantitative phase imaging at the tip of a coherent fiber bundle using chromatic aberrations inherent in a silicon nitride hyperboloid metalens. Our method leverages spectral multiplexing to recover phase from multiple defocus planes in a single capture using a color camera. Our 0.5 mm aperture metalens shows robust quantitative phase imaging capability with a$${28}^{\circ}$$ 28 field of view and 0.$${2}{\pi}$$ 2 π phase resolution ( ~ 0.$${1}{\lambda}$$ 1 λ in air) for experiments with an endoscopic fiber bundle. Since the spectral functionality is encoded directly in the imaging lens, the metalens acts both as a focusing element and a spectral filter. The use of a simple computational backend will enable real-time operation. Key limitations in the adoption of phase imaging methods for endoscopy such as multiple acquisition, interferometric alignment or mechanical scanning are completely mitigated in the reported metalens based QPI. 
    more » « less
  4. Three-dimensional quantitative phase imaging (3D QPI) is widely recognized as a potentially high-impact microscopic modality. Central to determining the resolution capability of 3D QPI is the phase optical transfer function (POTF). The magnitude of the POTF over its spatial frequency coverage (SFC) specifies the intensity of the response for each allowed spatial frequency. In this paper, a detailed analysis of the POTF for an axially symmetric optical configuration is presented. First, a useful geometric interpretation of the SFC, which enables its visualization, is presented. Second, a closed-form 1D integral expression is derived for the POTF in the general nonparaxial case, which enables rapid calculation of the POTF. Third, this formulation is applied to disk, annular, multi-annuli, and Gaussian illuminations as well as to an annular objective. Taken together, these contributions enable the visualization and simplified calculation of the 3D axially symmetric POTF and provide a basis for optimizing QPI in a wide range of applications. 
    more » « less
  5. Quantitative phase imaging (QPI) is an invaluable microscopic technology for definitively imaging phase objects such as biological cells and optical fibers. Traditionally, the condenser lens in QPI produces disk illumination of the object. However, it has been realized by numerous investigators that annular illumination can produce higher-resolution images. Although this performance improvement is impressive and well documented, the evidence presented has invariably been qualitative in nature. Recently, a theoretical basis for annular illumination was presented by Baoet al.[Appl. Opt.58,137(2019)APOPAI0003-693510.1364/AO.58.000137]. In our current work, systematic experimental QPI measurements are made with a reference phase mask to rigorously document the performance of annular illumination. In both theory and experiment, three spatial-frequency regions are identified: low, mid, and high. The low spatial-frequency region response is very similar for disk and annular illumination, both theoretically and experimentally. Theoretically, the high spatial-frequency region response is predicted to be much better for the annular illumination compared to the disk illumination––and is experimentally confirmed. In addition, the mid-spatial-frequency region response is theoretically predicted to be less for annular illumination than for disk illumination. This theoretical degradation of the mid-spatial-frequency region is only slightly experimentally observed. This bonus, although not well understood, further elevates the performance of annular illumination over disk illumination. 
    more » « less