skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Cross-correlation image analysis for real-time single particle tracking
Accurately measuring the translations of objects between images is essential in many fields, including biology, medicine, chemistry, and physics. One important application is tracking one or more particles by measuring their apparent displacements in a series of images. Popular methods, such as the center of mass, often require idealized scenarios to reach the shot noise limit of particle tracking and, therefore, are not generally applicable to multiple image types. More general methods, such as maximum likelihood estimation, reliably approach the shot noise limit, but are too computationally intense for use in real-time applications. These limitations are significant, as real-time, shot-noise-limited particle tracking is of paramount importance for feedback control systems. To fill this gap, we introduce a new cross-correlation-based algorithm that approaches shot-noise-limited displacement detection and a graphics processing unit-based implementation for real-time image analysis of a single particle.  more » « less
Award ID(s):
2227079 2011783 1912083
PAR ID:
10528732
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Publisher / Repository:
Review of Scientific Instruments
Date Published:
Journal Name:
Review of Scientific Instruments
Volume:
95
Issue:
7
ISSN:
0034-6748
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Modern science is dependent on imaging on the nanoscale, often achieved through processes that detect secondary electrons created by a highly focused incident charged particle beam. Multiple types of measurement noise limit the ultimate trade-off between the image quality and the incident particle dose, which can preclude useful imaging of dose-sensitive samples. Existing methods to improve image quality do not fundamentally mitigate the noise sources. Furthermore, barriers to assigning a physically meaningful scale make the images qualitative. Here, we introduce ion count-aided microscopy (ICAM), which is a quantitative imaging technique that uses statistically principled estimation of the secondary electron yield. With a readily implemented change in data collection, ICAM substantially reduces source shot noise. In helium ion microscopy, we demonstrate 3 × dose reduction and a good match between these empirical results and theoretical performance predictions. ICAM facilitates imaging of fragile samples and may make imaging with heavier particles more attractive. 
    more » « less
  2. Single-shot two-dimensional (2D) phase retrieval (PR) can recover the phase shift distribution within an object from a single 2D x-ray phase contrast image (XPCI). Two competing XPCI imaging modalities often used for single-shot 2D PR to recover material properties critical for predictive performance capabilities are: speckle-based (SP-XPCI) and propagation-based (PB-XPCI) XPCI imaging. However, PR from SP-XPCI and PB-XPCI images are, respectively, limited to reconstructing accurately slowly and rapidly varying features due to noise and differences in their contrast mechanisms. Herein, we consider a combined speckle- and propagation-based XPCI (SPB-XPCI) image by introducing a mask to generate a reference pattern and imaging in the near-to-holographic regime to induce intensity modulations in the image. We develop a single-shot 2D PR method for SPB-XPCI images of pure phase objects without imposing restrictions such as object support constraints. It is compared against PR methods inspired by those developed for SP-XPCI and PB-XPCI on simulated and experimental images of a thin glass shell before and during shockwave compression. Reconstructed phase maps show improvements in quantitative scores of root-mean-square error and structural similarity index measure using our proposed method. 
    more » « less
  3. Abstract We evaluate Beer–Lambert (BL) ray-tracing and Monte Carlo N-Particle (MCNP) photon tracking simulations for prediction and comparison of x-ray imaging system performance. These simulation tools can aid the methodical design of laboratory-scale x-ray particle image velocimetry (XPIV) experiments and tracer particles by predicting image quality. Particle image signal-to-noise ratio (SNR) is used as the metric of system performance. Simulated and experiment data of hollow, silver-coated, glass sphere tracer particles (AGSF-33) are compared. As predicted by the simulations, the AGSF-33 particles are visible with a SNR greater than unity in 100 ms exposure time images, demonstrating their potential as x-ray PIV or particle tracking velocimetry (XPTV) tracers. The BL approach predicts the image contrast, is computationally inexpensive, and enables the exploration of a vast parameter space for system design. MCNP simulations, on the other hand, predict experiment images slightly more accurately, but are more than an order of magnitude more computationally expensive than BL simulations. For most practical XPIV system design applications, the higher computational expense of MCNP is likely not justified by the modest accuracy improvement compared to BL. 
    more » « less
  4. Dipole-spread function (DSF) engineering reshapes the images of a microscope to maximize the sensitivity of measuring the 3D orientations of dipole-like emitters. However, severe Poisson shot noise, overlapping images, and simultaneously fitting high-dimensional information–both orientation and position–greatly complicates image analysis in single-molecule orientation-localization microscopy (SMOLM). Here, we report a deep-learning based estimator, termed Deep-SMOLM, that achieves superior 3D orientation and 2D position measurement precision within 3% of the theoretical limit (3.8° orientation, 0.32 sr wobble angle, and 8.5 nm lateral position using 1000 detected photons). Deep-SMOLM also demonstrates state-of-art estimation performance on overlapping images of emitters, e.g., a 0.95 Jaccard index for emitters separated by 139 nm, corresponding to a 43% image overlap. Deep-SMOLM accurately and precisely reconstructs 5D information of both simulated biological fibers and experimental amyloid fibrils from images containing highly overlapped DSFs at a speed ~10 times faster than iterative estimators. 
    more » « less
  5. Single molecule fluorescence spectroscopy has been largely implemented using methods which require tethering of molecules to a substrate in order to make high temporal resolution measurements. However, the act of tethering a molecule requires that the molecule be removed from its environment. This is especially perturbative when measuring biomolecules such as enzymes, which may rely on the non-equilibrium and crowded cellular environment for normal function. A method which may be able to un-tether single molecule fluorescence spectroscopy is real-time 3D single particle tracking (RT-3D-SPT). RT-3D-SPT uses active feedback to effectively lock-on to freely diffusing particles so they can be measured continuously with up to photon-limited temporal resolution over large axial ranges. This review gives an overview of the various active feedback 3D single particle tracking methods, highlighting specialized detection and excitation schemes which enable high-speed real-time tracking. Furthermore, the combination of these active feedback methods with simultaneous live-cell imaging is discussed. Finally, the successes in real-time 3D single molecule tracking (RT-3D-SMT) thus far and the roadmap going forward for this promising family of techniques are discussed. 
    more » « less