skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Combined online Bayesian and windowed estimation of background and signal localization facilitates active-feedback particle tracking in complex environments
Despite successes in tracking single molecules in vitro, the extension of active-feedback single-particle methods to tracking rapidly diffusing and unconfined proteins in live cells has not been realized. Since the existing active-feedback localization methods localize particles in real time assuming zero background, they are ill-suited to track in the inhomogeneous background environment of a live cell. Here, we develop a windowed estimation of signal and background levels using recent data to estimate the current particle brightness and background intensity. These estimates facilitate recursive Bayesian position estimation, improving upon current Kalman-based localization methods. Combined, online Bayesian and windowed estimation of background and signal (COBWEBS) surpasses existing 2D localization methods. Simulations demonstrate improved localization accuracy and responsivity in a homogeneous background for selected particle and background intensity combinations. Improved or similar performance of COBWEBS tracking extends to the majority of signal and background combinations explored. Furthermore, improved tracking durations are demonstrated in the presence of heterogeneous backgrounds for multiple particle intensities, diffusive speeds, and background patterns. COBWEBS can accurately track particles in the presence of high and nonuniform backgrounds, including intensity changes of up to three times the particle’s intensity, making it a prime candidate for advancing active-feedback single fluorophore tracking to the cellular interior.  more » « less
Award ID(s):
1847899
PAR ID:
10379689
Author(s) / Creator(s):
;
Publisher / Repository:
American Institute of Physics
Date Published:
Journal Name:
The Journal of Chemical Physics
Volume:
157
Issue:
18
ISSN:
0021-9606
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Single molecule fluorescence spectroscopy has been largely implemented using methods which require tethering of molecules to a substrate in order to make high temporal resolution measurements. However, the act of tethering a molecule requires that the molecule be removed from its environment. This is especially perturbative when measuring biomolecules such as enzymes, which may rely on the non-equilibrium and crowded cellular environment for normal function. A method which may be able to un-tether single molecule fluorescence spectroscopy is real-time 3D single particle tracking (RT-3D-SPT). RT-3D-SPT uses active feedback to effectively lock-on to freely diffusing particles so they can be measured continuously with up to photon-limited temporal resolution over large axial ranges. This review gives an overview of the various active feedback 3D single particle tracking methods, highlighting specialized detection and excitation schemes which enable high-speed real-time tracking. Furthermore, the combination of these active feedback methods with simultaneous live-cell imaging is discussed. Finally, the successes in real-time 3D single molecule tracking (RT-3D-SMT) thus far and the roadmap going forward for this promising family of techniques are discussed. 
    more » « less
  2. Real-time three-dimensional single-particle tracking (RT-3D-SPT) allows continuous detection of individual freely diffusing objects with high spatiotemporal precision by applying closed-loop active feedback in an optical microscope. However, the current tracking speed in RT-3D-SPT is primarily limited by the response time of control actuators, impeding long-term observation of fast diffusive objects such as single molecules. Here, we present an RT-3D-SPT system with improved tracking performance by replacing the XY piezoelectric stage with a galvo scanning mirror with an approximately five-time faster response rate (~5 kHz). Based on the previously developed 3D single-molecule active real-time tracking (3D-SMART), this new implementation with a fast-responding galvo mirror eliminates the mechanical movement of the sample and allows more rapid response to particle motion. The improved tracking performance of the galvo mirror-based implementation is verified through simulation and proof-of-principle experiments. Fluorescent nanoparticles and ~ 1 kB double-stranded DNA molecules were tracked via both the original piezoelectric stage and new galvo mirror implementations. With the new galvo-based implementation, notable increases in tracking duration, localization precision, and the degree to which the objects are locked to the center of the detection volume were observed. These results suggest faster control response elements can expand RT-3D-SPT to a broader range of chemical and biological systems. 
    more » « less
  3. Accurately measuring the translations of objects between images is essential in many fields, including biology, medicine, chemistry, and physics. One important application is tracking one or more particles by measuring their apparent displacements in a series of images. Popular methods, such as the center of mass, often require idealized scenarios to reach the shot noise limit of particle tracking and, therefore, are not generally applicable to multiple image types. More general methods, such as maximum likelihood estimation, reliably approach the shot noise limit, but are too computationally intense for use in real-time applications. These limitations are significant, as real-time, shot-noise-limited particle tracking is of paramount importance for feedback control systems. To fill this gap, we introduce a new cross-correlation-based algorithm that approaches shot-noise-limited displacement detection and a graphics processing unit-based implementation for real-time image analysis of a single particle. 
    more » « less
  4. Passive monitoring of acoustic or radio sources has important applications in modern convenience, public safety, and surveillance. A key task in passive monitoring is multiobject tracking (MOT). This paper presents a Bayesian method for multisensor MOT for challenging tracking problems where the object states are high-dimensional, and the measurements follow a nonlinear model. Our method is developed in the framework of factor graphs and the sum-product algorithm (SPA) and implemented using random samples or “particles”. The multimodal probability density functions provided by the SPA are effectively represented by a Gaussian mixture model (GMM). To perform the operations of the SPA with improved sample efficiency, we make use of particle flow (PFL). Here, particles are migrated towards regions of high likelihood based on the solution of a partial differential equation. This makes it possible to obtain good object detection and tracking performance even in challenging multisensor MOT scenarios with single sensor measurements that have a lower dimension than the object positions. We perform a numerical evaluation in a passive acoustic monitoring scenario where multiple sources are tracked in 3-D from 1-D time difference-of-arrival (TDOA) measurements provided by pairs of hydrophones. Our numerical results, obtained by processing synthetic and real data, demonstrate favorable detection and estimation accuracy compared to state-of-the-art reference techniques. 
    more » « less
  5. A promising new route for structural biology is single-particle imaging with an X-ray Free-Electron Laser (XFEL). This method has the advantage that the samples do not require crystallization and can be examined at room temperature. However, high-resolution structures can only be obtained from a sufficiently large number of diffraction patterns of individual molecules, so-called single particles. Here, we present a method that allows for efficient identification of single particles in very large XFEL datasets, operates at low signal levels, and is tolerant to background. This method uses supervised Geometric Machine Learning (GML) to extract low-dimensional feature vectors from a training dataset, fuse test datasets into the feature space of training datasets, and separate the data into binary distributions of “single particles” and “non-single particles.” As a proof of principle, we tested simulated and experimental datasets of the Coliphage PR772 virus. We created a training dataset and classified three types of test datasets: First, a noise-free simulated test dataset, which gave near perfect separation. Second, simulated test datasets that were modified to reflect different levels of photon counts and background noise. These modified datasets were used to quantify the predictive limits of our approach. Third, an experimental dataset collected at the Stanford Linear Accelerator Center. The single-particle identification for this experimental dataset was compared with previously published results and it was found that GML covers a wide photon-count range, outperforming other single-particle identification methods. Moreover, a major advantage of GML is its ability to retrieve single particles in the presence of structural variability. 
    more » « less