An official website of the United States government
Real-time three-dimensional single-particle tracking (RT-3D-SPT) allows continuous detection of individual freely diffusing objects with high spatiotemporal precision by applying closed-loop active feedback in an optical microscope. However, the current tracking speed in RT-3D-SPT is primarily limited by the response time of control actuators, impeding long-term observation of fast diffusive objects such as single molecules. Here, we present an RT-3D-SPT system with improved tracking performance by replacing the XY piezoelectric stage with a galvo scanning mirror with an approximately five-time faster response rate (~5 kHz). Based on the previously developed 3D single-molecule active real-time tracking (3D-SMART), this new implementation with a fast-responding galvo mirror eliminates the mechanical movement of the sample and allows more rapid response to particle motion. The improved tracking performance of the galvo mirror-based implementation is verified through simulation and proof-of-principle experiments. Fluorescent nanoparticles and ~ 1 kB double-stranded DNA molecules were tracked via both the original piezoelectric stage and new galvo mirror implementations. With the new galvo-based implementation, notable increases in tracking duration, localization precision, and the degree to which the objects are locked to the center of the detection volume were observed. These results suggest faster control response elements can expand RT-3D-SPT to a broader range of chemical and biological systems.
more »
« less
Information-Efficient, Off-Center Sampling Results in Improved Precision in 3D Single-Particle Tracking Microscopy
In this work, we present a 3D single-particle tracking system that can apply tailored sampling patterns to selectively extract photons that yield the most information for particle localization. We demonstrate that off-center sampling at locations predicted by Fisher information utilizes photons most efficiently. When performing localization in a single dimension, optimized off-center sampling patterns gave doubled precision compared to uniform sampling. A ~20% increase in precision compared to uniform sampling can be achieved when a similar off-center pattern is used in 3D localization. Here, we systematically investigated the photon efficiency of different emission patterns in a diffraction-limited system and achieved higher precision than uniform sampling. The ability to maximize information from the limited number of photons demonstrated here is critical for particle tracking applications in biological samples, where photons may be limited.
more »
« less
- Award ID(s):
- 1847899
- PAR ID:
- 10319231
- Date Published:
- Journal Name:
- Entropy
- Volume:
- 23
- Issue:
- 5
- ISSN:
- 1099-4300
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Spectroscopic single-molecule localization microscopy (sSMLM) was used to achieve simultaneous imaging and spectral analysis of single molecules for the first time. Current sSMLM fundamentally suffers from a reduced photon budget because the photons from individual stochastic emissions are divided into spatial and spectral channels. Therefore, both spatial localization and spectral analysis only use a portion of the total photons, leading to reduced precisions in both channels. To improve the spatial and spectral precisions, we present symmetrically dispersed sSMLM, or SDsSMLM, to fully utilize all photons from individual stochastic emissions in both spatial and spectral channels. SDsSMLM achieved 10-nm spatial and 0.8-nm spectral precisions at a total photon budget of 1000. Compared with the existing sSMLM using a 1:3 splitting ratio between spatial and spectral channels, SDsSMLM improved the spatial and spectral precisions by 42% and 10%, respectively, under the same photon budget. We also demonstrated multicolour imaging of fixed cells and three-dimensional single-particle tracking using SDsSMLM. SDsSMLM enables more precise spectroscopic single-molecule analysis in broader cell biology and material science applications.more » « less
-
Spectroscopic single-molecule localization microscopy (sSMLM) generates super-resolution images of single molecules while simultaneously capturing the spectra of their fluorescence emissions. However, sSMLM splits photons from single-molecule emissions into a spatial channel and a spectral channel, reducing both channels’ precisions. It is also challenging in transmission grating-based sSMLM to achieve a large field-of-view (FOV) and avoid overlap between the spatial and spectral channels. The challenge in FOV has further significance in single-molecule tracking applications. In this work, we analyzed the correlation between the spatial and spectral channels in sSMLM to improve its spatial precision, and we developed a split-mirror assembly to enlarge its FOV. We demonstrate the benefits of these improvements by tracking quantum dots. We also show that we can reduce particle-identification ambiguity by tagging each particle with its unique spectral characteristics.more » « less
-
By manipulating the spectral dispersion of detected photons, spectroscopic single-molecule localization microscopy (sSMLM) permits concurrent high-throughput single-molecular spectroscopic analysis and imaging. Despite its promising potential, using discrete optical components and managing the delicate balance between spectral dispersion and spatial localization compromise its performance, including non-uniform spectral dispersion, high transmission loss of grating, high optical alignment demands, and reduced precision. We designed a dual-wedge prism (DWP)-based monolithic imaging spectrometer to overcome these challenges. We optimized the DWP for spectrally dispersing focused beam without deviation and with minimal wavefront error. We integrated all components into a compact assembly, minimizing total transmission loss and significantly reducing optical alignment requirements. We show the feasibility of DWP using ray-tracing and numerical simulations. We validated our numerical simulations by experimentally imaging individual nanospheres and confirmed that DWP-sSMLM achieved much improved spatial and spectral precisions of grating-based sSMLM. We also demonstrated DWP-sSMLM in 3D multi-color imaging of cells.more » « less
-
The main challenge of monocular 3D object detection is the accurate localization of 3D center. Motivated by a new and strong observation that this challenge can be remedied by a 3D-space local-grid search scheme in an ideal case, we propose a stage-wise approach, which combines the information flow from 2D-to-3D (3D bounding box proposal generation with a single 2D image) and 3D-to-2D (proposal verification by denoising with 3D-to-2D contexts) in a topdown manner. Specifically, we first obtain initial proposals from off-the-shelf backbone monocular 3D detectors. Then, we generate a 3D anchor space by local-grid sampling from the initial proposals. Finally, we perform 3D bounding box denoising at the 3D-to-2D proposal verification stage. To effectively learn discriminative features for denoising highly overlapped proposals, this paper presents a method of using the Perceiver I/O model [20] to fuse the 3D-to-2D geometric information and the 2D appearance information. With the encoded latent representation of a proposal, the verification head is implemented with a self-attention module. Our method, named as MonoXiver, is generic and can be easily adapted to any backbone monocular 3D detectors. Experimental results on the well-established KITTI dataset and the challenging large-scale Waymo dataset show that MonoXiver consistently achieves improvement with limited computation overhead.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3390/e23050498
