An official website of the United States government
Tracking microrobots is challenging, considering their minute size and high speed. As the field progresses towards developing microrobots for biomedical applications and conducting mechanistic studies in physiologically relevant media (e.g., collagen), this challenge is exacerbated by the dense surrounding environments with feature size and shape comparable to microrobots. Herein, we report Motion Enhanced Multi-level Tracker (MEMTrack), a robust pipeline for detecting and tracking microrobots using synthetic motion features, deep learning-based object detection, and a modified Simple Online and Real-time Tracking (SORT) algorithm with interpolation for tracking. Our object detection approach combines different models based on the object's motion pattern. We trained and validated our model using bacterial micro-motors in collagen (tissue phantom) and tested it in collagen and aqueous media. We demonstrate that MEMTrack accurately tracks even the most challenging bacteria missed by skilled human annotators, achieving precision and recall of 77% and 48% in collagen and 94% and 35% in liquid media, respectively. Moreover, we show that MEMTrack can quantify average bacteria speed with no statistically significant difference from the laboriously-produced manual tracking data. MEMTrack represents a significant contribution to microrobot localization and tracking, and opens the potential for vision-based deep learning approaches to microrobot control in dense and low-contrast settings. All source code for training and testing MEMTrack and reproducing the results of the paper have been made publicly available this https URL.
more »
« less
Detecting and Tracking Hard-to-Detect Bacteria in Dense Porous Backgrounds
Studying bacteria motility is crucial to understanding and controlling biomedical and ecological phenomena involving bacteria. Tracking bacteria in complex environments such as polysaccharides (agar) or protein (collagen) hydrogels is a challenging task due to the lack of visually distinguishable features between bacteria and surrounding environment, making state-of-the-art methods for tracking easily recognizable objects such as pedestrians and cars unsuitable for this application. We propose a novel pipeline for detecting and tracking bacteria in bright-field microscopy videos involving bacteria in complex backgrounds. Our pipeline uses motion-based features and combines multiple models for detecting bacteria of varying difficulty levels. We apply multiple filters to prune false positive detections, and then use the SORT tracking algorithm with interpolation in case of missing detections. Our results demonstrate that our pipeline can accurately track hard-to-detect bacteria, achieving a high precision and recall.
more »
« less
- Award ID(s):
- 2107332
- PAR ID:
- 10470115
- Publisher / Repository:
- CVPR Workshop on CV4Animals 2023
- Date Published:
- Format(s):
- Medium: X
- Location:
- Vancouver, BC, Canada
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Multiple-particle tracking (MPT) is a microscopy technique capable of simultaneously tracking hundreds to thousands of nanoparticles in a biological sample and has been used extensively to characterize biological microenvironments, including the brain extracellular space (ECS). Machine learning techniques have been applied to MPT data sets to predict the diffusion mode of nanoparticle trajectories as well as more complex biological variables, such as biological age. In this study, we develop a machine learning pipeline to predict and investigate changes to the brain ECS due to injury using supervised classification and feature importance calculations. We first validate the pipeline on three related but distinct MPT data sets from the living brain ECS—age differences, region differences, and enzymatic degradation of ECS structure. We predict three ages with 86% accuracy, three regions with 90% accuracy, and healthy versus enzyme-treated tissue with 69% accuracy. Since injury across groups is normally compared with traditional statistical approaches, we first used linear mixed effects models to compare features between healthy control conditions and injury induced by two different oxygen glucose deprivation exposure times. We then used machine learning to predict injury state using MPT features. We show that the pipeline predicts between the healthy control, 0.5 h OGD treatment, and 1.5 h OGD treatment with 59% accuracy in the cortex and 66% in the striatum, and identifies nonlinear relationships between trajectory features that were not evident from traditional linear models. Our work demonstrates that machine learning applied to MPT data is effective across multiple experimental conditions and can find unique biologically relevant features of nanoparticle diffusion.more » « less
-
null (Ed.)Eye tracking tools are used in software engineering research to study various software development activities. However, a major limitation of these tools is their inability to track gaze data for activities that involve source code editing. We present a novel solution to support eye tracking experiments for tasks involving source code edits as an extension of the iTrace community infrastructure. We introduce the iTrace-Atom plugin and gazel—a Python data processing pipeline that maps gaze information to changing source code elements and provides researchers with a way to query this dynamic data. iTrace-Atom is evaluated via a series of simulations and is over 99% accurate at high eye-tracking speeds of over 1,000Hz. iTrace and gazel completely revolutionize the way eye tracking studies are conducted in realistic settings with the presence of scrolling, context switching, and now editing. This opens the doors to support many day-to-day software engineering tasks such as bug fixing, adding new features, and refactoring.more » « less
-
We present a novel method for identifying topological features of chromatin domains in live cells using single-particle tracking and topological data analysis (TDA). By applying TDA to particle trajectories, we can effectively detect complex spatial patterns, such as loops, that are often missed by traditional time series analysis. Using simulations of polymer bead–spring chains, we have validated the accuracy of our method and determined its limitations for detecting loops. Our approach offers a promising avenue for exploring the topological complexity of chromatin in living cells using TDA techniques.more » « less
-
Modern-day radar is used extensively in applications such as autonomous driving, robotics, air traffic control, and maritime operations. The commonality between the aforementioned examples is the underlying tracking filter used to process ambiguous detections and track multiple targets. In this paper, we present a Software-Defined Radio-based radar testbed that leverages controllable and repeatable large-scale wireless channel emulation to evaluate diverse radar applications experimentally without the complexity and expense of field testing. Through over-the-air (OTA) and emulated evaluation, we demonstrate the capa-bilities of this testbed to perform multiple-target tracking (MTT) via Joint Probabilistic Data Association (JPDA) filtering. This testbed features the use of flexible sub-6 GHz or mmWave operation, electromagnetic ray tracing for site-specific emulation, and software reconfigurable radar waveforms and processing. Although the testbed is designed generalizable, for this paper we demonstrate its capabilities using an advanced driver-assistance system radar application.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
