An official website of the United States government
Purpose: Robotic-assisted carotid artery stenting (CAS) cases have been demonstrated with promising results. However, no quantitative measurements have been made to compare manual with robotic-assisted CAS. This study aims to quantify surgical performance using tool tip kinematic data and metrics of precision during CAS with manual and robotic control in an ex vivo model. Materials and Methods: Transfemoral CAS cases were performed in a high-fidelity endovascular simulator. Participants completed cases with manual and robotic techniques in 2 different carotid anatomies in random order. C-arm angulations, table position, and endovascular devices were standardized. Endovascular tool tip kinematic data were extracted. We calculated the spectral arc length (SPARC), average velocity, and idle time during navigation in the common carotid artery and lesion crossing. Procedural time, fluoroscopy time, movements of the deployed filter wire, precision of stent, and balloon positioning were recorded. Data were analyzed and compared between the 2 modalities. Results: Ten participants performed 40 CAS cases with a procedural success of 100% and 0% residual stenosis. The median procedural time was significantly higher during the robotic-assisted cases (seconds, median [interquartile range, IQR]: 128 [49.5] and 161.5 [62.5], p=0.02). Fluoroscopy time differed significantly between manual and robotic-assisted procedures (seconds, median [IQR]: 81.5 [32] and 98.5 [39.5], p=0.1). Movement of the deployed filter wire did not show significant difference between manual and robotic interventions (mm, median [IQR]: 13 [10.5] and 12.5 [11], p=0.5). The postdilation balloon exceeded the margin of the stent with a median of 2 [1] mm in both groups. Navigation with robotic assistance showed significantly lower SPARC values (–5.78±3.14 and –8.63±3.98, p=0.04) and higher idle time values (8.92±8.71 and 3.47±3.9, p=0.02) than those performed manually. Conclusions: Robotic-assisted and manual CAS cases are comparable in the precision of stent and balloon positioning. Navigation in the carotid artery is associated with smoother motion and higher idle time values. These findings highlight the accuracy and the motion stabilizing capability of the endovascular robotic system. Clinical Impact Robotic assistance in the treatment of peripheral vascular disease is an emerging field and may be a tool for radiation protection and the geographic distribution of endovascular interventions in the future. This preclinical study compares the characteristics of manual and robotic-assisted carotid stenting (CAS). Our results highlight, that robotic-assisted CAS is associated with precise navigation and device positioning, and smoother navigation compared to manual CAS.
more »
« less
Velocity-Domain Motion Quality Measures for Surgical Performance Evaluation and Feedback
Abstract Endovascular navigation proficiency requires a significant amount of manual dexterity from surgeons. Objective performance measures derived from endovascular tool tip kinematics have been shown to correlate with expertise; however, such metrics have not yet been used during training as a basis for real-time performance feedback. This paper evaluates a set of velocity-based performance measures derived from guidewire motion to determine their suitability for online performance evaluation and feedback. We evaluated the endovascular navigation skill of 75 participants using three metrics (spectral arc length, average velocity, and idle time) as they steered tools to anatomical targets using a virtual reality simulator. First, we examined the effect of navigation task and experience level on performance and found that novice performance was significantly different from intermediate and expert performance. Then we computed correlations between measures calculated online and spectral arc length, our "gold standard" metric, calculated offline (at the end of the trial, using data from the entire trial). Our results suggest that average velocity and idle time calculated online are strongly and consistently correlated with spectral arc length computed offline, which was not the case when comparing spectral arc length computed online and offline. Average velocity and idle time, both time-domain based performance measures, are therefore more suitable measures than spectral arc length, a frequency-domain based metric, to use as the basis of online performance feedback. Future work is needed to determine how to best provide real-time performance feedback to endovascular surgery trainees based on these metrics.
more »
« less
- Award ID(s):
- 1638073
- PAR ID:
- 10208833
- Date Published:
- Journal Name:
- Journal of Medical Devices
- ISSN:
- 1932-6181
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The effectiveness of clarification question models in engaging users within search systems is currently constrained, casting doubt on their overall usefulness. To improve the performance of these models, it is crucial to employ assessment approaches that encompass both real-time feedback from users (online evaluation) and the characteristics of clarification questions evaluated through human assessment (offline evaluation). However, the relationship between online and offline evaluations has been debated in information retrieval. This study aims to investigate how this discordance holds in search clarification. We use user engagement as ground truth and employ several offline labels to investigate to what extent the offline ranked lists of clarification resemble the ideal ranked lists based on online user engagement. Contrary to the current understanding that offline evaluations fall short of supporting online evaluations, we indicate that when identifying the most engaging clarification questions from the user’s perspective, online and offline evaluations correspond with each other. We show that the query length does not influence the relationship between online and offline evaluations, and reducing uncertainty in online evaluation strengthens this relationship. We illustrate that an engaging clarification needs to excel from multiple perspectives, and SERP quality and characteristics of the clarification are equally important. We also investigate if human labels can enhance the performance of Large Language Models (LLMs) and Learning-to-Rank (LTR) models in identifying the most engaging clarification questions from the user’s perspective by incorporating offline evaluations as input features. Our results indicate that LTR models do not perform better than individual offline labels. However, GPT, an LLM, emerges as the standout performer, surpassing all LTR models and offline labels.more » « less
-
Person Re-IDentification (P-RID), as an instance-level recognition problem, still remains challenging in computer vision community. Many P-RID works aim to learn faithful and discriminative features/metrics from offline training data and directly use them for the unseen online testing data. However, their performance is largely limited due to the severe data shifting issue between training and testing data. Therefore, we propose an online joint multi-metric adaptation model to adapt the offline learned P-RID models for the online data by learning a series of metrics for all the sharing-subsets. Each sharing-subset is obtained from the proposed novel frequent sharing-subset mining module and contains a group of testing samples which share strong visual similarity relationships to each other. Unlike existing online P-RID methods, our model simultaneously takes both the sample-specific discriminant and the set-based visual similarity among testing samples into consideration so that the adapted multiple metrics can refine the discriminant of all the given testing samples jointly via a multi-kernel late fusion framework. Our proposed model is generally suitable to any offline learned P-RID baselines for online boosting, the performance improvement by our model is not only verified by extensive experiments on several widely-used P-RID benchmarks (CUHK03, Market1501, DukeMTMC-reID and MSMT17) and state-of-the-art P-RID baselines but also guaranteed by the provided in-depth theoretical analyses.more » « less
-
The feedback arc set problem is one of the most fundamental and well-studied ranking problems where n objects are to be ordered based on their pairwise comparison. The problem enjoys several efficient approximation algorithms in the offline setting. Unfortunately, online there are strong lower bounds on the competitive ratio establishing that no algorithm can perform well in the worst case.This paper introduces a new beyond-worst-case model for online feedback arc set. In the model, a sample of the input is given to the algorithm offline before the remaining instance is revealed online. This models the case in practice where yesterday's data is available and is similar to today's online instance. This sample is drawn from a known distribution which may not be uniform. We design an online algorithm with strong theoretical guarantees. The algorithm has a small constant competitive ratio when the sample is uniform---if not, we show we can recover the same result by adding a provably minimal sample. Empirical results validate the theory and show that such algorithms can be used on temporal data to obtain strong results.more » « less
-
Existing solutions to instance-level visual identification usually aim to learn faithful and discriminative feature extractors from offline training data and directly use them for the unseen online testing data. However, their performance is largely limited due to the severe distribution shifting issue between training and testing samples. Therefore, we propose a novel online group-metric adaptation model to adapt the offline learned identification models for the online data by learning a series of metrics for all sharing-subsets. Each sharing-subset is obtained from the proposed novel frequent sharing-subset mining module and contains a group of testing samples that share strong visual similarity relationships to each other. Furthermore, to handle potentially large-scale testing samples, we introduce self-paced learning (SPL) to gradually include samples into adaptation from easy to difficult which elaborately simulates the learning principle of humans. Unlike existing online visual identification methods, our model simultaneously takes both the sample-specific discriminant and the set-based visual similarity among testing samples into consideration. Our method is generally suitable to any off-the-shelf offline learned visual identification baselines for online performance improvement which can be verified by extensive experiments on several widely-used visual identification benchmarks.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1115/1.4049310
