An official website of the United States government
Accurate and real-time gait analysis is essential for enhancing performance and reducing injury risks in treadmill running. In this paper, we introduce VibRun, an unobtrusive gait analysis system that estimates key physiological metrics, such as cadence, ground contact time, stride time, center of pressure, and plantar pressure distribution, through footstep vibrations captured by low-cost treadmill-mounted sensors. Leveraging advanced multi-task transformer models, our system offers a robust, real-time solution to monitor and analyze running biomechanics without requiring intrusive wearable devices. This approach enables seamless integration into virtual sports, gaming platforms, and immersive exercise environments, enhancing the running experience by providing personalized feedback. By offering precise biomechanical insights in real-time, VibRun paves the way for future applications in virtual sports, gamified fitness, and interactive training programs, empowering users to engage more effectively in their training sessions while improving overall performance and reducing injury risks. Extensive evaluations with 17 participants across varied treadmill running scenarios demonstrate VibRun's accuracy in real-time gait analysis. For instance, VibRun achieves a mean error of 28.8 ms in ground contact time and a distance of 13.66 mm in the center of pressure, among other measured metrics, highlighting its precise performance across multiple gait parameters.
more »
« less
This content will become publicly available on September 3, 2026
MM-RunAssist: mmWave-based Respiratory and Running Rhythm Analysis during Treadmill Workouts
Treadmill running is a common workout for individuals across fitness levels. In this paper, we propose mm-RunAssist, a first-of-its-kind mmWave-based system that enhances treadmill workouts by monitoring respiration waveforms, running rhythm (i.e., coordination between breathing and strides), and detecting fall-off events. Extracting respiration from moving subjects using RF signals is challenging due to dominant motion artifacts. While prior deep learning efforts use adversarial or contrastive learning to mitigate such artifacts, they have been evaluated primarily under low-intensity activities like walking. To address this gap, mm-RunAssist introduces a Dual-task Variational U-Net that shares latent representations between respiration and upper-body movement tracking. This dual-task setup, guided by belt and depth sensors during training, improves reconstruction under intense body motion. Our system not only recovers fine-grained respiratory patterns during running but also supports cadence analysis through arm swing tracking. Extensive experiments with three state-of-the-art baselines under various conditions demonstrate mm-RunAssist's robustness and accuracy in treadmill running scenarios. Results show that mm-RunAssist advances RF sensing by effectively extracting vital signs even during vigorous body movements, offering new capabilities for fitness monitoring and non-intrusive health assessment.
more »
« less
- Award ID(s):
- 2132106
- PAR ID:
- 10638822
- Publisher / Repository:
- ACM
- Date Published:
- Journal Name:
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Volume:
- 9
- Issue:
- 3
- ISSN:
- 2474-9567
- Page Range / eLocation ID:
- 1 to 24
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
While radio frequency (RF) based respiration monitoring for at- home health screening is receiving increasing attention, robustness remains an open challenge. In recent work, deep learning (DL) methods have been demonstrated effective in dealing with non- linear issues from multi-path interference to motion disturbance, thus improving the accuracy of RF-based respiration monitoring. However, such DL methods usually require large amounts of train- ing data with intensive manual labeling efforts, and frequently not openly available. We propose RF-Q for robust RF-based respiration monitoring, using self-supervised learning with an autoencoder (AE) neural network to quantify the quality of respiratory signal based on the residual between the original and reconstructed sig- nals. We demonstrate that, by simply quantifying the signal quality with AE for weighted estimation we can boost the end-to-end (e2e) respiration monitoring accuracy by an improvement ratio of 2.75 compared to a baseline.more » « less
-
PurposeThe Radiofrequency (RF)‐induced heating for an active implantable medical device (AIMD) with dual parallel leads is evaluated in this paper. The coupling effects between dual parallel leads are studied via simulations and experiments methods. The global transfer function technique is used to assess the RF‐induced heating for dual‐lead AIMDs inside four human body models. MethodsRF‐induced heating for spinal cord stimulator systems with 60 and 90 cm length leads are studied at three parallel dual‐lead configurations (closely spaced, 8 mm spaced, and 40 mm spaced) and a single‐lead configuration. The global transfer function method is used to develop the AIMD models of different configurations and is used for lead‐tip heating assessments inside human body models. ResultsIn simulation studies, the peak 1g specific absorption rate/temperatrue rises of dual parallel leads systems is lower than those from the single‐lead system. In experimental American Society for Testing and Materials phantom studies, the temperature rises for the single‐lead AIMD system can be 2.4 times higher than that from dual‐lead AIMD systems. For the spinal cord stimulator systems used in the study, the statistical analysis shows the RF‐induced heating of dual‐lead configurations are also lower than those from the single‐lead configuration inside all four human body models. ConclusionFor the AIMD system in this study, it shows that the coupling effects between the dual parallel leads of AIMD systems can reduce RF‐induced heating. The global transfer function for different spatial distance dual‐lead configurations can potentially provide a method for the RF‐induced heating evaluation for dual‐lead AIMD systems.more » « less
-
Emerging Virtual Reality (VR) displays with embedded eye trackers are currently becoming a commodity hardware (e.g., HTC Vive Pro Eye). Eye-tracking data can be utilized for several purposes, including gaze monitoring, privacy protection, and user authentication/identification. Identifying users is an integral part of many applications due to security and privacy concerns. In this paper, we explore methods and eye-tracking features that can be used to identify users. Prior VR researchers explored machine learning on motion-based data (such as body motion, head tracking, eye tracking, and hand tracking data) to identify users. Such systems usually require an explicit VR task and many features to train the machine learning model for user identification. We propose a system to identify users utilizing minimal eye-gaze-based features without designing any identification-specific tasks. We collected gaze data from an educational VR application and tested our system with two machine learning (ML) models, random forest (RF) and k-nearest-neighbors (kNN), and two deep learning (DL) models: convolutional neural networks (CNN) and long short-term memory (LSTM). Our results show that ML and DL models could identify users with over 98% accuracy with only six simple eye-gaze features. We discuss our results, their implications on security and privacy, and the limitations of our work.more » « less
-
Performance improvements obtained by recent principled approaches for pulse rate (PR) estimation from face videos have typically been achieved by adding or modifying certain modules within a reconfigurable system. Yet, evaluations of such remote photoplethysmography (rPPG) are usually performed only at the system level. To better understand each module's contribution and facilitate future research in explainable learning and artificial intelligence for physiological monitoring, this paper conducts a comparative study of video-based, principled PR tracking algorithms, with a focus on challenging fitness scenarios. A review of the progress achieved over the last decade and a half in this field is utilized to construct the major processing modules of a reconfigurable remote pulse rate sensing system. Experiments are conducted on two challenging datasets—an internal collection of 25 videos of two Asian males exercising on stationary-bike, elliptical, and treadmill machines, and 34 videos from a public ECG fitness database of 14 men and 3 women exercising on elliptical and stationary-bike machines. The signal-to-noise ratio (SNR), Pearson's correlation coefficient, error count ratio, error rate, and root mean squared error are used for performance evaluation. The top-performing configuration produces respective values of −0.8 dB, 0.86, 9%, 1.7%, and 3.3 beats per minute (bpm) for the internal dataset and 1.3 dB, 0.77, 28.6%, 6.0%, and 8.1 bpm for the ECG Fitness dataset, achieving significant improvements over alternative configurations. Our results suggest a synergistic effect between pulse color mapping and adaptive motion filtering, as well as the importance of a robust frequency tracking algorithm for PR estimation in low SNR settings.more » « less
