An official website of the United States government
Basic vital signs such as heart and respiratory rates (HR and RR) are essential bio-indicators. Their longitudinal in-home collection enables prediction and detection of disease onset and change, providing for earlier health intervention. In this paper, we propose a robust, non-touch vital signs monitoring system using a pair of co-located Ultra-Wide Band (UWB) and depth sensors. By extensive manual examination, we identify four typical temporal and spectral signal patterns and their suitable vital signs estimators. We devise a probabilistic weighted framework (PWF) that quantifies evidence of these patterns to update the weighted combination of estimator output to track the vital signs robustly. We also design a “heatmap” based signal quality detector to exclude the disturbed signal from inadvertent motions. To monitor multiple co-habiting subjects in-home, we build a two-branch long short-term memory (LSTM) neural network to distinguish between individuals and their activities, providing activity context crucial to disambiguating critical from normal vital sign variability. To achieve reliable context annotation, we carefully devise the feature set of the consecutive skeletal poses from the depth data, and develop a probabilistic tracking model to tackle non-line-of-sight (NLOS) cases. Our experimental results demonstrate the robustness and superior performance of the individual modules as well as the end-to-end system for passive and context-aware vital signs monitoring.
more »
« less
DeepVS: A Deep Learning Approach For RF-based Vital Signs Sensing
Vital signs (e.g., heart and respiratory rate) are indicative for health status assessment. Efforts have been made to extract vital signs using radio frequency (RF) techniques (e.g., Wi-Fi, FMCW, UWB), which offer a non-touch solution for continuous and ubiquitous monitoring without users’ cooperative efforts. While RF-based vital signs monitoring is user-friendly, its robustness faces two challenges. On the one hand, the RF signal is modulated by the periodic chest wall displacement due to heartbeat and breathing in a nonlinear manner. It is inherently hard to identify the fundamental heart and respiratory rates (HR and RR) in the presence of higher order harmonics of them and intermodulation between HR and RR, especially when they have overlapping frequency bands. On the other hand, the inadvertent body movements may disturb and distort the RF signal, overwhelming the vital signals, thus inhibiting the parameter estimation of the physiological movement (i.e., heartbeat and breathing). In this paper, we propose DeepVS, a deep learning approach that addresses the aforementioned challenges from the non-linearity and inadvertent movements for robust RF-based vital signs sensing in a unified manner. DeepVS combines 1D CNN and attention models to exploit local features and temporal correlations. Moreover, it leverages a two-stream scheme to integrate features from both time and frequency domains. Additionally, DeepVS unifies the estimation of HR and RR with a multi-head structure, which only adds limited extra overhead (<1%) to the existing model, compared to doubling the overhead using two separate models for HR and RR respectively. Our experiments demonstrate that DeepVS achieves 80-percentile HR/RR errors of 7.4/4.9 beat/breaths per minute (bpm) on a challenging dataset, as compared to 11.8/7.3 bpm of a non-learning solution. Besides, an ablation study has been conducted to quantify the effectiveness of DeepVS.
more »
« less
- Award ID(s):
- 2119299
- PAR ID:
- 10356921
- Date Published:
- Journal Name:
- In 13th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics (BCB ’22)
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Baba, Justin S; Coté, Gerard L (Ed.)In this research, we examine the potential of measuring physiological variables, including heart rate (HR) and respiration rate (RR) on the upper arm using a wireless multimodal sensing system consisting of an accelerometer, a gyroscope, a three-wavelength photoplethysmography (PPG), single-sided electrocardiography (SS-ECG), and bioimpedance (BioZ). The study included collecting HR data when the subject was at rest and typing, and RR data when the subject was at rest. The data from three wavelengths of PPG and BioZ were collected and compared to the SS-ECG as the standard. The accelerometer and gyro signals were used to exclude data with excessive noise due to motion. The results showed that when the subject remained sedentary, the mean absolute error (MAE) for the HR calculation for all three wavelengths of the PPG modality was less than two bpm, while the BioZ was 3.5 bpm compared with SS-ECG HR. The MAE for typing increased for both modalities and was less than three bpm for all three wavelengths of the PPG but increased to 7.5 bpm for the BioZ. Regarding RR, both modalities resulted in RR within one breath per minute of the SS-ECG modality for the one breathing rate. Overall, all modalities on this upper arm wearable worked well when the subject was sedentary. Still, the SS-ECG and PPG showed less variability for the HR signal in the presence of motion during micro-motions such as typing.more » « less
-
Non-contact vital signs monitoring (NCVSM) with radio frequency (RF) is attracting increasing attention due to its non-invasive nature. Recent advances in COTS radar technologies accelerate the development of RF-based solutions. While researchers have implemented and demonstrated the feasibility of NCVSM with diverse radar hardware, most efforts have been focused on devising algorithms to extract vital signs, with limited understanding about the effects of radar configurations. The deficiency in such understanding hinders the design of software defined radar (SDR) optimally customized for NCVSM. In this work, we first hypothesize the effects of FMCW radar configurations using signal-to-interference-plus-noise ratio (SINR) based signal modeling, then we conduct extensive experiments with a COTS FMCW radar, TinyRad, to understand how various parameters impact NCVSM performance compared to a medical device. We find that a larger bandwidth or higher transmitting power in general improves vital sign estimation accuracy; however, coherent processing of consecutive chirps (time diversity) or multiple receiving antennas (space diversity) does not improve the performance. Observations on the baseband (BB) signal show that coherent processing contributes to a higher amplitude but similar phase patterns, whose periodic changes are the key in extracting vital signs.more » « less
-
Continuous monitoring of respiration provides invaluable insights about health status management (e.g., the progression or recovery of diseases). Recent advancements in radio frequency (RF) technologies show promise for continuous respiration monitoring by virtue of their non-invasive nature, and preferred over wearable solutions that require frequent charging and continuous wearing. However, RF signals are susceptible to large body movements, which are inevitable in real life, challenging the robustness of respiration monitoring. While many existing methods have been proposed to achieve robust RF-based respiration monitoring, their reliance on supervised data limits their potential for broad applicability. In this context, we propose, RF-Q, an unsupervised/self-supervised model to achieve signal quality assessment and quality-aware estimation for robust RF-based respiration monitoring. RF-Q uses the recon- struction error of an autoencoder (AE) neural network to quantify the quality of respiratory information in RF signals without the need for data labeling. With the combination of the quantified sig- nal quality and reconstructed signal in a weighted fusion, we are able to achieve improved robustness of RF respiration monitor- ing. We demonstrate that, instead of applying sophisticated models devised with respective expertise using a considerable amount of labeled data, by just quantifying the signal quality in an unsupervised manner we can significantly boost the average end-to-end (e2e) respiratory rate estimation accuracy of a baseline by an improvement ratio of 2.75, higher than the gain of 1.94 achieved by a supervised baseline method that excludes distorted data.more » « less
-
Treadmill running is a common workout for individuals across fitness levels. In this paper, we propose mm-RunAssist, a first-of-its-kind mmWave-based system that enhances treadmill workouts by monitoring respiration waveforms, running rhythm (i.e., coordination between breathing and strides), and detecting fall-off events. Extracting respiration from moving subjects using RF signals is challenging due to dominant motion artifacts. While prior deep learning efforts use adversarial or contrastive learning to mitigate such artifacts, they have been evaluated primarily under low-intensity activities like walking. To address this gap, mm-RunAssist introduces a Dual-task Variational U-Net that shares latent representations between respiration and upper-body movement tracking. This dual-task setup, guided by belt and depth sensors during training, improves reconstruction under intense body motion. Our system not only recovers fine-grained respiratory patterns during running but also supports cadence analysis through arm swing tracking. Extensive experiments with three state-of-the-art baselines under various conditions demonstrate mm-RunAssist's robustness and accuracy in treadmill running scenarios. Results show that mm-RunAssist advances RF sensing by effectively extracting vital signs even during vigorous body movements, offering new capabilities for fitness monitoring and non-intrusive health assessment.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3535508.3545554
