An official website of the United States government
Abstract Seismocardiography (SCG) is a technique that non-invasively measures the chest wall’s local vibrations caused by the heart’s mechanical activity. Traditionally, SCG signals have been recorded using accelerometers placed at a single location on the chest wall. This study presents an innovative, cost-effective SCG method that utilizes standard smartphone videos to capture data from multiple chest locations. The analysis of vibrations from multiple points can offer a more thorough understanding of the heart’s mechanical activity compared to signals obtained solely from a single chest location. Our approach employs computer vision and deep learning techniques to extract and improve the resolution of multichannel SCG maps obtained by video capture of chest movement. We attached a grid of patterned stickers to the chest surface and recorded videos of chest movements during different respiratory phases. Using a deep learning-based object detector and a template tracking method, we tracked the stickers across video frames and extracted the corresponding SCG signals from sticker displacements. We also developed a robust algorithm to estimate heart rate (HR) from these chest videos and identify the optimal chest location for HR estimation. The method was tested on 28 chest videos captured from 14 healthy participants. The results demonstrated that our method effectively extracted multichannel SCG maps and enhanced their resolution with a mean squared error of 0.1078 and 0.0418 for right-to-left and head-to-foot SCG signals, respectively. We observed intersubject chest vibration patterns corresponding to cardiac events including opening and closure of the heart valves. Moreover, our algorithm accurately estimated HR from 1968 SCG signals extracted from the videos compared to the gold-standard HR measured from each subject’s electrocardiogram (bias ± 1.96 SD = 0.04 ± 2.14 bpm;r = 0.99,p < 0.001). The findings from this study underscore the potential of our approach in developing a cardiac monitoring tool using a smartphone that would be widely accessible to the general public and might provide more timely detection of diseases.
more »
« less
This content will become publicly available on November 12, 2025
Abstract 4112524: Novel Contactless and AI-Based Method Can Determine Heart Rate and Cardiac-Induced Vibrations of Chest
Introduction:Seismocardiography (SCG) - measurements of cardiovascular-induced vibrations on the chest - has shown potential for providing clinical information for cardiac conditions. SCG is conventionally recorded by an accelerometer attached to a single point on chest. Recent research suggests multichannel SCG (mSCG) - measurements from multiple chest locations - can provide extra and more accurate clinical information. Current mSCG methods are limited to accelerometer arrays, laser Doppler vibrometry, and airborne ultrasound that are either costly, difficult for inexperienced users, or need bulky equipment, thereby impeding their use beyond research or clinical settings. Hypothesis:mSCG signals can be accurately estimated from tiny chest movements in chest videos recorded by ordinary cameras, e.g., those in smartphones. Methods:We enrolled 10 subjects (sbjs) with no history of CVDs (21.7 ± 1.7 years, 40% women). ECG and chest video of sbjs were recorded at rest for 15 sec during breath hold at the end of inhalation followed by another 15 sec recording during breath hold at the end of exhalation. We developed an AI-powered mobile app to record the chest videos and convert them to 0-30 Hz mSCG in right-to-left (RL) and head-to-foot (HF) directions (Fig 1a). Heart rate (HR) based on ECG RR interval and mSCG was measured and compared. Results:HR estimated from mSCG in both RL and HF directions had a good agreement with ECG-based HR using Bland-Altman analysis [RL: bias = 1.4 bpm, 95% CI = 5.6 bpm; HF: bias = 0.8 bpm, 95% CI = 6.2 bpm (Fig 1b)]. High-quality mSCG and ECG measurements were obtained for all sbjs. Conclusion:Clinically relevant information can be accurately extracted from chest videos using our novel, contactless, AI-based method. Given that the vast majority of Americans have access to a camera phone, future developments of this method may provide new means of remote and accessible cardiac monitoring.
more »
« less
- Award ID(s):
- 2340020
- PAR ID:
- 10580252
- Publisher / Repository:
- American Heart Association
- Date Published:
- Journal Name:
- Circulation
- Volume:
- 150
- Issue:
- Suppl_1
- ISSN:
- 0009-7322
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Seismocardiography (SCG) has attracted significant interest for monitoring cardiac health and diagnosing cardiovascular conditions. While traditional SCG methods rely on uncomfortable chest-mounted accelerometers, recent research explores non-contact approaches, including analyzing video recordings of the chest. In this study, three computer vision-based methods including Lucas-Kanade optical flow, template tracking, and Gunnar-Farneback optical flow were evaluated for extracting SCG signals from ordinary camera-recorded chest videos. The study focused on right-to-left and head-to-foot SCG signals obtained from 13 healthy subjects during breath-hold at the end of exhalation and inhalation. Comparative analysis was performed by calculating the mean squared error (MSE) and root MSE (RMSE) between the vision-based SCG signals and the gold-standard accelerometer signals. Visual and quantitative analyses showed that the Lucas-Kanade and template tracking methods estimated vision-based SCG signals closely resembling the accelerometer data, particularly in the head-to-foot direction. The Lucas-Kanade method had MSE values ranging from 0.14 to 0.93, RMSE values from 0.38 to 0.96, average correlation values of 0.82±0.09. The template tracking method showed MSE values between 0.12 to 0.94, RMSE values from 0.35 to 0.97, and average correlation values of 0.83±0.10. In comparison, the Farneback method had higher MSE values ranging from 0.20 to 1.07, RMSE values from 0.44 to 1.03, and average correlation values of 0.76±0.11. These results suggest the effectiveness of Lucas-Kanade and template tracking methods for non-contact SCG signal extraction from chest video data.more » « less
-
Baba, Justin S; Coté, Gerard L (Ed.)In this research, we examine the potential of measuring physiological variables, including heart rate (HR) and respiration rate (RR) on the upper arm using a wireless multimodal sensing system consisting of an accelerometer, a gyroscope, a three-wavelength photoplethysmography (PPG), single-sided electrocardiography (SS-ECG), and bioimpedance (BioZ). The study included collecting HR data when the subject was at rest and typing, and RR data when the subject was at rest. The data from three wavelengths of PPG and BioZ were collected and compared to the SS-ECG as the standard. The accelerometer and gyro signals were used to exclude data with excessive noise due to motion. The results showed that when the subject remained sedentary, the mean absolute error (MAE) for the HR calculation for all three wavelengths of the PPG modality was less than two bpm, while the BioZ was 3.5 bpm compared with SS-ECG HR. The MAE for typing increased for both modalities and was less than three bpm for all three wavelengths of the PPG but increased to 7.5 bpm for the BioZ. Regarding RR, both modalities resulted in RR within one breath per minute of the SS-ECG modality for the one breathing rate. Overall, all modalities on this upper arm wearable worked well when the subject was sedentary. Still, the SS-ECG and PPG showed less variability for the HR signal in the presence of motion during micro-motions such as typing.more » « less
-
Abstract Cardiovascular diseases, the leading cause of global mortality, demand refined diagnostic methods. Seismocardiography (SCG), a noninvasive method of measuring cardiovascular-induced vibrations on the chest surface, offers promise in assessing cardiac function. The cardiac wall movements are transmitted to the organs around the heart and eventually damped onto the chest surface, where they manifest as visible vibrations. These chest surface vibrations can be measured using an accelerometer via SCG. Although SCG signals are widely used in literature, further investigations are needed to understand the genesis of their patterns under different pathophysiological conditions. The goal of this study is to improve our understanding of the origin of SCG signals by simulating the transmission of cardiac motion reaching the chest surface using finite element method, and linking back the patterns of the simulated SCG signals to specific cardiac events. The computational domain, extracted from 4D computed tomography (CT) images of a healthy subject, comprised the lungs, ribcage, and chest muscles and fat. Using the Lukas-Kanade algorithm, the cardiac wall motion was extracted from the 4D CT scan images and was used as a displacement boundary condition. The elastic material properties were assigned to the lungs, muscles, fat, and rib cage. The dorsoventral SCG component from the finite element modeling was compared with two actual SCG signals obtained from the literature. The left ventricular volume was also calculated from the CT scans and was used to interpret the SCG waveforms. Important cardiac phases were labeled on the SCG signal extracted from the computationally modeled acceleration map near the xiphoid. This type of analysis can provide insights into various cardiac parameters and SCG patterns corresponding to the mitral valve closing, mitral valve opening, aortic valve opening, and aortic valve closure. These findings suggested the effectiveness of this modeling approach in understanding the underlying sources of the SCG waveforms.more » « less
-
Using wireless signals to monitor human vital signs, especially heartbeat information, has been intensively studied in the past decade. This non-contact sensing modality can drive various applications from cardiac health, sleep, and emotion management. Under the circumstance of the COVID-19 pandemic, non-contact heart monitoring receives increasingly market demands. However, existing wireless heart monitoring schemes can only detect limited heart activities, such as heart rate, fiducial points, and Seismocardiography (SCG)-like information. In this paper, we present CardiacWave to enable a non-contact high-definition heart monitoring. CardiacWave can provide a full spectrum of Electrocardiogram (ECG)-like heart activities, including the details of P-wave, T-wave, and QRS complex. Specifically, CardiacWave is built upon the Cardiac-mmWave scattering effect (CaSE), which is a variable frequency response of the cardiac electromagnetic field under the mmWave interrogation. The CardiacWave design consists of a noise-resistant sensing scheme to interrogate CaSE and a cardiac activity profiling module for extracting cardiac electrical activities from the interrogation response. Our experiments show that the CardiacWave-induced ECG measures have a high positive correlation with the heart activity ground truth (i.e., measurements from a medical-grade instrument). The timing difference of P-waves, T-waves, and QRS complex is 0.67%, 0.71%, and 0.49%, respectively, and a mean cardiac event difference is within a delay of 5.3 milliseconds. These results indicate that CaridacWave offers high-fidelity and integral heart clinical characteristics. Furthermore, we evaluate the CardiacWave system with participants under various conditions, including heart and breath rates, ages, and heart habits (e.g., tobacco use).more » « less
