skip to main content


Title: CNN-Based LCD Transcription of Blood Pressure From a Mobile Phone Camera
Routine blood pressure (BP) measurement in pregnancy is commonly performed using automated oscillometric devices. Since no wireless oscillometric BP device has been validated in preeclamptic populations, a simple approach for capturing readings from such devices is needed, especially in low-resource settings where transmission of BP data from the field to central locations is an important mechanism for triage. To this end, a total of 8192 BP readings were captured from the Liquid Crystal Display (LCD) screen of a standard Omron M7 self-inflating BP cuff using a cellphone camera. A cohort of 49 lay midwives captured these data from 1697 pregnant women carrying singletons between 6 weeks and 40 weeks gestational age in rural Guatemala during routine screening. Images exhibited a wide variability in their appearance due to variations in orientation and parallax; environmental factors such as lighting, shadows; and image acquisition factors such as motion blur and problems with focus. Images were independently labeled for readability and quality by three annotators (BP range: 34–203 mm Hg) and disagreements were resolved. Methods to preprocess and automatically segment the LCD images into diastolic BP, systolic BP and heart rate using a contour-based technique were developed. A deep convolutional neural network was then trained to convert the LCD images into numerical values using a multi-digit recognition approach. On readable low- and high-quality images, this proposed approach achieved a 91% classification accuracy and mean absolute error of 3.19 mm Hg for systolic BP and 91% accuracy and mean absolute error of 0.94 mm Hg for diastolic BP. These error values are within the FDA guidelines for BP monitoring when poor quality images are excluded. The performance of the proposed approach was shown to be greatly superior to state-of-the-art open-source tools (Tesseract and the Google Vision API). The algorithm was developed such that it could be deployed on a phone and work without connectivity to a network.  more » « less
Award ID(s):
1636933
NSF-PAR ID:
10275619
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Frontiers in Artificial Intelligence
Volume:
4
ISSN:
2624-8212
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Background Numerous cardiometabolic factors may underlie risk of hearing loss. Modifiable risk factors such as non-optimal blood pressure (BP) are of interest. Purpose To investigate early auditory evoked potentials (AEPs) in persons with nonoptimal BP. Research Design A cross-sectional nonexperimental study was performed. Study Sample Fifty-two adults (18–55 years) served as subjects. Individuals were classified as having optimal (systolic [S] BP < 120 and diastolic [D] BP < 80 mm Hg, n = 25) or non-optimal BP (SBP ≥=120 or DBP ≥=80 mm Hg or antihypertensive use, n = 27). Thirteen subjects had hypertension (HTN) (SBP ≥130 or DBP ≥80 mm Hg or use of antihypertensives). Data Collection and Analysis Behavioral thresholds from 0.25 to 16 kHz were collected. Threshold auditory brain stem responses (ABRs) were recorded using rarefaction clicks (17.7/second) from 80 dB nHL to wave V threshold. Electrocochleograms were obtained with 90 dB nHL 7.1/second alternating clicks and assessed for summating and compound action potentials (APs). Outcomes were compared via independent samples t tests. Linear mixed effects models for behavioral thresholds and ABR wave latencies were constructed to account for potential confounders. Results Wave I and III latencies were comparable between optimal and non-optimal BP groups. Wave I was prolonged in hypertensive versus optimal BP subjects at stimulus level 70 dB nHL (p = 0.016). ABR wave V latencies were prolonged in non-optimal BP at stimulus level 80 dB nHL (p = 0.048) and in HTN at levels of 80, 50, and 30 dB nHL (all p < 0.050). DBP was significantly correlated with wave V latency (r = 0.295; p = 0.039). No differences in ABR amplitudes were observed between optimal and non-optimal BP subjects. Electrocochleographic study showed statistically comparable action and summating potential amplitudes between optimal and non-optimal BP subjects. AP latencies were also similar between the groups. Analysis using a set baseline amplitude of 0 μV showed that hypertensive subjects had higher summating (p = 0.038) and AP (p = 0.047) amplitudes versus optimal BP subjects; AP latencies were comparable. Conclusion Elevated BP and more specifically, HTN was associated with subtle AEP abnormalities. This study provides preliminary evidence that nonoptimal BP, and more specifically HTN, may be related to auditory neural dysfunction; larger confirmatory studies are warranted. 
    more » « less
  2. Abstract

    Wearable devices for continuous monitoring of arterial pulse waves have the potential to improve the diagnosis, prognosis, and management of cardiovascular diseases. These pulse wave signals are often affected by the contact pressure between the wearable device and the skin, limiting the accuracy and reliability of hemodynamic parameter quantification. Here, a continuous hemodynamic monitoring device that enables the simultaneous recording of dual‐channel bioimpedance and quantification of pulse wave velocity (PWV) and blood pressure (BP) is reported. The investigations demonstrate the effect of contact pressure on bioimpedance and PWV. The pulsatile bioimpedance magnitude reached its maximum when the contact pressure approximated the mean arterial pressure of the subject. PWV is employed to continuously quantify BP while maintaining comfortable contact pressure for prolonged wear. The mean absolute error and standard deviation of the error compared to the reference value are determined to be 0.1 ± 3.3 mmHg for systolic BP, 1.3 ± 3.7 mmHg for diastolic BP, and −0.4 ± 3.0 mmHg for mean arterial pressure when measurements are conducted in the lying down position. This research demonstrates the potential of wearable dual‐bioimpedance sensors with contact pressure guidance for reliable and continuous hemodynamic monitoring.

     
    more » « less
  3. Abstract Hearing loss has been associated with individual cardiovascular disease (CVD) risk factors and, to a lesser extent, CVD risk metrics. However, these relationships are understudied in clinical populations. We conducted a retrospective study of electronic health records to evaluate the relationship between hearing loss and CVD risk burden. Hearing loss was defined as puretone average (PTA 0.5,1,2,4 ) > 20 dB hearing level (HL). Optimal CVD risk was defined as nondiabetic, nonsmoking, systolic blood pressure (SBP) < 120 and diastolic (D)BP < 80 mm Hg, and total cholesterol < 180 mg/dL. Major CVD risk factors were diabetes, smoking, hypertension, and total cholesterol ≥ 240 mg/dL or statin use. We identified 6332 patients (mean age = 62.96 years; 45.5% male); 64.0% had hearing loss. Sex-stratified logistic regression adjusted for age, noise exposure, hearing aid use, and body mass index examined associations between hearing loss and CVD risk. For males, diabetes, hypertension, smoking, and ≥ 2 major CVD risk factors were associated with hearing loss. For females, diabetes, smoking, and ≥ 2 major CVD risk factors were significant risk factors. Compared to those with no CVD risk factors, there is a higher likelihood of hearing loss in patients with ≥ 2 major CVD risk factors. Future research to better understand sex dependence in the hearing loss-hypertension relationship is indicated. 
    more » « less
  4. Abstract

    In two-thirds of intensive care unit (ICU) patients and 90% of surgical patients, arterial blood pressure (ABP) is monitored non-invasively but intermittently using a blood pressure cuff. Since even a few minutes of hypotension increases the risk of mortality and morbidity, for the remaining (high-risk) patients ABP is measured continuously using invasive devices, and derived values are extracted from the recorded waveforms. However, since invasive monitoring is associated with major complications (infection, bleeding, thrombosis), the ideal ABP monitor should be both non-invasive and continuous. With large volumes of high-fidelity physiological waveforms, it may be possible today to impute a physiological waveform from other available signals. Currently, the state-of-the-art approaches for ABP imputation only aim at intermittent systolic and diastolic blood pressure imputation, and there is no method that imputes the continuous ABP waveform. Here, we developed a novel approach to impute the continuous ABP waveform non-invasively using two continuously-monitored waveforms that are currently part of the standard-of-care, the electrocardiogram (ECG) and photo-plethysmogram (PPG), by adapting a deep learning architecture designed for image segmentation. Using over 150,000 min of data collected at two separate health systems from 463 patients, we demonstrate that our model provides a highly accurate prediction of the continuous ABP waveform (root mean square error 5.823 (95% CI 5.806–5.840) mmHg), as well as the derived systolic (mean difference 2.398 ± 5.623 mmHg) and diastolic blood pressure (mean difference − 2.497 ± 3.785 mmHg) compared to arterial line measurements. Our approach can potentially be used to measure blood pressure continuously and non-invasively for all patients in the acute care setting, without the need for any additional instrumentation beyond the current standard-of-care.

     
    more » « less
  5. Abstract

    Indwelling arterial lines, the clinical gold standard for continuous blood pressure (BP) monitoring in the pediatric intensive care unit (PICU), have significant drawbacks due to their invasive nature, ischemic risk, and impediment to natural body movement. A noninvasive, wireless, and accurate alternative would greatly improve the quality of patient care. Recently introduced classes of wireless, skin‐interfaced devices offer capabilities in continuous, precise monitoring of physiologic waveforms and vital signs in pediatric and neonatal patients, but have not yet been employed for continuous tracking of systolic and diastolic BP—critical for guiding clinical decision‐making in the PICU. The results presented here focus on materials and mechanics that optimize the system‐level properties of these devices to enhance their reliable use in this context, achieving full compatibility with the range of body sizes, skin types, and sterilization schemes typically encountered in the PICU. Systematic analysis of the data from these devices on 23 pediatric patients, yields derived, noninvasive BP values that can be quantitatively validated against direct recordings from arterial lines. The results from this diverse cohort, including those under pharmacological protocols, suggest that wireless, skin‐interfaced devices can, in certain circumstances of practical utility, accurately and continuously monitor BP in the PICU patient population.

     
    more » « less