skip to main content


Title: Boosting Lying Posture Classification with Transfer Learning
Automatic lying posture tracking is an important factor in human health monitoring. The increasing popularity of the wrist-based trackers provides the means for unobtrusive, affordable, and long-term monitoring with minimized privacy concerns for the end-users and promising results in detecting the type of physical activity, step counting, and sleep quality assessment. However, there is limited research on development of accurate and efficient lying posture tracking models using wrist-based sensor. Our experiments demonstrate a major drop in the accuracy of the lying posture tracking using wrist-based accelerometer sensor due to the unpredictable noise from arbitrary wrist movements and rotations while sleeping. In this paper, we develop a deep transfer learning method that improves performance of lying posture tracking using noisy data from wrist sensor by transferring the knowledge from an initial setting which contains both clean and noisy data. The proposed solution develops an optimal mapping model from the noisy data to the clean data in the initial setting using LSTM sequence regression, and reconstruct clean synthesized data in another setting where no noisy sensor data is available. This increases the lying posture tracking F1-Score by 24.9% for left-wrist and by 18.1% for right-wrist sensors comparing to the case without mapping.  more » « less
Award ID(s):
2210133
PAR ID:
10325314
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
The 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2022)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Advancements in flexible and printable sensor technologies to overcome the limitations of conventional rigid counterparts offer an excellent opportunity to design various healthcare applications for humans, and their potential flexibility can be used in real-time health monitoring and personalized physical conditions with minimal or no inconvenience. However, managing a large volume of obtained sensor datasets and ensuring accurate predictions can take time and effort. While statistical analysis and the Pearson correlation coefficient can reduce data volume, whether this would lead to losing important information and affect downstream application performance is still being determined. In this paper, we use posture classification as an exemplar of timely services in digital healthcare, especially for bedsores or decubitus ulcers. Our sensors, placed under hospital beds, have a thickness of just 0.4mm and collect pressure data from 28 sensors (7 by 4) at an 8 Hz cycle, categorizing postures into 4 types from 5 patients. We then collected sensor data to explore the possibility of using a small number of pressure sensors for patient posture classification. Next, we apply a statistical analysis to the datasets obtained to select the featured sensor data cells and evaluate the performance of posture classification models on various groups of sensors. Our evaluation involves the analysis of reduced datasets through statistical methods and the Pearson correlation coefficient. The classification performance using datasets comprising 5 featured and 28 sensors are 0.93 and 0.99, respectively. These results suggest comparable performance and the viability of useful classifiers for both cases. Consequently, comparable posture classification performance can be achieved using only 17.9% of the entire dataset. 
    more » « less
  2. Abstract

    Wearable electromechanical sensors are essential to improve health monitoring and off‐site point‐of‐care applications. However, their practicality is restricted by narrow ranges of detection, failure to simultaneously sense static and dynamic pressures, and low durability. Here, an all‐fabric pressure sensor with high sensitivity in a broad range of pressures, from subtle heart pulses to body posture, exceeding that of previously‐reported sensors is introduced. By taking advantage of chemical vapor deposition of p‐doped poly(3,4‐ethylenedioxythiophene) chloride (PEDOT‐Cl) on two natural textiles (cotton gauze and cotton balls), multiscale tunable pressure sensitivity with low power demand for data read‐out is obtained. To protect the sensor against humidity induced degradations, the sensor is encapsulated with a hydrophobic coating that leads to ultrastability of the sensor performance even after 1 week of exposure to 100% relative humidity and 20 laundry cycles. The sensor reveals excellent performance retention of >99% over 70 000 bending cycles under ambient conditions. The varied utility of this sensor for health monitoring is demonstrated by recording heartbeats, respiration, and joint movements. Furthermore, using this sensor, grip strength is successfully detected by 93.6% accuracy as compared to commercial dynamometer, speaking of its potential as the first fabric‐based sensor allowing for personalized real‐time grip strength analysis.

     
    more » « less
  3. Abstract

    Highly stretchable fiber sensors have attracted significant interest recently due to their applications in wearable electronics, human–machine interfaces, and biomedical implantable devices. Here, a scalable approach for fabricating stretchable multifunctional electrical and optical fiber sensors using a thermal drawing process is reported. The fiber sensors can sustain at least 580% strain and up to 750% strain with a helix structure. The electrical fiber sensor simultaneously exhibits ultrahigh stretchability (400%), high gauge factors (≈1960), and excellent durability during 1000 stretching and bending cycles. It is also shown that the stretchable step‐index optical fibers facilitate detection of bending and stretching deformation through changes in the light transmission. By combining both electrical and optical detection schemes, multifunctional fibers can be used for quantifying and distinguishing multimodal deformations such as bending and stretching. The fibers’ utility and functionality in sensing and control applications are demonstrated in a smart glove for controlling a virtual hand model, a wrist brace for wrist motion tracking, fiber meshes for strain mapping, and real‐time monitoring of multiaxial expansion and shrinkage of porcine bladders. These results demonstrate that the fiber sensors can be promising candidates for smart textiles, robotics, prosthetics, and biomedical implantable devices.

     
    more » « less
  4. Opioid use disorder is a medical condition with major social and economic consequences. While ubiquitous physiological sensing technologies have been widely adopted and extensively used to monitor day-to-day activities and deliver targeted interventions to improve human health, the use of these technologies to detect drug use in natural environments has been largely underexplored. The long-term goal of our work is to develop a mobile technology system that can identify high-risk opioid-related events (i.e., development of tolerance in the setting of prescription opioid use, return-to-use events in the setting of opioid use disorder) and deploy just-in-time interventions to mitigate the risk of overdose morbidity and mortality. In the current paper, we take an initial step by asking a crucial question: Can opioid use be detected using physiological signals obtained from a wrist-mounted sensor? Thirty-six individuals who were admitted to the hospital for an acute painful condition and received opioid analgesics as part of their clinical care were enrolled. Subjects wore a noninvasive wrist sensor during this time (1-14 days) that continuously measured physiological signals (heart rate, skin temperature, accelerometry, electrodermal activity, and interbeat interval). We collected a total of 2070 hours (≈ 86 days) of physiological data and observed a total of 339 opioid administrations. Our results are encouraging and show that using a Channel-Temporal Attention TCN (CTA-TCN) model, we can detect an opioid administration in a time-window with an F1-score of 0.80, a specificity of 0.77, sensitivity of 0.80, and an AUC of 0.77. We also predict the exact moment of administration in this time-window with a normalized mean absolute error of 8.6% and R2 coefficient of 0.85. 
    more » « less
  5. Advances in flexible and printable sensor technologies have made it possible to use posture classification for providing timely services in digital healthcare, especially for bedsores or decubitus ulcers. However, managing a large amount of sensor data and ensuring accurate predictions can be challenging. While lossy compressors can reduce data volume, it is still unclear whether this would lead to losing important information and affect downstream application performance. In this paper, we propose LCDNN (Lossy Compression using Deep Neural Network) to reduce the size of sensor data and evaluate the performance of posture classification models. Our sensors, placed under hospital beds, have a thickness of just 0.4mm and collect pressure data from 28 sensors (7 by 4) at an 8 Hz cycle, categorizing postures into 4 types from 5 patients. Our evaluation, which includes reduced datasets by LCDNN, demonstrates that the results are promising. 
    more » « less