skip to main content

Title: Boosting Lying Posture Classification with Transfer Learning
Automatic lying posture tracking is an important factor in human health monitoring. The increasing popularity of the wrist-based trackers provides the means for unobtrusive, affordable, and long-term monitoring with minimized privacy concerns for the end-users and promising results in detecting the type of physical activity, step counting, and sleep quality assessment. However, there is limited research on development of accurate and efficient lying posture tracking models using wrist-based sensor. Our experiments demonstrate a major drop in the accuracy of the lying posture tracking using wrist-based accelerometer sensor due to the unpredictable noise from arbitrary wrist movements and rotations while sleeping. In this paper, we develop a deep transfer learning method that improves performance of lying posture tracking using noisy data from wrist sensor by transferring the knowledge from an initial setting which contains both clean and noisy data. The proposed solution develops an optimal mapping model from the noisy data to the clean data in the initial setting using LSTM sequence regression, and reconstruct clean synthesized data in another setting where no noisy sensor data is available. This increases the lying posture tracking F1-Score by 24.9% for left-wrist and by 18.1% for right-wrist sensors comparing to the case without mapping.  more » « less
Award ID(s):
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
The 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2022)
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Highly stretchable fiber sensors have attracted significant interest recently due to their applications in wearable electronics, human–machine interfaces, and biomedical implantable devices. Here, a scalable approach for fabricating stretchable multifunctional electrical and optical fiber sensors using a thermal drawing process is reported. The fiber sensors can sustain at least 580% strain and up to 750% strain with a helix structure. The electrical fiber sensor simultaneously exhibits ultrahigh stretchability (400%), high gauge factors (≈1960), and excellent durability during 1000 stretching and bending cycles. It is also shown that the stretchable step‐index optical fibers facilitate detection of bending and stretching deformation through changes in the light transmission. By combining both electrical and optical detection schemes, multifunctional fibers can be used for quantifying and distinguishing multimodal deformations such as bending and stretching. The fibers’ utility and functionality in sensing and control applications are demonstrated in a smart glove for controlling a virtual hand model, a wrist brace for wrist motion tracking, fiber meshes for strain mapping, and real‐time monitoring of multiaxial expansion and shrinkage of porcine bladders. These results demonstrate that the fiber sensors can be promising candidates for smart textiles, robotics, prosthetics, and biomedical implantable devices.

    more » « less
  2. Opioid use disorder is a medical condition with major social and economic consequences. While ubiquitous physiological sensing technologies have been widely adopted and extensively used to monitor day-to-day activities and deliver targeted interventions to improve human health, the use of these technologies to detect drug use in natural environments has been largely underexplored. The long-term goal of our work is to develop a mobile technology system that can identify high-risk opioid-related events (i.e., development of tolerance in the setting of prescription opioid use, return-to-use events in the setting of opioid use disorder) and deploy just-in-time interventions to mitigate the risk of overdose morbidity and mortality. In the current paper, we take an initial step by asking a crucial question: Can opioid use be detected using physiological signals obtained from a wrist-mounted sensor? Thirty-six individuals who were admitted to the hospital for an acute painful condition and received opioid analgesics as part of their clinical care were enrolled. Subjects wore a noninvasive wrist sensor during this time (1-14 days) that continuously measured physiological signals (heart rate, skin temperature, accelerometry, electrodermal activity, and interbeat interval). We collected a total of 2070 hours (≈ 86 days) of physiological data and observed a total of 339 opioid administrations. Our results are encouraging and show that using a Channel-Temporal Attention TCN (CTA-TCN) model, we can detect an opioid administration in a time-window with an F1-score of 0.80, a specificity of 0.77, sensitivity of 0.80, and an AUC of 0.77. We also predict the exact moment of administration in this time-window with a normalized mean absolute error of 8.6% and R2 coefficient of 0.85. 
    more » « less
  3. This paper presents ssLOTR (self-supervised learning on the rings), a system that shows the feasibility of designing self-supervised learning based techniques for 3D finger motion tracking using a custom-designed wearable inertial measurement unit (IMU) sensor with a minimal overhead of labeled training data. Ubiquitous finger motion tracking enables a number of applications in augmented and virtual reality, sign language recognition, rehabilitation healthcare, sports analytics, etc. However, unlike vision, there are no large-scale training datasets for developing robust machine learning (ML) models on wearable devices. ssLOTR designs ML models based on data augmentation and self-supervised learning to first extract efficient representations from raw IMU data without the need for any training labels. The extracted representations are further trained with small-scale labeled training data. In comparison to fully supervised learning, we show that only 15% of labeled training data is sufficient with self-supervised learning to achieve similar accuracy. Our sensor device is designed using a two-layer printed circuit board (PCB) to minimize the footprint and uses a combination of Polylactic acid (PLA) and Thermoplastic polyurethane (TPU) as housing materials for sturdiness and flexibility. It incorporates a system-on-chip (SoC) microcontroller with integrated WiFi/Bluetooth Low Energy (BLE) modules for real-time wireless communication, portability, and ubiquity. In contrast to gloves, our device is worn like rings on fingers, and therefore, does not impede dexterous finger motion. Extensive evaluation with 12 users depicts a 3D joint angle tracking accuracy of 9.07° (joint position accuracy of 6.55mm) with robustness to natural variation in sensor positions, wrist motion, etc, with low overhead in latency and power consumption on embedded platforms. 
    more » « less
  4. null (Ed.)
    Smart bracelets able to interpret the wearer's emotional state and communicate it to a remote decision-support facility will have broad applications in healthcare, elder care, the military, and other fields. While there are existing commercial embedded devices, such as the Apple Watch, that have health-monitoring sensors, such devices cannot sufficiently support a real-time health-monitoring system with battery-efficient remote data delivery. Ongoing R&D is developing solutions capable of monitoring multiple psycho-physiological signals. Possible hardware configurations include wrist-worn devices and sensors across an augmented reality headset (e.g., HoloLens 2). The device should carry an array of sensors of psycho-physiological signals, including a galvanic skin response sensor, motion sensor, skin temperature sensor, and a heart rate sensor. Output from these sensors can be intelligently fused to monitor the affective state and to determine specific trigger events for the wearer. To enable real-time remote monitoring applications, the device needs to be low-power to allow persistent monitoring while prolonging usage before recharging. For many applications, specialized sensor arrays are required, e.g. a galvanic skin response sensor. An application-flexible device would allow adding/removing sensors and would provide a choice of communication modules (e.g., Bluetooth 5.0 low-energy vs ZigBee). Appropriate configurations of the device would support applications in military health monitoring, drug-addiction mitigation, autistic trigger monitoring, and augmented reality exploration. A configuration example is: motion sensors (3-axis accelerometers, gyroscopes, and magnetometers to track steps, falls, and energy usage), a heart-rate sensor (e.g., an optical-based heart rate sensor with a single monitoring zone using the process of photoplethysmography (PPS)), at least a Bluetooth 5.0 (but a different communication device may be needed depending on the use case), and flash memory to temporarily store data when the device is not remotely communicating. The wearables field has greatly advanced in the quality of sensors; the fusion of multi-sensor data is the current frontier. 
    more » « less
  5. Abstract

    Wearable electromechanical sensors are essential to improve health monitoring and off‐site point‐of‐care applications. However, their practicality is restricted by narrow ranges of detection, failure to simultaneously sense static and dynamic pressures, and low durability. Here, an all‐fabric pressure sensor with high sensitivity in a broad range of pressures, from subtle heart pulses to body posture, exceeding that of previously‐reported sensors is introduced. By taking advantage of chemical vapor deposition of p‐doped poly(3,4‐ethylenedioxythiophene) chloride (PEDOT‐Cl) on two natural textiles (cotton gauze and cotton balls), multiscale tunable pressure sensitivity with low power demand for data read‐out is obtained. To protect the sensor against humidity induced degradations, the sensor is encapsulated with a hydrophobic coating that leads to ultrastability of the sensor performance even after 1 week of exposure to 100% relative humidity and 20 laundry cycles. The sensor reveals excellent performance retention of >99% over 70 000 bending cycles under ambient conditions. The varied utility of this sensor for health monitoring is demonstrated by recording heartbeats, respiration, and joint movements. Furthermore, using this sensor, grip strength is successfully detected by 93.6% accuracy as compared to commercial dynamometer, speaking of its potential as the first fabric‐based sensor allowing for personalized real‐time grip strength analysis.

    more » « less