skip to main content


Title: WiStress: Contactless Stress Monitoring Using Wireless Signals
Stress plays a critical role in our lives, impacting our productivity and our long-term physiological and psychological well-being. This has motivated the development of stress monitoring solutions to better understand stress, its impact on productivity and teamwork, and help users adapt their habits toward more sustainable stress levels. However, today's stress monitoring solutions remain obtrusive, requiring active user participation (e.g., self-reporting), interfering with people's daily activities, and often adding more burden to users looking to reduce their stress. In this paper, we introduce WiStress, the first system that can passively monitor a user's stress levels by relying on wireless signals. WiStress does not require users to actively provide input or to wear any devices on their bodies. It operates by transmitting ultra-low-power wireless signals and measuring their reflections off the user's body. WiStress introduces two key innovations. First, it presents the first machine learning network that can accurately and robustly extract heartbeat intervals (IBI's) from wireless reflections without constraints on a user's daily activities. Second, it introduces a stress classification framework that combines the extracted heartbeats with other wirelessly captured stress-related features in order to infer a subject's stress level. We built a prototype of WiStress and tested it on 22 different subjects across different environments in both stress-induced and free-living conditions. Our results demonstrate that WiStress has high accuracy (84%-95%) in inferring a person's stress level in a fully-automated way, paving the way for ubiquitous sensing systems that can monitor stress and provide feedback to improve productivity, health, and well-being.  more » « less
Award ID(s):
1844280
NSF-PAR ID:
10319378
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Volume:
5
Issue:
3
ISSN:
2474-9567
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The availability of FPGAs in cloud data centers offers rapid, on-demand access to reconfigurable hardware compute resources that users can adapt to their own needs. However, the low-level access to the FPGA hardware and associated resources such as the PCIe bus, SSD drives, or DRAM modules also opens up threats of malicious attackers uploading designs that are able to infer information about other users or about the cloud infrastructure itself. In particular, this work presents a new, fast PCIe-contention-based channel that is able to transmit data between FPGA-accelerated virtual machines by modulating the PCIe bus usage. This channel further works with different operating systems, and achieves bandwidths reaching 20 kbps with 99% accuracy. This is the first cross-FPGA covert channel demonstrated on commercial clouds, and has a bandwidth which is over 2000 × larger than prior voltage- or temperature-based cross-board attacks. This paper further demonstrates that the PCIe receivers are able to not just receive covert transmissions, but can also perform fine-grained monitoring of the PCIe bus, including detecting when co-located VMs are initialized, even prior to their associated FPGAs being used. Moreover, the proposed mechanism can be used to infer the activities of other users, or even slow down the programming of the co-located FPGAs as well as other data transfers between the host and the FPGA. Beyond leaking information across different virtual machines, the ability to monitor the PCIe bandwidth over hours or days can be used to estimate the data center utilization and map the behavior of the other users. The paper also introduces further novel threats in FPGA-accelerated instances, including contention due to network traffic, contention due to shared NVMe SSDs, as well as thermal monitoring to identify FPGA co-location using the DRAM modules attached to the FPGA boards. This is the first work to demonstrate that it is possible to break the separation of privilege in FPGA-accelerated cloud environments, and highlights that defenses for public clouds using FPGAs need to consider PCIe, SSD, and DRAM resources as part of the attack surface that should be protected. 
    more » « less
  2. mmWave signals form a critical component of 5G and next-generation wireless networks, which are also being increasingly considered for sensing the environment around us to enable ubiquitous IoT applications. In this context, this paper leverages the properties of mmWave signals for tracking 3D finger motion for interactive IoT applications. While conventional vision-based solutions break down under poor lighting, occlusions, and also suffer from privacy concerns, mmWave signals work under typical occlusions and non-line-of-sight conditions, while being privacy-preserving. In contrast to prior works on mmWave sensing that focus on predefined gesture classification, this work performs continuous 3D finger motion tracking. Towards this end, we first observe via simulations and experiments that the small size of fingers coupled with specular reflections do not yield stable mmWave reflections. However, we make an interesting observation that focusing on the forearm instead of the fingers can provide stable reflections for 3D finger motion tracking. Muscles that activate the fingers extend through the forearm, whose motion manifests as vibrations on the forearm. By analyzing the variation in phases of reflected mmWave signals from the forearm, this paper designs mm4Arm, a system that tracks 3D finger motion. Nontrivial challenges arise due to the high dimensional search space, complex vibration patterns, diversity across users, hardware noise, etc. mm4Arm exploits anatomical constraints in finger motions and fuses them with machine learning architectures based on encoder-decoder and ResNets in enabling accurate tracking. A systematic performance evaluation with 10 users demonstrates a median error of 5.73° (location error of 4.07 mm) with robustness to multipath and natural variation in hand position/orientation. The accuracy is also consistent under non-line-of-sight conditions and clothing that might occlude the forearm. mm4Arm runs on smartphones with a latency of 19 ms and low energy overhead. 
    more » « less
  3. Abstract

    Stress is one of the main causes that increase the risk of serious health problems. Recent wearable devices have been used to monitor stress levels via electrodermal activities on the skin. Although many biosensors provide adequate sensing performance, they still rely on uncomfortable, partially flexible systems with rigid electronics. These devices are mounted on either fingers or palms, which hinders a continuous signal monitoring. A fully‐integrated, stretchable, wireless skin‐conformal bioelectronic (referred to as “SKINTRONICS”) is introduced here that integrates soft, multi‐layered, nanomembrane sensors and electronics for continuous and portable stress monitoring in daily life. The all‐in‐one SKINTRONICS is ultrathin, highly soft, and lightweight, which overall offers an ergonomic and conformal lamination on the skin. Stretchable nanomembrane electrodes and a digital temperature sensor enable highly sensitive monitoring of galvanic skin response (GSR) and temperature. A set of comprehensive signal processing, computational modeling, and experimental study provides key aspects of device design, fabrication, and optimal placing location. Simultaneous comparison with two commercial stress monitors captures the enhanced performance of SKINTRONICS in long‐term wearability, minimal noise, and skin compatibility. In vivo demonstration of continuous stress monitoring in daily life reveals the unique capability of the soft device as a real‐world applicable stress monitor.

     
    more » « less
  4. Unlike the younger population that uses wearables such as smartwatches for monitoring health on a daily basis, elderly people need assistance in the use of technology and interpreting the data obtained through these smart connected frameworks. The current monitoring systems are primarily designed to monitor the physiological signals on a daily basis. The aim of this proposed research, Easy-Assist, is to help older people to maintain their emotional well-being. This research is focused on developing a wearable affective framework, which can help in detecting the emotions of the user in addition to monitoring their physiological signals. The proposed framework can be used in an automated assisted living environment, where the user's emotional state can be balanced using a haptic-based emotional elicitation system after the user's emotion is recognized, detected and interpreted in real-time. The proposed framework is validated using a fall detection algorithm deployed in a custom-built watch wearable, built using off-the-shelf components and an emotion detection framework built using a single board computer. A dataset of 21700 samples acquired using the proposed framework yielded a maximum efficiency of 97.25%, 96 %, and 94 %, in classifying the state and emotion classes into Alert, Active and Normal classes respectively, using multi-class SVM model. The overall latency of the proposed research was in few orders of milli-seconds. 
    more » « less
  5. Ryckman, Kelli K (Ed.)
    Background Technology enables the continuous monitoring of personal health parameter data during pregnancy regardless of the disruption of normal daily life patterns. Our research group has established a project investigating the usefulness of an Internet of Things–based system and smartwatch technology for monitoring women during pregnancy to explore variations in stress, physical activity and sleep. The aim of this study was to examine daily patterns of well-being in pregnant women before and during the national stay-at-home restrictions related to the COVID-19 pandemic in Finland. Methods A longitudinal cohort study design was used to monitor pregnant women in their everyday settings. Two cohorts of pregnant women were recruited. In the first wave in January-December 2019, pregnant women with histories of preterm births (gestational weeks 22–36) or late miscarriages (gestational weeks 12–21); and in the second wave between October 2019 and March 2020, pregnant women with histories of full-term births (gestational weeks 37–42) and no pregnancy losses were recruited. The final sample size for this study was 38 pregnant women. The participants continuously used the Samsung Gear Sport smartwatch and their heart rate variability, and physical activity and sleep data were collected. Subjective stress, activity and sleep reports were collected using a smartphone application developed for this study. Data between February 12 to April 8, 2020 were included to cover four-week periods before and during the national stay-at-home restrictions. Hierarchical linear mixed models were exploited to analyze the trends in the outcome variables. Results The pandemic-related restrictions were associated with changes in heart rate variability: the standard deviation of all normal inter-beat intervals (p = 0.034), low-frequency power (p = 0.040) and the low-frequency/high-frequency ratio (p = 0.013) increased compared with the weeks before the restrictions. Women’s subjectively evaluated stress levels also increased significantly. Physical activity decreased when the restrictions were set and as pregnancy proceeded. The total sleep time also decreased as pregnancy proceeded, but pandemic-related restrictions were not associated with sleep. Daily rhythms changed in that the participants overall started to sleep later and woke up later. Conclusions The findings showed that Finnish pregnant women coped well with the pandemic-related restrictions and lockdown environment in terms of stress, physical activity and sleep. 
    more » « less