skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 8:00 PM ET on Friday, March 21 until 8:00 AM ET on Saturday, March 22 due to maintenance. We apologize for the inconvenience.


Title: An Empirical Study Comparing Unobtrusive Physiological Sensors for Stress Detection in Computer Work
Several unobtrusive sensors have been tested in studies to capture physiological reactions to stress in workplace settings. Lab studies tend to focus on assessing sensors during a specific computer task, while in situ studies tend to offer a generalized view of sensors’ efficacy for workplace stress monitoring, without discriminating different tasks. Given the variation in workplace computer activities, this study investigates the efficacy of unobtrusive sensors for stress measurement across a variety of tasks. We present a comparison of five physiological measurements obtained in a lab experiment, where participants completed six different computer tasks, while we measured their stress levels using a chest-band (ECG, respiration), a wristband (PPG and EDA), and an emerging thermal imaging method (perinasal perspiration). We found that thermal imaging can detect increased stress for most participants across all tasks, while wrist and chest sensors were less generalizable across tasks and participants. We summarize the costs and benefits of each sensor stream, and show how some computer use scenarios present usability and reliability challenges for stress monitoring with certain physiological sensors. We provide recommendations for researchers and system builders for measuring stress with physiological sensors during workplace computer use.  more » « less
Award ID(s):
1704889
PAR ID:
10168807
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Sensors
Volume:
19
Issue:
17
ISSN:
1424-8220
Page Range / eLocation ID:
1-21
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Stress increases the risk of several mental and physical health problems like anxiety, hypertension, and cardiovascular diseases. Better guidance and interventions towards mitigating the impact of stress can be provided if stress can be monitored continuously. The recent proliferation of wearable devices and their capability in measuring several physiological signals related to stress have created the opportunity to measure stress continuously in the wild. Wearable devices used to measure physiological signals are mostly placed on the wrist and the chest. Though currently chest sensors, with/without wrist sensors, provide better results in detecting stress than using wrist sensors only, chest devices are not as convenient and prevalent as wrist devices, particularly in the free-living context. In this paper, we present a solution to detect stress using wrist sensors that emulate the gold standard chest sensors. Data from wrist sensors are translated into the data from chest sensors, and the translated data is used for stress detection without requiring the users to wear any device on the chest. We evaluated our solution using a public dataset, and results show that our solution detects stress with accuracy comparable to the gold standard chest devices which are impractical for daily use 
    more » « less
  2. Stress impacts our physical and mental health as well as our social life. A passive and contactless indoor stress monitoring system can unlock numerous important applications such as workplace productivity assessment, smart homes, and personalized mental health monitoring. While the thermal signatures from a user's body captured by a thermal camera can provide important information about the ``fight-flight'' response of the sympathetic and parasympathetic nervous system, relying solely on thermal imaging for training a stress prediction model often lead to overfitting and consequently a suboptimal performance. This paper addresses this challenge by introducing ThermaStrain, a novel co-teaching framework that achieves high-stress prediction performance by transferring knowledge from the wearable modality to the contactless thermal modality. During training, ThermaStrain incorporates a wearable electrodermal activity (EDA) sensor to generate stress-indicative representations from thermal videos, emulating stress-indicative representations from a wearable EDA sensor. During testing, only thermal sensing is used, and stress-indicative patterns from thermal data and emulated EDA representations are extracted to improve stress assessment. The study collected a comprehensive dataset with thermal video and EDA data under various stress conditions and distances. ThermaStrain achieves an F1 score of $0.8293$ in binary stress classification, outperforming the thermal-only baseline approach by over 9\%. Extensive evaluations highlight ThermaStrain's effectiveness in recognizing stress-indicative attributes, its adaptability across distances and stress scenarios, real-time executability on edge platforms, its applicability to multi-individual sensing, ability to function on limited visibility and unfamiliar conditions, and the advantages of its co-teaching approach. These evaluations validate ThermaStrain's fidelity and its potential for enhancing stress assessment. 
    more » « less
  3. Stress impacts our physical and mental health as well as our social life. A passive and contactless indoor stress monitoring system can unlock numerous important applications such as workplace productivity assessment, smart homes, and personalized mental health monitoring. While the thermal signatures from a user’s body captured by a thermal camera can provide important information about the “fight-flight” response of the sympathetic and parasympathetic nervous system, relying solely on thermal imaging for training a stress prediction model often lead to overfitting and consequently a suboptimal performance. This paper addresses this challenge by introducing ThermaStrain, a novel co-teaching framework that achieves high-stress prediction performance by transferring knowledge from the wearable modality to the contactless thermal modality. During training, ThermaStrain incorporates a wearable electrodermal activity (EDA) sensor to generate stress-indicative representations from thermal videos, emulating stress-indicative representations from a wearable EDA sensor. During testing, only thermal sensing is used, and stress-indicative patterns from thermal data and emulated EDA representations are extracted to improve stress assessment. The study collected a comprehensive dataset with thermal video and EDA data under various stress conditions and distances. ThermaStrain achieves an F1 score of 0.8293 in binary stress classification, outperforming the thermal-only baseline approach by over 9%. Extensive evaluations highlight ThermaStrain’s effectiveness in recognizing stress-indicative attributes, its adaptability across distances and stress scenarios, real-time executability on edge platforms, its applicability to multi-individual sensing, ability to function on limited visibility and unfamiliar conditions, and the advantages of its co-teaching approach. These evaluations validate ThermaStrain’s fidelity and its potential for enhancing stress assessment. 
    more » « less
  4. Stress impacts our physical and mental health as well as our social life. A passive and contactless indoor stress monitoring system can unlock numerous important applications such as workplace productivity assessment, smart homes, and personalized mental health monitoring. While the thermal signatures from a user's body captured by a thermal camera can provide important information about the fight-flight response of the sympathetic and parasympathetic nervous system, relying solely on thermal imaging for training a stress prediction model often lead to overfitting and consequently a suboptimal performance. This paper addresses this challenge by introducing ThermaStrain, a novel co-teaching framework that achieves high-stress prediction performance by transferring knowledge from the wearable modality to the contactless thermal modality. During training, ThermaStrain incorporates a wearable electrodermal activity (EDA) sensor to generate stress-indicative representations from thermal videos, emulating stress-indicative representations from a wearable EDA sensor. During testing, only thermal sensing is used, and stress-indicative patterns from thermal data and emulated EDA representations are extracted to improve stress assessment. The study collected a comprehensive dataset with thermal video and EDA data under various stress conditions and distances. ThermaStrain achieves an F1 score of 0.8293 in binary stress classification, outperforming the thermal-only baseline approach by over 9%. Extensive evaluations highlight ThermaStrain's effectiveness in recognizing stress-indicative attributes, its adaptability across distances and stress scenarios, real-time executability on edge platforms, its applicability to multi-individual sensing, ability to function on limited visibility and unfamiliar conditions, and the advantages of its co-teaching approach. These evaluations validate ThermaStrain's fidelity and its potential for enhancing stress assessment.

     
    more » « less
  5. Abstract

    Severe stress endangers outdoor workers who are in an exceedingly hot workplace. Although recent studies quantify stress levels on the human skin, they still rely on rigid, bulky sensor modules, causing data loss from motion artifacts and limited field‐deployability for continuous health monitoring. Moreover, no prior work shows a wearable device that can endure heat exposure while showing continuous monitoring of a subject's stress under realistic working environments. Herein, a soft, field‐deployable, wearable bioelectronic system is introduced for detecting outdoor workers' stress levels with negligible motion artifacts and controllable thermal management. A nanofabric radiative cooler (NFRC) and miniaturized sensors with a nanomembrane soft electronic platform are integrated to measure stable electrodermal activities and temperature in hot outdoor conditions. The NFRC exhibits outstanding cooling performance in sub‐ambient air with high solar reflectivity and high thermal emissivity. The integrated wearable device with all embedded electronic components and the NFRC shows a lower temperature (41.1%) in sub‐ambient air than the NFRC‐less device while capturing improved operation time (18.2%). In vivo human study of the bioelectronics with agricultural activities demonstrates the device's capability for portable, continuous, real‐time health monitoring of outdoor workers with field deployability.

     
    more » « less