skip to main content

Title: Automated Detection of Stressful Conversations Using Wearable Physiological and Inertial Sensors
Stressful conversation is a frequently occurring stressor in our daily life. Stressors not only adversely affect our physical and mental health but also our relationships with family, friends, and coworkers. In this paper, we present a model to automatically detect stressful conversations using wearable physiological and inertial sensors. We conducted a lab and a field study with cohabiting couples to collect ecologically valid sensor data with temporally-precise labels of stressors. We introduce the concept of stress cycles, i.e., the physiological arousal and recovery, within a stress event. We identify several novel features from stress cycles and show that they exhibit distinguishing patterns during stressful conversations when compared to physiological response due to other stressors. We observe that hand gestures also show a distinct pattern when stress occurs due to stressful conversations. We train and test our model using field data collected from 38 participants. Our model can determine whether a detected stress event is due to a stressful conversation with an F1-score of 0.83, using features obtained from only one stress cycle, facilitating intervention delivery within 3.9 minutes since the start of a stressful conversation.
; ; ; ; ;
Award ID(s):
1640813 1823221 1722646 2019085
Publication Date:
Journal Name:
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Page Range or eLocation-ID:
1 to 23
Sponsoring Org:
National Science Foundation
More Like this
  1. ABSTRACT Developing animals display a tremendous ability to change the course of their developmental path in response to the environment they experience, a concept referred to as developmental plasticity. This change in behavior, physiology or cellular processes is primarily thought to allow animals to better accommodate themselves to the surrounding environment. However, existing data on developmental stress and whether it brings about beneficial or detrimental outcomes show conflicting results. There are several well-referred hypotheses related to developmental stress in the current literature, such as the environmental matching, silver spoon and thrifty phenotype hypotheses. These hypotheses speculate that the early-life environment defines the capacity of the physiological functions and behavioral tendencies and that this change is permanent and impacts the fitness of the individual. These hypotheses also postulate there is a trade-off among organ systems and physiological functions when resources are insufficient. Published data on avian taxa show that some effects of developmental nutritional and thermal stressors are long lasting, such as the effects on body mass and birdsong. Although hypotheses on developmental stress are based on fitness components, data on reproduction and survival are scarce, making it difficult to determine which hypothesis these data support. Furthermore, most physiological and performancemore »measures are collected only once; thus, the physiological mechanisms remain undertested. Here, we offer potential avenues of research to identify reasons behind the contrasting results in developmental stress research and possible ways to determine whether developmental programming due to stressors is beneficial or detrimental, including quantifying reproduction and survival in multiple environments, measuring temporal changes in physiological variables and testing for stress resistance later in life.« less
  2. Online conversations can go in many directions: some turn out poorly due to antisocial behavior, while others turn out positively to the benefit of all. Research on improving online spaces has focused primarily on detecting and reducing antisocial behavior. Yet we know little about positive outcomes in online conversations and how to increase them—is a prosocial outcome simply the lack of antisocial behavior or something more? Here, we examine how conversational features lead to prosocial outcomes within online discussions. We introduce a series of new theory-inspired metrics to define prosocial outcomes such as mentoring and esteem enhancement. Using a corpus of 26M Reddit conversations, we show that these outcomes can be forecasted from the initial comment of an online conversation, with the best model providing a relative 24% improvement over human forecasting performance at ranking conversations for predicted outcome. Our results indicate that platforms can use these early cues in their algorithmic ranking of early conversations to prioritize better outcomes.
  3. Controversial posts are those that split the preferences of a community, receiving both significant positive and significant negative feedback. Our inclusion of the word “community” here is deliberate: what is controversial to some audiences may not be so to others. Using data from several different communities on, we predict the ultimate controversiality of posts, leveraging features drawn from both the textual content and the tree structure of the early comments that initiate the discussion. We find that even when only a handful of comments are available, e.g., the first 5 comments made within 15 minutes of the original post, discussion features often add predictive capacity to strong content-andrate only baselines. Additional experiments on domain transfer suggest that conversations tructure features often generalize to other communities better than conversation-content features do.
  4. Background The use of wearables facilitates data collection at a previously unobtainable scale, enabling the construction of complex predictive models with the potential to improve health. However, the highly personal nature of these data requires strong privacy protection against data breaches and the use of data in a way that users do not intend. One method to protect user privacy while taking advantage of sharing data across users is federated learning, a technique that allows a machine learning model to be trained using data from all users while only storing a user’s data on that user’s device. By keeping data on users’ devices, federated learning protects users’ private data from data leaks and breaches on the researcher’s central server and provides users with more control over how and when their data are used. However, there are few rigorous studies on the effectiveness of federated learning in the mobile health (mHealth) domain. Objective We review federated learning and assess whether it can be useful in the mHealth field, especially for addressing common mHealth challenges such as privacy concerns and user heterogeneity. The aims of this study are to describe federated learning in an mHealth context, apply a simulation of federated learningmore »to an mHealth data set, and compare the performance of federated learning with the performance of other predictive models. Methods We applied a simulation of federated learning to predict the affective state of 15 subjects using physiological and motion data collected from a chest-worn device for approximately 36 minutes. We compared the results from this federated model with those from a centralized or server model and with the results from training individual models for each subject. Results In a 3-class classification problem using physiological and motion data to predict whether the subject was undertaking a neutral, amusing, or stressful task, the federated model achieved 92.8% accuracy on average, the server model achieved 93.2% accuracy on average, and the individual model achieved 90.2% accuracy on average. Conclusions Our findings support the potential for using federated learning in mHealth. The results showed that the federated model performed better than a model trained separately on each individual and nearly as well as the server model. As federated learning offers more privacy than a server model, it may be a valuable option for designing sensitive data collection methods.« less
  5. How and to what degree an animal deals with potential threats is a fascinating topic that has been well-researched, particularly in insects, though usually not with the impact of parasites in mind. A growing body of work is showing how even benign parasites can affect, positively or negatively, their hosts’ physiological or behavioral reaction to threats. With this in mind we conducted an experiment using horned passalus beetles, Odontotaenius disjunctus that were naturally parasitized with a nematode Chondronema passali; we subjected beetles to simulated attacks (resembling rival fighting or predator attacks) and from videos of the encounters we quantified a suite of behaviors (antennae movement, aggressive posturing, threat displays, etc.), plus rates of alarm calls (stridulations) which all correspond to the “fight or flight” reaction. We obtained behavioral and parasite data from 140 beetles from two field collections, of which half had been housed in our lab for three weeks in conditions that would be stressful (little cover for burrowing). We observed a wide range of behaviors during the simulated attack procedure, from beetles offering little resistance to those which were extremely aggressive, though most beetles showed a moderate reaction. Alarm calling rates also varied, but surprisingly, these were notmore »correlated with the magnitude of behavioral reactions. Also surprising was that stressful housing did not heighten the physical resistance during attacks, but did elevate alarm calling rate. Importantly, parasitized beetles had significantly reduced physical reactions to attack than those without nematodes (meaning their resistance to the attack was muted). The results concerning parasitism, coupled with prior work in our lab, indicate that the C. passali nematode depresses the hosts’ acute stress, or fight or flight, reaction (likely from its energetic cost), which may make hosts more susceptible to the very dangers that they are coping with during the stress events.« less