skip to main content


Title: Automated Detection of Stressful Conversations Using Wearable Physiological and Inertial Sensors
Stressful conversation is a frequently occurring stressor in our daily life. Stressors not only adversely affect our physical and mental health but also our relationships with family, friends, and coworkers. In this paper, we present a model to automatically detect stressful conversations using wearable physiological and inertial sensors. We conducted a lab and a field study with cohabiting couples to collect ecologically valid sensor data with temporally-precise labels of stressors. We introduce the concept of stress cycles, i.e., the physiological arousal and recovery, within a stress event. We identify several novel features from stress cycles and show that they exhibit distinguishing patterns during stressful conversations when compared to physiological response due to other stressors. We observe that hand gestures also show a distinct pattern when stress occurs due to stressful conversations. We train and test our model using field data collected from 38 participants. Our model can determine whether a detected stress event is due to a stressful conversation with an F1-score of 0.83, using features obtained from only one stress cycle, facilitating intervention delivery within 3.9 minutes since the start of a stressful conversation.  more » « less
Award ID(s):
1640813 1823221 1722646 2019085
NSF-PAR ID:
10290604
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Volume:
4
Issue:
4
ISSN:
2474-9567
Page Range / eLocation ID:
1 to 23
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Objectives

    The World Health Organization estimates that almost 300 million people suffer from depression worldwide. African Americans are understudied for depression‐related phenotypes despite widespread racial disparities. In our study of African Americans, we integrated information on psychosocial stressors with genetic variation in order to better understand how these factors associated with depressive symptoms.

    Methods

    Our research strategy combined information on financial strain and social networks with genetic data to investigate variation in symptoms of depression (CES‐D scores). We collected self‐report data on depressive symptoms, financial strain (difficulty paying bills) and personal social networks (a model of an individual's social environment), and we genotyped genetic variants in five genes previously implicated in depressive disorders (HTR1a, BDNF, GNB3, SLC6A4, andFKBP5) in 128 African Americans residing in Tallahassee, Florida. We tested for direct and gene–environment interactive effects of the psychosocial stressors and genetic variants on depressive symptoms.

    Results

    Significant associations were identified between high CES‐D scores and a stressful social environment (i.e., a high percentage of people in participants' social network who were a source of stress) and high financial strain. Only one genetic variant (rs1360780 inFKBP5) was significantly associated with CES‐D scores and only when psychosocial stressors were included in the model; the T allele had an additive effect on depressive symptoms. Sex was also significantly associated with CES‐D score in the model with psychosocial stressors and genetic variants; males had higher CES‐D scores. No significant interactive effects were detected.

    Conclusions

    A stressful social environment and material disadvantage increase depressive symptoms in the study population. Additional associations withFKBP5and male sex were revealed in models that included both psychosocial and genetic data. Our results suggest that incorporating psychosocial stressors may empower future genetic association studies and help clarify the biological consequences of social and financial stress.

     
    more » « less
  2. The culture within engineering colleges and departments has been historically quiet when considering social justice issues. Often the faculty in those departments are less concerned with social issues and are primarily focused on their disciplines and the concrete ways that they can make impacts academically and professionally in their respective arena’s. However, with the social climate of the United States shifting ever more towards a politically charged climate, and current events, particularly the protests against police brutality in recent years, faculty and students are constantly inundated with news of injustices happening in our society. The murder of George Floyd on May 25th 2020 sent shockwaves across the United States and the world. The video captured of his death shared across the globe brought everyone’s attention to the glaringly ugly problem of police brutality, paired with the COVID-19 pandemic, and US election year, the conditions were just right for a social activist movement to grow to a size that no one could ignore. Emmanuel Acho spoke out, motivated by injustices seen in the George Floyd murder, initially with podcasts and then by writing his book “Uncomfortable Converstations with a Black Man” [1]. In his book he touched on various social justice issues such as: racial terminology (i.e., Black or African American), implicit biases, white privilege, cultural appropriation, stereotypes (e.g., the “angry black man”), racial slurs (particularly the n-word), systemic racism, the myth of reverse racism, the criminal justice system, the struggles faced by black families, interracial families, allyship, and anti-racism. Students and faculty at Anonymous University felt compelled to set aside the time to meet and discuss this book in depth through the video conferencing client Zoom. In these meetings diverse facilitators were tasked with bringing the topics discussed by Acho in his book into conversation and pushing attendees of these meetings to consider those topics critically and personally. In an effort to avoid tasking attendees with reading homework to be able to participate in these discussions, the discussed chapter of the audiobook version of Acho’s book was played at the beginning of each meeting. Each audiobook chapter lasted between fifteen and twenty minutes, after which forty to forty-five minutes were left in the hour-long meetings to discuss the content of the chapter in question. Efforts by students and faculty were made to examine how some of the teachings of the book could be implemented into their lives and at Anonymous University. For broader topics, they would relate the content back to their personal lives (e.g., raising their children to be anti-racist and their experiences with racism in American and international cultures). Each meeting was recorded for posterity in the event that those conversations would be used in a paper such as this. Each meeting had at least one facilitator whose main role was to provide discussion prompts based on the chapter and ensure that the meeting environment was safe and inclusive. Naturally, some chapters address topics that are highly personal to some participants, so it was vital that all participants felt comfortable and supported to share their thoughts and experiences. The facilitator would intervene if the conversation veered in an aggressive direction. For example, if a participant starts an argument with another participant in a non-constructive manner, e.g., arguing over the definition of ethnicity, then the facilitator will interrupt, clear the air to bring the group back to a common ground, and then continue the discussion. Otherwise, participants were allowed to steer the direction of the conversation as new avenues of discussion popped up. These meetings were recorded with the goal of returning to these conversations and analyzing the conversations between attendees. Grounded theory will be used to first assess the most prominent themes of discussion between attendees for each meeting [2]. Attendees will be contacted to expressly ask their permission to have their words and thoughts used in this work, and upon agreement that data will begin to be processed. Select attendees will be asked to participate in focus group discussions, which will also be recorded via Zoom. These discussions will focus around the themes pulled from general discussion and will aim to dive deeper into the impact that this experience has had on them as either students or faculty members. A set of questions will be developed as prompts, but conversation is expected to evolve organically as these focus groups interact. These sessions will be scheduled for an hour, and a set of four focus groups with four participants are expected to participate for a total of sixteen total focus group participants. We hope to uncover how this experience changed the lives of the participants and present a model of how conversations such as this can promote diversity, equity, inclusion, and access activities amongst faculty and students outside of formal programs and strategic plans that are implemented at university, college, or departmental levels. 
    more » « less
  3. Synopsis

    Accurate forecasting of organismal responses to climate change requires a deep mechanistic understanding of how physiology responds to present-day variation in the physical environment. However, the road to physiological enlightenment is fraught with complications: predictable environmental fluctuations of any single factor are often accompanied by substantial stochastic variation and rare extreme events, and several factors may interact to affect physiology. Lacking sufficient knowledge of temporal patterns of co-variation in multiple environmental stressors, biologists struggle to design and implement realistic and relevant laboratory experiments. In this study, we directly address these issues, using measurements of the thermal tolerance of freshly collected animals and long-term field records of environmental conditions to explore how the splash-pool copepod Tigriopus californicus adjusts its physiology as its environment changes. Salinity and daily maximum temperature—two dominant environmental stressors experienced by T. californicus—are extraordinarily variable and unpredictable more than 2–3 days in advance. However, they substantially co-vary such that when temperature is high salinity is also likely to be high. Copepods appear to take advantage of this correlation: median lethal temperature of field-collected copepods increases by 7.5°C over a roughly 120 parts-per-thousand range of ambient salinity. Complementary laboratory experiments show that exposure to a single sublethal thermal event or to an abrupt shift in salinity also elicits rapid augmentation of heat tolerance via physiological plasticity, although the effect of salinity dwarfs that of temperature. These results suggest that T. californicus’s physiology keeps pace with the rapid, unpredictable fluctuations of its hypervariable physical environment by responding to the cues provided by recent sublethal stress and, more importantly, by leveraging the mechanistic cross-talk between responses to salinity and heat stress.

     
    more » « less
  4. Participants in a conversation must carefully monitor the turn-management (speaking and listening) willingness of other conversational partners and adjust their turn-changing behaviors accordingly to have smooth conversation. Many studies have focused on developing actual turn-changing (i.e., next speaker or end-of-turn) models that can predict whether turn-keeping or turn-changing will occur. Participants' verbal and non-verbal behaviors have been used as input features for predictive models. To the best of our knowledge, these studies only model the relationship between participant behavior and turn-changing. Thus, there is no model that takes into account participants' willingness to acquire a turn (turn-management willingness). In this paper, we address the challenge of building such models to predict the willingness of both speakers and listeners. Firstly, we find that dissonance exists between willingness and actual turn-changing. Secondly, we propose predictive models that are based on trimodal inputs, including acoustic, linguistic, and visual cues distilled from conversations. Additionally, we study the impact of modeling willingness to help improve the task of turn-changing prediction. To do so, we introduce a dyadic conversation corpus with annotated scores of speaker/listener turn-management willingness. Our results show that using all three modalities (i.e., acoustic, linguistic, and visual cues) of the speaker and listener is critically important for predicting turn-management willingness. Furthermore, explicitly adding willingness as a prediction task improves the performance of turn-changing prediction. Moreover, turn-management willingness prediction becomes more accurate when this joint prediction of turn-management willingness and turn-changing is performed by using multi-task learning techniques. 
    more » « less
  5. Online conversations can go in many directions: some turn out poorly due to antisocial behavior, while others turn out positively to the benefit of all. Research on improving online spaces has focused primarily on detecting and reducing antisocial behavior. Yet we know little about positive outcomes in online conversations and how to increase them—is a prosocial outcome simply the lack of antisocial behavior or something more? Here, we examine how conversational features lead to prosocial outcomes within online discussions. We introduce a series of new theory-inspired metrics to define prosocial outcomes such as mentoring and esteem enhancement. Using a corpus of 26M Reddit conversations, we show that these outcomes can be forecasted from the initial comment of an online conversation, with the best model providing a relative 24% improvement over human forecasting performance at ranking conversations for predicted outcome. Our results indicate that platforms can use these early cues in their algorithmic ranking of early conversations to prioritize better outcomes. 
    more » « less