skip to main content


Title: Awe Versus Aww: The Effectiveness of Two Kinds of Positive Emotional Stimulation on Stress Reduction for Online Content Moderators
When people have the freedom to create and post content on the internet, particularly anonymously, they do not always respect the rules and regulations of the websites on which they post, leaving other unsuspecting users vulnerable to sexism, racism, threats, and other unacceptable content in their daily cyberspace diet. However, content moderators witness the worst of humanity on a daily basis in place of the average netizen. This takes its toll on moderators, causing stress, fatigue, and emotional distress akin to the symptomology of post-traumatic stress disorder (PTSD). The goal of the present study was to explore whether adding positive stimuli to breaktimes-images of baby animals or beautiful, aweinspiring landscapes-could help reduce the negative side-effects of being a content moderator. To test this, we had over 300 experienced content moderators read and decide whether 200 fake text-based social media posts were acceptable or not for public consumption. Although we set out to test positive emotional stimulation, however, we actually found that it is the cumulative nature of the negative emotions that likely negates most of the effects of the intervention: the longer the person had practiced content moderation, the stronger their negative experience. Connections to compassion fatigue and how best to spend work breaks as a content moderator are discussed.  more » « less
Award ID(s):
1928627
NSF-PAR ID:
10383964
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Proceedings of the ACM on Human-Computer Interaction
Volume:
6
Issue:
CSCW2
ISSN:
2573-0142
Page Range / eLocation ID:
1 to 19
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background The physical and emotional well-being of women is critical for healthy pregnancy and birth outcomes. The Two Happy Hearts intervention is a personalized mind-body program coached by community health workers that includes monitoring and reflecting on personal health, as well as practicing stress management strategies such as mindful breathing and movement. Objective The aims of this study are to (1) test the daily use of a wearable device to objectively measure physical and emotional well-being along with subjective assessments during pregnancy, and (2) explore the user’s engagement with the Two Happy Hearts intervention prototype, as well as understand their experiences with various intervention components. Methods A case study with a mixed design was used. We recruited a 29-year-old woman at 33 weeks of gestation with a singleton pregnancy. She had no medical complications or physical restrictions, and she was enrolled in the Medi-Cal public health insurance plan. The participant engaged in the Two Happy Hearts intervention prototype from her third trimester until delivery. The Oura smart ring was used to continuously monitor objective physical and emotional states, such as resting heart rate, resting heart rate variability, sleep, and physical activity. In addition, the participant self-reported her physical and emotional health using the Two Happy Hearts mobile app–based 24-hour recall surveys (sleep quality and level of physical activity) and ecological momentary assessment (positive and negative emotions), as well as the Perceived Stress Scale, Center for Epidemiologic Studies Depression Scale, and State-Trait Anxiety Inventory. Engagement with the Two Happy Hearts intervention was recorded via both the smart ring and phone app, and user experiences were collected via Research Electronic Data Capture satisfaction surveys. Objective data from the Oura ring and subjective data on physical and emotional health were described. Regression plots and Pearson correlations between the objective and subjective data were presented, and content analysis was performed for the qualitative data. Results Decreased resting heart rate was significantly correlated with increased heart rate variability (r=–0.92, P<.001). We found significant associations between self-reported responses and Oura ring measures: (1) positive emotions and heart rate variability (r=0.54, P<.001), (2) sleep quality and sleep score (r=0.52, P<.001), and (3) physical activity and step count (r=0.77, P<.001). In addition, deep sleep appeared to increase as light and rapid eye movement sleep decreased. The psychological measures of stress, depression, and anxiety appeared to decrease from baseline to post intervention. Furthermore, the participant had a high completion rate of the components of the Two Happy Hearts intervention prototype and shared several positive experiences, such as an increased self-efficacy and a normal delivery. Conclusions The Two Happy Hearts intervention prototype shows promise for potential use by underserved pregnant women. 
    more » « less
  2. Moderators of online communities often employ comment deletion as a tool. We ask here whether, beyond the positive effects of shielding a community from undesirable content, does comment removal actually cause the behavior of the comment’s author to improve? We examine this question in a particularly well-moderated community, the ChangeMyView subreddit. The standard analytic approach of interrupted time-series analysis unfortunately cannot answer this question of causality because it fails to distinguish the effect of having made a non-compliant comment from the effect of being subjected to moderator removal of that comment. We therefore leverage a “delayed feedback” approach based on the observation that some users may remain active between the time when they posted the non-compliant comment and the time when that comment is deleted. Applying this approach to such users, we reveal the causal role of comment deletion in reducing immediate noncompliance rates, although we do not find evidence of it having a causal role in inducing other behavior improvements. Our work thus empirically demonstrates both the promise and some potential limits of content removal as a positive moderation strategy, and points to future directions for identifying causal effects from observational data. 
    more » « less
  3. Abstract

    Experiencing stress before an event can influence how that event is later remembered. In the current study, we examine how individual differences in one's physiological response to a stressor are related to changes to underlying brain states and memory performance. Specifically, we examined how changes in intrinsic amygdala connectivity relate to positive and negative memory performance as a function of stress response, defined as a change in cortisol. Twenty‐five participants underwent a social stressor before an incidental emotional memory encoding task. Cortisol samples were obtained before and after the stressor to measure individual differences in stress response. Three resting state scans (pre‐stressor, post‐stressor/pre‐encoding and post‐encoding) were conducted to evaluate pre‐ to post‐stressor and pre‐ to post‐encoding changes to intrinsic amygdala connectivity. Analyses examined relations between greater cortisol changes and connectivity changes. Greater cortisol increases were associated with a greaterdecreasein prefrontal‐amygdala connectivity following the stressor and a reversal in the relation between prefrontal‐amygdala connectivity and negative vs. positive memory performance. Greater cortisol increases were also associated with a greaterincreasein amygdala connectivity with a number of posterior sensory regions following encoding. Consistent with prior findings in non‐stressed individuals, pre‐ to post‐encoding increases in amygdala‐posterior connectivity were associated with greater negative relative to positive memory performance, although this was specific to lateral rather than medial posterior regions and to participants with the greatest cortisol changes. These findings suggest that stress response is associated with changes in intrinsic connectivity that have downstream effects on the valence of remembered emotional content.

     
    more » « less
  4. null (Ed.)
    Content moderation is a critical service performed by a variety of people on social media, protecting users from offensive or harmful content by reviewing and removing either the content or the perpetrator. These moderators fall into one of two categories: employees or volunteers. Prior research has suggested that there are differences in the effectiveness of these two types of moderators, with the more transparent user-based moderation being useful for educating users. However, direct comparisons between commercially-moderated and user-moderated platforms are rare, and apart from the difference in transparency, we still know little about what other disparities in user experience these two moderator types may create. To explore this, we conducted cross-platform surveys of over 900 users of commercially-moderated (Facebook, Instagram, Twitter, and YouTube) and user-moderated (Reddit and Twitch) social media platforms. Our results indicated that although user-moderated platforms did seem to be more transparent than commercially-moderated ones, this did not lead to user-moderated platforms being perceived as less toxic. In addition, commercially-moderated platform users want companies to take more responsibility for content moderation than they currently do, while user-moderated platform users want designated moderators and those who post on the site to take more responsibility. Across platforms, users seem to feel powerless and want to be taken care of when it comes to content moderation as opposed to engaging themselves. 
    more » « less
  5. The COVID-19 pandemic caused extensive disruption to higher education, highlighting the negative impacts of emergency shift to online instruction. As a result, advantages of intentionally designed, online programs in higher education were overshadowed during the pandemic. Furthermore, socioeconomic disparities were exacerbated during the pandemic which extended to STEM undergraduate transfer students, who are more likely to be low-income, from historically underrepresented groups, older, and first generation in their family to attend college. To better understand the impact of the pandemic on STEM undergraduates, including those in an intentionally designed online program, ordinal regression analysis of 352 student survey respondents enrolled in a life sciences major at a large, R1 institution in the United States spring 2020 through fall 2021 was performed. Three student types are compared: on-campus, first-time in college (FTIC); on-campus transfer (OC-TR); and online transfer (ONL-TR) students. The latter group receives all course delivery online, whereas on-campus student groups received predominately in-person course delivery prior to the pandemic. ONL-TR students were over six times less likely to report negative educational impact compared to on-campus students, FTIC and OC-TR, while controlling for parent education, income, gender, race/ethnicity, and GPA. Additional survey items further explored this result and were validated with academic records and thematic analysis of students’ text responses. A pre−/post-pandemic comparison revealed that students maintained a similar course load and GPA, despite increased perceptions of a lower GPA during the pandemic. OC-TR students were over two times more likely to express increased concern related to delayed graduation and higher frequency of feeling stress compared to FTIC and ONL-TR students. Meanwhile, low-income students were more likely to report stressors due to the pandemic’s impact on daily life, independent of student type. Taken together, students in this intentionally designed online program were more resilient to the educational and emotional impacts of the pandemic compared to on-campus students. The differences between student groups warn against generalization of student impacts and suggest further research into the positive role of online learning, not just for delivery of educational content and expanding access, but for academic and emotional stability for different student populations. 
    more » « less