skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 8:00 PM ET on Friday, March 21 until 8:00 AM ET on Saturday, March 22 due to maintenance. We apologize for the inconvenience.


This content will become publicly available on April 17, 2025

Title: What Makes Digital Support Effective? How Therapeutic Skills Affect Clinical Well-Being

Online mental health support communities, in which volunteer counselors provide accessible mental and emotional health support, have grown in recent years. Despite millions of people using these platforms, the clinical effectiveness of these communities on mental health symptoms remains unknown. Although volunteers receive some training on the therapeutic skills proven effective in face-to-face environments, such as active listening and motivational interviewing, it is unclear how the usage of these skills in an online context affects people's mental health. In our work, we collaborate with one of the largest online peer support platforms and use both natural language processing and machine learning techniques to examine how one-on-one support chats on the platform affect clients' depression and anxiety symptoms. We measure how characteristics of support-providers, such as their experience on the platform and use of therapeutic skills (e.g. affirmation, showing empathy), affect support-seekers' mental health changes. Based on a propensity-score matching analysis to approximate a random-assignment experiment, results shows that online peer support chats improve both depression and anxiety symptoms with a statistically significant but relatively small effect size. Additionally, support providers' techniques such as emphasizing the autonomy of the client lead to better mental health outcomes. However, we also found that the use of some behaviors, such as persuading and providing information, are associated with worsening of mental health symptoms. Our work provides key understanding for mental health care in the online setting and designing training systems for online support providers.

 
more » « less
Award ID(s):
2247357
PAR ID:
10511296
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Proceedings of the ACM on Human-Computer Interaction
Date Published:
Journal Name:
Proceedings of the ACM on Human-Computer Interaction
Volume:
8
Issue:
CSCW1
ISSN:
2573-0142
Page Range / eLocation ID:
1 to 29
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Kwon, Young Dae (Ed.)
    Despite the profound health and economic implications of Covid-19, there is only limited knowledge to date about the role of economic concerns, health worries and social distancing for mental health outcomes during the pandemic. We analyze online survey data from the nationally representative “Understanding America Study” (UAS) covering the period of March 10-31st 2020 (sample size: 6,585). Mental health is assessed by the validated PHQ-4 instrument for measuring symptoms of depression and anxiety. About 29% (CI:27.4-.30.4%) of the US adult population reported some depression/anxiety symptoms over the study period, with symptoms deteriorating over the month of March. Worsening mental health was most strongly associated with concerns about the economic consequences of the pandemic, while concerns about the potential implications of the virus for respondents’ own health and social distancing also predicted increases in symptoms of depression and anxiety during the early stages of the pandemic in the US, albeit less strongly. Our findings point towards the possibility of a major mental health crisis unfolding simultaneously with the pandemic, with economic concerns being a key driving force of this crisis. These results highlight the likely importance of economic countermeasures and social policy for mitigating the impact of Covid-19 on adult mental health in the US over and above an effective public health response. 
    more » « less
  2. Abstract

    Depression is one of the leading causes of disability worldwide. Individuals with depression often experience unrealistic and overly negative thoughts, i.e. cognitive distortions, that cause maladaptive behaviors and feelings. Now that a majority of the US population uses social media platforms, concerns have been raised that they may serve as a vector for the spread of distorted ideas and thinking amid a global mental health epidemic. Here, we study how individuals (n=838) interact with distorted content on social media platforms using a simulated environment similar to Twitter (now X). We find that individuals with higher depression symptoms tend to prefer distorted content more than those with fewer symptoms. However, a simple one-shot intervention can teach individuals to recognize and drastically reduce interactions with distorted content across the entire depression scale. This suggests that distorted thinking on social media may disproportionally affect individuals with depression, but simple awareness training can mitigate this effect. Our findings have important implicasstions for understanding the role of social media in propagating distorted thinking and potential paths to reduce the societal cost of mental health disorders.

     
    more » « less
  3. Background

    The COVID-19 pandemic has resulted in heightened levels of depression, anxiety, and other mental health issues due to sudden changes in daily life, such as economic stress, social isolation, and educational irregularity. Accurately assessing emotional and behavioral changes in response to the pandemic can be challenging, but it is essential to understand the evolving emotions, themes, and discussions surrounding the impact of COVID-19 on mental health.

    Objective

    This study aims to understand the evolving emotions and themes associated with the impact of COVID-19 on mental health support groups (eg, r/Depression and r/Anxiety) on Reddit (Reddit Inc) during the initial phase and after the peak of the pandemic using natural language processing techniques and statistical methods.

    Methods

    This study used data from the r/Depression and r/Anxiety Reddit communities, which consisted of posts contributed by 351,409 distinct users over a period spanning from 2019 to 2022. Topic modeling and Word2Vec embedding models were used to identify key terms associated with the targeted themes within the data set. A range of trend and thematic analysis techniques, including time-to-event analysis, heat map analysis, factor analysis, regression analysis, and k-means clustering analysis, were used to analyze the data.

    Results

    The time-to-event analysis revealed that the first 28 days following a major event could be considered a critical window for mental health concerns to become more prominent. The theme trend analysis revealed key themes such as economic stress, social stress, suicide, and substance use, with varying trends and impacts in each community. The factor analysis highlighted pandemic-related stress, economic concerns, and social factors as primary themes during the analyzed period. Regression analysis showed that economic stress consistently demonstrated the strongest association with the suicide theme, whereas the substance theme had a notable association in both data sets. Finally, the k-means clustering analysis showed that in r/Depression, the number of posts related to the “depression, anxiety, and medication” cluster decreased after 2020, whereas the “social relationships and friendship” cluster showed a steady decrease. In r/Anxiety, the “general anxiety and feelings of unease” cluster peaked in April 2020 and remained high, whereas the “physical symptoms of anxiety” cluster showed a slight increase.

    Conclusions

    This study sheds light on the impact of COVID-19 on mental health and the related themes discussed in 2 web-based communities during the pandemic. The results offer valuable insights for developing targeted interventions and policies to support individuals and communities in similar crises.

     
    more » « less
  4. Abstract Background

    Peer victimization predicts the development of mental health symptoms in the transition to adolescence, but it is unclear whether and how parents and school environments can buffer this link.

    Methods

    We analyzed two-year longitudinal data from the Adolescent Brain Cognitive Development (ABCD) study, involving a diverse sample of 11 844 children across the United States (average at baseline = 9.91 years; standard deviation = 0.63; range = 8.92–11.08; complete case sample = 8385). Longitudinal associations between peer victimization and two-year changes in mental health symptoms of major depression disorder (MDD), separation anxiety (SA), prodromal psychosis (PP), and attention-deficit/hyperactivity disorder (ADHD) were examined including a wide range of covariates. Mixed linear models were used to test for the moderating effects of parental warmth and prosocial school environment.

    Results

    20% of children experienced peer victimization. Higher exposure to peer victimization was associated with increases in MDD, SA, and ADHD symptoms. Parental warmth was associated with decreases in MDD symptoms but did not robustly buffer the link between peer victimization and mental health symptoms. Prosocial school environment predicted decreases in PP symptoms and buffered the link between peer victimization and MDD symptoms but amplified the link between peer victimization and SA and ADHD symptoms.

    Conclusions

    Peer victimization is associated with increases in mental health symptoms during the transition to adolescence. Parental warmth and prosocial school environments might not be enough to counter the negative consequences of peer victimization on all mental health outcomes.

     
    more » « less
  5. Millions of users come to online peer counseling platforms to seek support on diverse topics ranging from relationship stress to anxiety. However, studies show that online peer support groups are not always as effective as expected largely due to users' negative experiences with unhelpful counselors. Peer counselors are key to the success of online peer counseling platforms, but most of them often do not have systematic ways to receive guidelines or supervision. In this work, we introduce CARE: an interactive AI-based tool to empower peer counselors through automatic suggestion generation. During the practical training stage, CARE helps diagnose which specific counseling strategies are most suitable in the given context and provides tailored example responses as suggestions. Counselors can choose to select, modify, or ignore any suggestion before replying to the support seeker. Building upon the Motivational Interviewing framework, CARE utilizes large-scale counseling conversation data together with advanced natural language generation techniques to achieve these functionalities. We demonstrate the efficacy of CARE by performing both quantitative evaluations and qualitative user studies through simulated chats and semi-structured interviews. We also find that CARE especially helps novice counselors respond better in challenging situations. 
    more » « less