skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: "I'm gonna KMS": From Imminent Risk to Youth Joking about Suicide and Self-Harm via Social Media
Recent increases in self-harm and suicide rates among youth have coincided with prevalent social media use; therefore, making these sensitive topics of critical importance to the HCI research community. We analyzed 1,224 direct message conversations (DMs) from 151 young Instagram users (ages 13-21), who engaged in private conversations using self-harm and suicide-related language. We found that youth discussed their personal experiences, including imminent thoughts of suicide and/or self-harm, as well as their past attempts and recovery. They gossiped about others, including complaining about triggering content and coercive threats of self-harm and suicide but also tried to intervene when a friend was in danger. Most of the conversations involved suicide or self-harm language that did not indicate the intent to harm but instead used hyperbolical language or humor. Our results shed light on youth perceptions, norms, and experiences of self-harm and suicide to inform future efforts towards risk detection and prevention. ContentWarning: This paper discusses the sensitive topics of self-harm and suicide. Reader discretion is advised.  more » « less
Award ID(s):
2329976 2333207
PAR ID:
10563048
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
ACM
Date Published:
ISBN:
9798400703300
Page Range / eLocation ID:
1 to 18
Format(s):
Medium: X
Location:
Honolulu HI USA
Sponsoring Org:
National Science Foundation
More Like this
  1. Although youth increasingly communicate with peers online, we know little about how private online channels play a role in providing a supportive environment for youth. To fill this gap, we asked youth to donate their Instagram Direct Messages and filtered them by the phrase “help me.” From this query, we analyzed 82 conversations comprised of 336,760 messages that 42 participants donated. These threads often began as casual conversations among friends or lovers they met offline or online. The conversations evolved into sharing negative experiences about everyday stress (e.g., school, dating) to severe mental health disclosures (e.g., suicide). Disclosures were usually reciprocated with relatable experiences and positive peer support. We also discovered unsupport as a theme, where conversation members denied giving support, a unique finding in the online social support literature. We discuss the role of social media-based private channels and their implications for design in supporting youth’s mental health. Content Warning: This paper includes sensitive topics, including self-harm and suicide ideation. Reader discretion is advised. 
    more » « less
  2. We conducted a study with 173 adolescents (ages 13-21), who self-reported their offline and online risk experiences and uploaded their Instagram data to our study website to flag private conversations as unsafe. Risk profiles were first created based on the survey data and then compared with the risk-flagged social media data. Five risk profiles emerged: Low Risks (51% of the participants), Medium Risks (29%), Increased Sexting (8%), Increased Self-Harm (8%), and High Risk Perpetration (4%). Overall, the profiles correlated well with the social media data with the highest level of risk occurring in the three smallest profiles. Youth who experienced increased sexting and self-harm frequently reported engaging in unsafe sexual conversations. Meanwhile, high risk perpetration was characterized by increased violence, threats, and sales/promotion of illegal activities. A key insight from our study was that offline risk behavior sometimes manifested differently in online contexts (i.e., offline self-harm as risky online sexual interactions). Our findings highlight the need for targeted risk prevention strategies for youth online safety. 
    more » « less
  3. The Blue Whale Challenge (BWC) is an online viral game ” that allegedly encourages youth and young adults towards self harming behaviors that could eventually lead to suicide. The BWC can be situated within a larger phenomenon of viral online self harm challenges, which may be propagated through both social media and news sources. Research has established that suicide is a global public health issue that is known to be influenced by media reporting. Violation of safe messaging guidelines has be en shown to increase imitative suicides, particularly in youth and young adults. Given the confirmed effects of news media reporting, we analyzed 150 digital newspaper articles reporting on the BWC to assess whether they adhered to suicide prevention safe messaging guidelines. Overall, 81% of the articles violated at least one contagion related guideline, most commonly normalizing suicide, discussing means of suicide, and sensationalizing. Even though the majority (91%) of the articles adhered to at least o ne health promotion guideline, such as emphasizing prevention, the articles did not follow these guidelines on a deep and comprehensive level. Through thematic analysis, we also found evidence of potential misinformation in reporting, where the articles un equivocally attributed many suicides to the BWC with little or no evidence. Additionally, articles often stated an individual s reason for participating in the challenge without interviewing the individual or those close to the individual, another aspect o f potential misinformation due to lack of evidence. A contribution of the current study is the synthesis of safe messaging guidelines that can be used in future research. This study contributes to the understanding of news reporting practices regarding sui cide and self-harm in regard to the BWC and similar online challenges. We discuss how sensationalized news media reports on the BWC could unintentionally propagate suicide contagion effects that normalize self harming behaviors among youth. We then examine implications for practice and policy, such using automated approaches to aid reporters in adhering to safe messaging guidelines. 
    more » « less
  4. Youth regularly use technology driven by artificial intelligence (AI). However, it is increasingly well-known that AI can cause harm on small and large scales, especially for those underrepresented in tech fields. Recently, users have played active roles in surfacing and mitigating harm from algorithmic bias. Despite being frequent users of AI, youth have been under-explored as potential contributors and stakeholders to the future of AI. We consider three notions that may be at the root of youth facing barriers to playing an active role in responsible AI, which are youth (1) cannot understand the technical aspects of AI, (2) cannot understand the ethical issues around AI, and (3) need protection from serious topics related to bias and injustice. In this study, we worked with youth (N = 30) in first through twelfth grade and parents (N = 6) to explore how youth can be part of identifying algorithmic bias and designing future systems to address problematic technology behavior. We found that youth are capable of identifying and articulating algorithmic bias, often in great detail. Participants suggested different ways users could give feedback for AI that reflects their values of diversity and inclusion. Youth who may have less experience with computing or exposure to societal structures can be supported by peers or adults with more of this knowledge, leading to critical conversations about fairer AI. This work illustrates youths' insights, suggesting that they should be integrated in building a future of responsible AI. 
    more » « less
  5. Both liberals and conservatives believe that using facts in political discussions helps to foster mutual respect, but 15 studies—across multiple methodologies and issues—show that these beliefs are mistaken. Political opponents respect moral beliefs more when they are supported by personal experiences, not facts. The respect-inducing power of personal experiences is revealed by survey studies across various political topics, a field study of conversations about guns, an analysis of YouTube comments from abortion opinion videos, and an archival analysis of 137 interview transcripts from Fox News and CNN. The personal experiences most likely to encourage respect from opponents are issue-relevant and involve harm. Mediation analyses reveal that these harm-related personal experiences increase respect by increasing perceptions of rationality: everyone can appreciate that avoiding harm is rational, even in people who hold different beliefs about guns, taxes, immigration, and the environment. Studies show that people believe in the truth of both facts and personal experiences in nonmoral disagreement; however, in moral disagreements, subjective experiences seem truer (i.e., are doubted less) than objective facts. These results provide a concrete demonstration of how to bridge moral divides while also revealing how our intuitions can lead us astray. Stretching back to the Enlightenment, philosophers and scientists have privileged objective facts over experiences in the pursuit of truth. However, furnishing perceptions of truth within moral disagreements is better accomplished by sharing subjective experiences, not by providing facts. 
    more » « less