Large generative AI models (GMs) like GPT and DALL-E are trained to generate content for general, wide-ranging purposes. GM content filters are generalized to filter out content which has a risk of harm in many cases, e.g., hate speech. However, prohibited content is not always harmful -- there are instances where generating prohibited content can be beneficial. So, when GMs filter out content, they preclude beneficial use cases along with harmful ones. Which use cases are precluded reflects the values embedded in GM content filtering. Recent work on red teaming proposes methods to bypass GM content filters to generate harmful content. We coin the term green teaming to describe methods of bypassing GM content filters to design for beneficial use cases. We showcase green teaming by: 1) Using ChatGPT as a virtual patient to simulate a person experiencing suicidal ideation, for suicide support training; 2) Using Codex to intentionally generate buggy solutions to train students on debugging; and 3) Examining an Instagram page using Midjourney to generate images of anti-LGBTQ+ politicians in drag. Finally, we discuss how our use cases demonstrate green teaming as both a practical design method and a mode of critique, which problematizes and subverts current understandings of harms and values in generative AI.
more »
« less
Emotion Recognition from Natural Phone Conversations in Individuals with and without Recent Suicidal Ideation
Suicide is a serious public health concern in the U.S., taking the lives of over 47,000 people in 2017. Early detection of suicidal ideation is key to prevention. One promising approach to symptom monitoring is suicidal speech prediction, as speech can be passively collected and may indicate changes in risk. However, directly identifying suicidal speech is difficult, as characteristics of speech can vary rapidly compared with suicidal thoughts. Suicidal ideation is also associated with emotion dysregulation. Therefore, in this work, we focus on the detection of emotion from speech and its relation to suicide. We introduce the Ecological Measurement of Affect, Speech, and Suicide (EMASS) dataset, which contains phone call recordings of individuals recently discharged from the hospital following admission for suicidal ideation or behavior, along with controls. Participants self-report their emotion periodically throughout the study. However, the dataset is relatively small and has uncertain labels. Because of this, we find that most features traditionally used for emotion classification fail. We demonstrate how outside emotion datasets can be used to generate more relevant features, making this analysis possible. Finally, we use emotion predictions to differentiate healthy controls from those with suicidal ideation, providing evidence for suicidal speech detection using emotion.
more »
« less
- Award ID(s):
- 1651740
- NSF-PAR ID:
- 10125071
- Date Published:
- Journal Name:
- Interspeech
- Page Range / eLocation ID:
- 3282 to 3286
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Objective This study examined the relationship between eating‐disorder behaviors—including restrictive eating, binge eating, and purging—and suicidal ideation. We hypothesized that restrictive eating would significantly predict suicidal ideation, beyond the effects of binge eating/purging.
Methods Participants were 82 adolescents and young adults with low‐weight eating disorders. We conducted a hierarchical logistic regression, with binge eating and purging in Step 1 and restrictive eating in Step 2, to predict suicidal ideation.
Results Step 1 was significant (
p = .01) and explained 20% variance in suicidal ideation; neither binge eating nor purging significantly predicted suicidal ideation. Adding restrictive eating in Step 2 significantly improved the model (ΔR 2= .07,p = .009). This final model explained 27% of the variance, and restrictive eating (but not binge eating/purging) significantly predicted suicidal ideation (p = .02).Discussion Restrictive eating is associated with suicidal ideation in youth with low‐weight eating disorders, beyond the effects of other eating‐disorder behaviors. Although healthcare providers may be more likely to screen for suicidality in patients with binge eating and purging, our findings indicate clinicians should regularly assess suicide and self‐injury in patients with restrictive eating. Future research examining how individuals progress from suicidal ideation to suicidal attempts can further enhance our understanding of suicide in eating disorders.
-
more » « less
Abstract Here, salivary microbiota and major histocompatibility complex (MHC) human leukocyte antigen (HLA) alleles were compared between 47 (12.6%) young adults with recent suicidal ideation (SI) and 325 (87.4%) controls without recent SI. Several bacterial taxa were correlated with SI after controlling for sleep issues, diet, and genetics. Four MHC class II alleles were protective for SI including DRB1*04, which was absent in every subject with SI while present in 21.7% of controls. Increased incidence of SI was observed with four other MHC class II alleles and two MHC class I alleles. Associations between these HLA alleles and salivary bacteria were also identified. Furthermore, rs10437629, previously associated with attempted suicide, was correlated here with SI and the absence of
Alloprevotella rava , a producer of an organic acid known to promote brain energy homeostasis. Hence, microbial-genetic associations may be important players in the diathesis-stress model for suicidal behaviors. -
more » « less
Abstract Objective Despite the high rates of suicidality in body dysmorphic disorder and eating disorders (EDs), research on suicidality in a related disorder, muscle dysmorphia (MD), is essentially nonexistent. Thus, this study tested relations between suicidal thoughts and behaviors and MD and ED symptoms in an online male community sample.
Method A total of 464 males (
M age = 40.3; 85% Caucasian) recruited from Amazon's Mechanical Turk completed measures that evaluated ED symptoms, MD symptoms, current suicidal ideation, and past suicide attempts.Results Most MD and ED symptoms were correlated with current suicidal ideation and previous suicide attempts. In multivariate regression models, vomiting and appearance intolerance remained significantly related to suicidal ideation, while hard exercise and lower functional impairment were significantly related to prior suicide attempts.
Conclusion Results indicate that appearance dissatisfaction, a core MD criterion, and hard exercise, a common behavioral symptom of MD, are associated with suicidality.
-
more » « less
Objective: The COVID-19 pandemic has put unprecedented stress on essential workers and their children. Limited cross-sectional research has found increases in mental health conditions from workload, reduced income, and isolation among essential workers. Less research has been conducted on children of essential workers. We examined trends in the crisis response of essential workers and their children from April 2020 through August 2021.
Methods: We investigated the impact during 3 periods of the pandemic on workers and their children using anonymized data from the Crisis Text Line on crisis help-seeking texts for thoughts of suicide or active suicidal ideation (desire, intent, capability, time frame), abuse (emotional, physical, sexual, unspecified), anxiety/stress, grief, depression, isolation, bullying, eating or body image, gender/sexual identity, self-harm, and substance use. We used generalized estimating equations to study the longitudinal change in crisis response across the later stages of the pandemic using adjusted odds ratios (aORs) for worker status and crisis outcomes.
Results: Results demonstrated higher odds of crisis outcomes for thoughts of suicide (aOR = 1.06; 95% CI, 1.00-1.12) and suicide capability (aOR = 1.14; 95% CI, 1.02-1.27) among essential workers than among nonessential workers. Children of essential workers had higher odds of substance use than children of nonessential workers (aOR = 1.33; 95% CI, 1.08-1.65), particularly for Indigenous American children (aOR = 2.76; 95% CI, 1.35-5.36). Essential workers (aOR = 1.17; 95% CI, 1.07-1.27) and their children (aOR = 1.18; 95% CI, 1.07-1.30) had higher odds of grief than nonessential workers and their children.
Conclusion: Essential workers and their children had elevated crisis outcomes. Immediate and low-cost psychologically supportive interventions are needed to mitigate the mental health impacts of the COVID-19 pandemic on these populations.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.21437/interspeech.2019-1830
