skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Pitfalls of Embodiment in Human-Agent Experiment Design
The intelligent virtual agent community often works from the assumption that embodiment confers clear benefits to human-machine interaction. However, embodiment has potential drawbacks in highlighting the salience of social stereotypes such as those around race and gender. Indeed, theories of computer-mediated communication highlight that visual anonymity can sometimes enhance team outcomes. Negotiation is one domain where social perceptions can impact outcomes. For example, research suggests women perform worse in negotiations and find them more aversive, particularly when interacting with men opponents. Research with human participants makes it challenging to unpack whether these negative consequences stem from women’s perceptions of their partner or greater toughness on the part of these men opponents. We use a socially intelligent AI negotiation agent to begin to unpack these processes. We manipulate the perceived toughness of the AI by whether or not it expresses anger — a common tactic to extract concessions. Independently, we manipulate the activation of stereotypes by randomly setting whether the interaction has embodiment (as a male opponent) or has only text (where we obscure gender cues). We find a clear interaction between gender and embodiment. Specifically, women perform worse, and men perform better against an apparently male opponent compared to a disembodied agent – as measured by the subjective value they assign to their outcome. This highlights the potential disadvantages of embodiment in negotiation, though future research must rule out alternative mechanisms that might explain these results.  more » « less
Award ID(s):
2150187
PAR ID:
10566500
Author(s) / Creator(s):
; ;
Publisher / Repository:
ACM
Date Published:
ISBN:
9798400706257
Page Range / eLocation ID:
1 to 9
Format(s):
Medium: X
Location:
GLASGOW United Kingdom
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The cisgender male partners of transgender women have received little attention beyond their sexual behaviour. This is an issue, as marginalisation and social environments determine sexual behav- iour and subsequent health outcomes. This article assesses in- depth interviews with cisgender male partners of transgender women in Atlanta and Baltimore, USA. Analysis suggests men experience minority stress that may lead to ameliorative coping processes such as coming out and LGBTQ group affiliation. Specifically, the interviews identify stressful, marginalising reac- tions from family and friends concerning men ’ s relationships with transgender women. In turn, men described uniquely supportive ties to LGBTQ communities, which included ongoing relationships with transgender women, having close sexual and gender minor- ity friends, and occupying notably LGBTQ spaces such as Pride events. The LGBTQ social connectivity of the cisgender male part- ners of transgender women could prove critical to future targeted HIV prevention efforts. 
    more » « less
  2. Mental health stigma prevents many individuals from receiving the appropriate care, and social psychology studies have shown that mental health tends to be overlooked in men. In this work, we investigate gendered mental health stigma in masked language models. In doing so, we operationalize mental health stigma by developing a framework grounded in psychology research: we use clinical psychology literature to curate prompts, then evaluate the models’ propensity to generate gendered words. We find that masked language models capture societal stigma about gender in mental health: models are consistently more likely to predict female subjects than male in sentences about having a mental health condition (32% vs. 19%), and this disparity is exacerbated for sentences that indicate treatment-seeking behavior. Furthermore, we find that different models capture dimensions of stigma differently for men and women, associating stereotypes like anger, blame, and pity more with women with mental health conditions than with men. In showing the complex nuances of models’ gendered mental health stigma, we demonstrate that context and overlapping dimensions of identity are important considerations when assessing computational models’ social biases. 
    more » « less
  3. Mental health stigma prevents many individuals from receiving the appropriate care, and social psychology studies have shown that mental health tends to be overlooked in men. In this work, we investigate gendered mental health stigma in masked language models. In doing so, we operationalize mental health stigma by developing a framework grounded in psychology research: we use clinical psychology literature to curate prompts, then evaluate the models’ propensity to generate gendered words. We find that masked language models capture societal stigma about gender in mental health: models are consistently more likely to predict female subjects than male in sentences about having a mental health condition (32% vs. 19%), and this disparity is exacerbated for sentences that indicate treatment-seeking behavior. Furthermore, we find that different models capture dimensions of stigma differently for men and women, associating stereotypes like anger, blame, and pity more with women with mental health conditions than with men. In showing the complex nuances of models’ gendered mental health stigma, we demonstrate that context and overlapping dimensions of identity are important considerations when assessing computational models’ social biases. 
    more » « less
  4. null (Ed.)
    Robots' spatial positioning is a useful communication modality in social interactions. For example, in the context of group conversations, certain types of positioning signal membership to the group interaction. How does robot embodiment influence these perceptions? To investigate this question, we conducted an online study in which participants observed renderings of several robots in a social environment, and judged whether the robots were positioned to take part in a group conversation with other humans in the scene. Our results suggest that robot embodiment can influence perceptions of conversational group membership. An important factor to consider in this regard is whether robot embodiment leads to a discernible orientation for the agent. 
    more » « less
  5. Attributing gender discrimination to implicit bias has become increasingly common. However, research suggests that when discrimination is attributed to implicit rather than explicit bias, the perpetrators are held less accountable and deemed less worthy of punishment. The present work examines (a) whether this effect replicates in the domain of gender discrimination, and (b) whether sharing a group membership with the victim moderates the effect. Four studies revealed that both men and women hold perpetrators of gender discrimination less accountable if their behavior is attributed to implicit rather than explicit bias. Moreover, women held male (Studies 1–3), but not female (Study 4), perpetrators of gender discrimination more accountable than did men. Together, these findings suggest that while shared gender group membership may inform judgments of accountability for gender discrimination, it does not weaken the tendency to hold perpetrators less accountable for discrimination attributed to implicit, compared with explicit, bias. 
    more » « less