More Like this

1. Individual differences (or the lack of them) in comprehension of singular they.

   Arnold, J. E.; Mayo, H.; Dong, L. (January 2020, UNC Language Processing Lab Technical Report #3)

   Arnold, J. E., Mayo, H., & Dong, L. (2020). Individual differences (or the lack of them) in comprehension of singular they. Technical Report #3. UNC Language Processing Lab, Department of Psychology & Neuroscience, University of North Carolina – Chapel Hill, Chapel Hill, North Carolina. The pronoun “they” can refer to an individual who identifies as nonbinary, but it also is commonly used as a plural pronoun. How do listeners identify whether “they” is being used in a singular or plural sense? Arnold, Mayo, & Dong (in press) report three experiments in that test the role of explicitly introducing gender identity via pronouns, e.g. “This is Alex, and they use they/them pronouns.” Participants read short stories like “Alex went running with Liz and they fell down.” Answers to “Who fell down” indicated whether participants interpreted they as Alex or Alex-and-Liz. Singular interpretations of they were more likely when participants hear an explicit statement that Alex uses they/them pronouns, and in supporting discourse contexts. This paper is a companion to the main article, and reports analyses of individual difference measures. Participants self-reported familiarity with individuals who identify as nonbinary, which was expected to increase singular interpretations, but mostly it did not. In experiment 2 we also measured print exposure, but we found that it did not affect interpretation of singular they. In short, we saw virtually no effects of individual difference predictors. 

   more » « less
2. My pronouns are they/them: Talking about pronouns changes how pronouns are understood

   https://doi.org/10.3758/s13423-021-01905-0  

   Arnold, Jennifer E.; Mayo, Heather C.; Dong, Lisa (April 2021, Psychonomic Bulletin & Review)

   null (Ed.)

   The pronoun “they” can be either plural or singular, perhaps referring to an individual who identifies as nonbinary. How do listeners identifywhether “they” has a singular or plural sense? We test the role of explicitly discussing pronouns (e.g., “Alex uses they/them pronouns”). In three experiments, participants read short stories, like “Alex went running with Liz. They fell down.” Answers to “Who fell down” indicated whether participants interpreted they as Alex or Alex-and-Liz. We found more singular responses in discourse contexts that make Alex more available: when Alex was either the only person in the context or mentioned first. Critically, the singular interpretation was stronger when participants heard explicit instructions that Alex uses they/them pronouns, even though participants in all conditions had ample opportunity to learn this fact through observation. Results show that the social trend to talk about pronouns has a direct impact on how language is understood. 

   more » « less
3. Gender Competition in the Production of Nonbinary ‘They’

   https://doi.org/10.5070/G60111306  

   Arnold, Jennifer E; Venkatesh, Ranjani; Vig, Zachary (February 2024, Glossa Psycholinguistics)

   Two experiments test how college students use nonbinary they to refer to a single and specific person whose pronouns are they/them, e.g., “Alex played basketball on the neighborhood court. At one point they made a basket,” compared to matched stories about characters with binary (she/her or he/him) pronouns. Experiment 1 shows that for both types of pronouns, people use pronouns more in a one-person than a two-person context. In both experiments, people produce nonbinary they at least as frequently as binary pronouns, suggesting that any difficulty does not result in pronoun avoidance in spoken language, even though it does in written language (Arnold et al., 2022). Nevertheless, there is evidence that nonbinary they is somewhat difficult, in that people made gender errors on about 9% of trials, and they used a more acoustically prominent and disfluent-sounding pronunciation for nonbinary pronouns than binary pronouns. However, exposure  to  they  in  the  context  of  the  experiment  had  no  effect  on  frequency,  accuracy,  or  pronunciation of pronouns. This provides the first evidence of how nonbinary they is used in a naturalistic storytelling context and shows that while it poses some minor difficulties, it can be used successfully in a supportive context.  

   more » « less
4. Kesan, James & Arnold, J. E. (2025). Singular “they” exposure increases singular interpretations in ambiguous pronouns. Proceedings of the Cognitive Science Society Meeting.

   Kesan, James R; Arnold, Jennifer E (August 2025, Proceedings of the Annual Meeting of the Cognitive Science Society, 47(0))

   Evidence is accumulating that patterns of use for singular “they” are changing in English. The pronoun is becoming the preferred generic when the gender of the referent is unknown or backgrounded. This change reflects a shift in patterns of acceptability for uses of singular “they” which is in turn linked to the increased frequency of singular they. We predict that adaptation may be a cognitive mechanism underlying this change, and if so, we may see short-term adaptation within a lab session. In the present study, we use a between-subjects priming paradigm to test whether participants adapt to the frequency with which they encounter singular or plural senses of “they” in the local discourse. We find that selections of singular “they” are significantly more likely after participants have been exposed to unambiguously singular vs. plural uses of “they”. This finding implicates adaptation and suggests that adaptation may link changes in the frequency of linguistic forms to changes in their acceptability. 

   more » « less
5. MISGENDERED: Limits of Large Language Models in Understanding Pronouns

   https://doi.org/10.18653/v1/2023.acl-long.293  

   Hossain, Tamanna; Dev, Sunipa; Singh, Sameer (January 2023, Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers))

   Gender bias in language technologies has been widely studied, but research has mostly been restricted to a binary paradigm of gender. It is essential also to consider non-binary gender identities, as excluding them can cause further harm to an already marginalized group. In this paper, we comprehensively evaluate popular language models for their ability to correctly use English gender-neutral pronouns (e.g., singular they, them) and neo-pronouns (e.g., ze, xe, thon) that are used by individuals whose gender identity is not represented by binary pronouns. We introduce Misgendered, a framework for evaluating large language models’ ability to correctly use preferred pronouns, consisting of (i) instances declaring an individual’s pronoun, followed by a sentence with a missing pronoun, and (ii) an experimental setup for evaluating masked and auto-regressive language models using a unified method. When prompted out-of-the-box, language models perform poorly at correctly predicting neo-pronouns (averaging 7.6% accuracy) and gender-neutral pronouns (averaging 31.0% accuracy). This inability to generalize results from a lack of representation of non-binary pronouns in training data and memorized associations. Few-shot adaptation with explicit examples in the prompt improves the performance but plateaus at only 45.4% for neo-pronouns. We release the full dataset, code, and demo at https://tamannahossainkay.github.io/misgendered/. 

   more » « less