An official website of the United States government
AI technologies such as Large Language Models (LLMs) are increasingly used to make suggestions to autocomplete text as people write. Can these suggestions impact people’s writing and attitudes? In two large-scale preregistered experiments (N=2,582), we expose participants who are writing about important societal issues to biased AI-generated suggestions. The attitudes participants expressed in their writing and in a post-task survey converged towards the AI’s position. Yet, a majority of participants were unaware of the AI suggestions’ bias and their influence. Further, awareness of the task or of the AI’s bias, e.g. warning participants about potential bias before or after exposure to the treatment, did not mitigate the influence effect. Moreover, the AI’s influence is not fully explained by the additional information provided by the suggestions.
more »
« less
AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
Large language models (LLMs) are being increasingly integrated into everyday products and services, such as coding tools and writing assistants. As these embedded AI applications are deployed globally, there is a growing concern that the AI models underlying these applications prioritize Western values. This paper investigates what happens when a Western-centric AI model provides writing suggestions to users from a different cultural background. We conducted a cross-cultural controlled experiment with 118 participants from India and the United States who completed culturally grounded writing tasks with and without AI suggestions. Our analysis reveals that AI provided greater efficiency gains for Americans compared to Indians. Moreover, AI suggestions led Indian participants to adopt Western writing styles, altering not just what is written but also how it is written. These findings show that Western-centric AI models homogenize writing toward Western norms, diminishing nuances that differentiate cultural expression.
more »
« less
- Award ID(s):
- 1901151
- PAR ID:
- 10563656
- Publisher / Repository:
- arXiv
- Date Published:
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Prior research suggests various reasons for the paucity of American Indian/Alaska Native (AI/AN) people in engineering fields, including academic deficiencies, lack of role models, and minimal financial support to pursue a college education. One potential reason that has yet to be explored relates to the cultural and spiritual barriers that could deter AI/AN people from feeling a sense of belonging in engineering fields. These barriers may create obstacles to progressing through engineering career pathways. Our research investigates the range and variation of cultural/spiritual/ethical issues that may be affecting AI/AN people’s success in engineering and other science, technology, and mathematics fields. The work reported here focuses on findings from students and professionals in engineering fields specifically. The study seeks to answer two research questions: (1) What ethical issues do AI/AN students and professionals in engineering fields experience, and how do they navigate these issues?, and (2) Do ethical issues impede AI/AN students from pursuing engineering careers, and if so, how? We distributed an online survey to AI/AN college students (undergraduate and graduate) and professionals in STEM fields, including engineers, in the western United States region. Our results indicate strong connections to AI/AN culture by the participants in the study as well as some cultural, ethical, and/or spiritual barriers that exist for AI/AN individuals in the engineering field. The AI/AN professionals had less concerns with respect to activities that may conflict with AI/AN cultural customs compared to the students, which may be a result of the professionals having gained experiences that allow them to navigate these situations. Overall, our research offers insights for policy and practice within higher education institutions with engineering majors and/or graduate programs and organizations that employ engineering professionals.more » « less
-
Qin Zhu, PhD Assistant Professor (Ed.)Prior research suggests various reasons for the paucity of American Indian/Alaska Native (AI/AN) people in engineering fields, including academic deficiencies, lack of role models, and minimal financial support to pursue a college education. One potential reason that has yet to be explored relates to the cultural and spiritual barriers that could deter AI/AN people from feeling a sense of belonging in engineering fields. These barriers may create obstacles to progressing through engineering career pathways. Our research investigates the range and variation of cultural/spiritual/ethical issues that may be affecting AI/AN people’s success in engineering and other science, technology, and mathematics fields. The work reported here focuses on findings from students and professionals in engineering fields specifically. The study seeks to answer two research questions: (1) What ethical issues do AI/AN students and professionals in engineering fields experience, and how do they navigate these issues?, and (2) Do ethical issues impede AI/AN students from pursuing engineering careers, and if so, how? We distributed an online survey to AI/AN college students (undergraduate and graduate) and professionals in STEM fields, including engineers, in the western United States region. Our results indicate strong connections to AI/AN culture by the participants in the study as well as some cultural, ethical, and/or spiritual barriers that exist for AI/AN individuals in the engineering field. The AI/AN professionals had less concerns with respect to activities that may conflict with AI/AN cultural customs compared to the students, which may be a result of the professionals having gained experiences that allow them to navigate these situations. Overall, our research offers insights for policy and practice within higher education institutions with engineering majors and/or graduate programs and organizations that employ engineering professionalsmore » « less
-
Given large language models’ (LLMs) increasing integration into workplace software, it is important to examine how biases in the models may impact workers. For example, stylistic biases in the language suggested by LLMs may cause feelings of alienation and result in increased labor for individuals or groups whose style does not match. We examine how such writer-style bias impacts inclusion, control, and ownership over the work when co-writing with LLMs. In an online experiment, participants wrote hypothetical job promotion requests using either hesitant or self-assured auto-complete suggestions from an LLM and reported their subsequent perceptions. We found that the style of the AI model did not impact perceived inclusion. However, individuals with higher perceived inclusion did perceive greater agency and ownership, an effect more strongly impacting participants of minoritized genders. Feelings of inclusion mitigated a loss of control and agency when accepting more AI suggestions.more » « less
-
AI-supported writing technologies (AISWT) that provide grammatical suggestions, autocomplete sentences, or generate and rewrite text are now a regular feature integrated into many people's workflows. However, little is known about how people perceive the suggestions these tools provide. In this paper, we investigate how Black American users perceive AISWT, motivated by prior findings in natural language processing that highlight how the underlying large language models can contain racial biases. Using interviews and observational user studies with 13 Black American users of AISWT, we found a strong tradeoff between the perceived benefits of using AISWT to enhance their writing style and feeling like ''it wasn't built for us'''. Specifically, participants reported AISWT's failure to recognize commonly used names and expressions in African American Vernacular English, experiencing its corrections as hurtful and alienating and fearing it might further minoritize their culture. We end with a reflection on the tension between AISWT that fail to include Black American culture and language, and AISWT that attempt to mimic it, with attention to accuracy, authenticity, and the production of social difference.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Posted Content:
- The DOI is not currently available.
