skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: To Impress an Algorithm; Minoritized Applicants’ Perceptions of Fairness in AI Hiring Systems
Technology firms increasingly leverage artificial intelligence (AI) to enhance human decision-making processes in the rapidly evolving talent acquisi- tion landscape. However, the ramifications of these advancements on workforce diversity remain a topic of intense debate. Drawing upon Gilliland’s procedu- ral justice framework, we explore how IT job candidates interpret the fairness of AI-driven recruitment systems. Gilliland’s model posits that an organization’s adherence to specific fairness principles, such as honesty and the opportunity to perform, profoundly shapes candidates’ self-perceptions, their judgments of the recruitment system’s equity, and the overall attractiveness of the organization. Using focus groups and interviews, we interacted with 47 women, Black and Lat- inx or Hispanic undergraduates specializing in computer and information science to discern how gender, race, and ethnicity influence attitudes toward AI in hir- ing. Three procedural justice rules, consistency of administration, job-relatedness, and selection information, emerged as critical in shaping participants’ fairness perceptions. Although discussed less frequently, the propriety of questions held significant resonance for Black and Latinx or Hispanic participants. Our study underscores the critical role of fairness evaluations for organizations, especially those striving to diversify the tech workforce.  more » « less
Award ID(s):
1841368
PAR ID:
10541584
Author(s) / Creator(s):
;
Publisher / Repository:
Lecture Notes in Computer Science
Date Published:
Page Range / eLocation ID:
43-61
Subject(s) / Keyword(s):
algorithms hiring bias
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Objectives Traditional police procedural justice theory argues that citizen perceptions of fair treatment by police officers increase police legitimacy, which leads to an increased likelihood of legal compliance. Recently, Nagin and Telep (2017) criticized these causal assumptions, arguing that prior literature has not definitively ruled out reverse causality—that is, legitimacy influences perceptions of fairness and/or compliance influences perceptions of both fairness and legitimacy. The goal of the present paper was to explore this critique using experimental and correlational methodologies within a longitudinal framework. Methods Adolescents completed a vignette-based experiment that manipulated two aspects of officer behavior linked to perceptions of fairness: voice and impartiality. After reading the vignette, participants rated the fairness and legitimacy of the officer within the situation. At three time points prior to the experiment (1, 17, and 31 months), participants completed surveys measuring their global perceptions of police legitimacy and self-reported delinquency. Data were analyzed to assess the extent to which global legitimacy and delinquency predicted responses to the vignette net of experimental manipulations and controls. Results Both experimental manipulations led to higher perceptions of situational procedural justice and officer legitimacy. Prior perceptions of police legitimacy did not predict judgments of situational procedural justice; however, in some cases, prior engagement in delinquency was negatively related to situational procedural justice. Prior perceptions of legitimacy were positively associated with situational perceptions of legitimacy regardless of experimental manipulations. Conclusions This study showed mixed support for the case of reverse causality among police procedural justice, legitimacy, and compliance 
    more » « less
  2. Abstract For most of the scientific disciplines associated with coastal and estuarine research, workforce representation does not match the demographics of communities we serve, especially for Black, Hispanic or Latino, and Indigenous peoples. This essay provides an overview of this inequity and identifies how a scientific society can catalyze representational, structural, and interactional diversity to achieve greater inclusion. Needed changes go beyond representational diversity and require an intentional commitment to build capacity through inclusivity and community engagement by supporting anti-racist policies and actions. We want to realize a sense of belonging on the part of scientists in society at large and enable research pursuits through a lens of social justice in service of coastal communities. Minimally, this framework offers an avenue for increased recruitment of individuals from more diverse racial and ethnic identities. More broadly, the mechanisms described here aim to create a culture in scientific societies in which social justice, driven by anti-racist actions, produces systemic change in how members of scientific societies approach, discuss, and address issues of inequity. We have written this essay for members of the coastal and marine science community who are interested in change. We aim to call in new voices, allies, and champions to this work. 
    more » « less
  3. Despite increasing demands for skilled workers within the technological domain, there is still a deficit in the number of graduates in computing fields (computer science, information technology, and computer engineering). Understanding the factors that contribute to students’ motivation and persistence is critical to helping educators, administrators, and industry professionals better focus efforts to improve academic outcomes and job placement. This article examines how experiences contribute to a student’s computing identity, which we define by their interest, recognition, sense of belonging, and competence/performance beliefs. In particular, we consider groups underrepresented in these disciplines, women and minoritized racial/ethnic groups (Black/African American and Hispanic/Latinx). To delve into these relationships, a survey of more than 1,600 students in computing fields was conducted at three metropolitan public universities in Florida. Regression was used to elucidate which experiences predict computing identity and how social identification (i.e., as female, Black/African American, and/or Hispanic/Latinx) may interact with these experiences. Our results suggest that several types of experiences positively predict a student’s computing identity, such as mentoring others, having a job, or having friends in computing. Moreover, certain experiences have a different effect on computing identity for female and Hispanic/Latinx students. More specifically, receiving academic advice from teaching assistants was more positive for female students, receiving advice from industry professionals was more negative for Hispanic/Latinx students, and receiving help on classwork from students in their class was more positive for Hispanic/Latinx students. Other experiences, while having the same effect on computing identity across students, were experienced at significantly different rates by females, Black/African American students, and Hispanic/Latinx students. The findings highlight experiential ways in which computing programs can foster computing identity development, particularly for underrepresented and marginalized groups in computing. 
    more » « less
  4. Despite increasing demands for skilled workers within the technological domain, there is still a deficit in the number of graduates in computing fields (computer science, information technology, and computer engineering). Understanding the factors that contribute to students’ motivation and persistence is critical to helping educators, administrators, and industry professionals better focus efforts to improve academic outcomes and job placement. This article examines how experiences contribute to a student’s computing identity, which we define by their interest, recognition, sense of belonging, and competence/performance beliefs. In particular, we consider groups underrepresented in these disciplines, women and minoritized racial/ethnic groups (Black/African American and Hispanic/Latinx). To delve into these relationships, a survey of more than 1,600 students in computing fields was conducted at three metropolitan public universities in Florida. Regression was used to elucidate which experiences predict computing identity and how social identification (i.e., as female, Black/African American, and/or Hispanic/Latinx) may interact with these experiences. Our results suggest that several types of experiences positively predict a student’s computing identity, such as mentoring others, having a job, or having friends in computing. Moreover, certain experiences have a different effect on computing identity for female and Hispanic/Latinx students. More specifically, receiving academic advice from teaching assistants was more positive for female students, receiving advice from industry professionals was more negative for Hispanic/Latinx students, and receiving help on classwork from students in their class was more positive for Hispanic/Latinx students. Other experiences, while having the same effect on computing identity across students, were experienced at significantly different rates by females, Black/African American students, and Hispanic/Latinx students. The findings highlight experiential ways in which computing programs can foster computing identity development, particularly for underrepresented and marginalized groups in computing. 
    more » « less
  5. The plethora of fairness metrics developed for ranking-based decision-making raises the question: which metrics align best with people’s perceptions of fairness, and why? Most prior studies examining people’s perceptions of fairness metrics tend to use ordinal rating scales (e.g., Likert scales). However, such scales can be ambiguous in their interpretation across participants, and can be influenced by interface features used to capture responses.We address this gap by exploring the use of two-alternative forced choice methodologies— used extensively outside the fairness community for comparing visual stimuli— to quantitatively compare participant perceptions across fairness metrics and ranking characteristics. We report a crowdsourced experiment with 224 participants across four conditions: two alternative rank fairness metrics, ARP and NDKL, and two ranking characteristics, lists of 20 and 100 candidates, resulting in over 170,000 individual judgments. Quantitative results show systematic differences in how people interpert these metrics, and surprising exceptions where fairness metrics disagree with people’s perceptions. Qualitative analyses of participant comments reveals an interplay between cognitive and visual strategies that affects people’s perceptions of fairness. From these results, we discuss future work in aligning fairness metrics with people’s perceptions, and highlight the need and benefits of expanding methodologies for fairness studies. 
    more » « less