An official website of the United States government
Research has documented the presence of bias against women in hiring, including in academic science, technology, engineering, and mathematics (STEM). Hiring rubrics (also called criterion checklists, decision support tools, and evaluation tools) are widely recommended as a precise, cost-effective remedy to counteract hiring bias, despite a paucity of evidence that they actually work (see table S8). Our in-depth case study of rubric usage in faculty hiring in an academic engineering department in a very research-active university found that the rate of hiring women increased after the department deployed rubrics and used them to guide holistic discussions. Yet we also found evidence of substantial gender bias persisting in some rubric scoring categories and evaluators’ written comments. We do not recommend abandoning rubrics. Instead, we recommend a strategic and sociologically astute use of rubrics as a department self-study tool within the context of a holistic evaluation of semifinalist candidates.
more »
« less
Do Rubrics Live up to Their Promise? Examining How Rubrics Mitigate Bias in Faculty Hiring
Many colleges and universities now require faculty search committees to use rubrics when evaluating faculty job candidates, as proponents believe these “decision-support tools” can reduce the impact of bias in candidate evaluation. That is, rubrics are intended to ensure that candidates are evaluated more fairly, which is then thought to contribute to the enhanced hiring of candidates from minoritized groups. However, there is scant — and even contradictory — evidence to support this claim. This study used a multiple case study methodology to explore how five faculty search committees used rubrics in candidate evaluation, and the extent to which using a rubric seemed to perpetuate or mitigate bias in committee decision-making. Results showed that the use of rubrics can improve searches by clarifying criteria, encouraging criteria use in evaluation, calibrating the application of criteria to evidence, and in some cases, bringing diversity, equity, and inclusion work (DEI) into consideration. However, search committees also created and implemented rubrics in ways that seem to perpetuate bias, undermine effectiveness, and potentially contribute to the hiring of fewer minoritized candidates. We conclude by providing stakeholders with practical recommendations on using rubrics and actualizing DEI in faculty hiring.
more »
« less
- PAR ID:
- 10430722
- Date Published:
- Journal Name:
- The Journal of Higher Education
- ISSN:
- 0022-1546
- Page Range / eLocation ID:
- 1 to 28
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Efforts to mitigate bias in faculty hiring processes are well-documented in the literature. Yet, significant barriers to the hiring of racially minoritized and White women in many STEM fields remain. An underreported barrier to inclusive hiring is assessment of risk. Guided by theory from behavioral economics, social psychology, and decision-making, we examine the inner workings of five faculty search committees to understand how committee members identified and assessed risk with particular attention to assessments of risk that became intermingled with social biases. Committees identified and assessed five risks, including candidate interest, candidate disciplinary expertise, candidate competence, candidate collegiality, and the timing and oversight of the search process itself. We discuss implications of risk identification and assessment for effective and inclusive searches.more » « less
-
Despite the increasing diversity of undergraduate students in the United States, university faculty demographics, particularly in science, technology, engineering, and mathematics (STEM) fields, remain largely homogeneous, which is problematic for fostering an inclusive academic environment. We examined the hiring process for tenure-track teaching-focused faculty (TFF) positions, specifically within the University of California system, to develop and implement inclusive hiring practices that may promote greater faculty diversity. Through a series of faculty learning communities (FLCs), we developed and implemented inclusive hiring rubrics designed to better evaluate teaching excellence and ensure the recruitment of diverse faculty members. Our findings highlight the critical need for faculty diversity, particularly TFF who instruct in gateway introductory STEM courses, to enhance student outcomes by fostering more inclusive teaching practices and reducing racial disparities in academic achievement. We recommend that institutions adopt inclusive hiring practices, including the use of tailored hiring rubrics, to create a more equitable and supportive learning environment for all students.more » « less
-
Abstract BackgroundThe lack of racial diversity in science, technology, engineering, and mathematics (STEM) disciplines is perhaps one of the most challenging issues in the United States higher education system. The issue is not only concerning diverse students, but also diverse faculty members. One important contributing factor is the faculty hiring process. To make progress toward equity in hiring decisions, it is necessary to better understand how applicants are considered and evaluated. In this paper, we describe and present our study based on a survey of current STEM faculty members and administrators who examined applicant qualifications and characteristics in STEM faculty hiring decisions. ResultsThere are three key findings of the present research. First, we found that faculty members placed different levels of importance on characteristics and qualifications for tenure track hiring and non-tenure track hiring. For example, items related to research were more important when evaluating tenure track applicants, whereas items related to teaching and diversity were more important when evaluating non-tenure track applicants. Second, faculty members’ institutional classification, position, and personal identities (e.g., gender, race/ethnicity) had an impact on their evaluation criteria. For instance, we found men considered some diversity-related items more important than women. Third, faculty members rated the importance of qualifications with diversity, equity, and inclusion (DEI)-related constructs significantly lower than qualifications that did not specify DEI-related constructs, and this trend held for both tenure track and non-tenure track faculty hiring. ConclusionsThis study was an attempt to address the issue of diversity in STEM faculty hiring at institutions of higher education by examining how applicant characteristics are considered and evaluated in faculty hiring practices. Emphasizing research reputation and postdoctoral reputation while neglecting institutional diversity and equitable and inclusive teaching, research, and service stunt progress toward racial diversity because biases—both implicit and explicit, both positive and negative—still exist. Our results were consistent with research on bias in recruitment, revealing that affinity bias, confirmation bias, and halo bias exist in the faculty hiring process. These biases contribute to inequities in hiring, and need to be addressed before we can reach, sustain, and grow desired levels of diversity.more » « less
-
DeChenne-Peters, Sue Ellen (Ed.)Persons Excluded due to Ethnicity and Race (PEERs) remain underrepresented in university faculties, particularly in science, technology, engineering, math and medicine (STEMM) fields, despite increasing representation among students, and mounting evidence supporting the importance of PEER faculty in positively impacting both scientific and educational outcomes. In fact, the ratio of PEER faculty to students has been steadily dropping since 2000. In our case study, we examine the factors that explain creation of an unusually diverse faculty within a biology department. We analyzed nearly 40 years of hiring data in the study department and show that this department (the study department), historically and currently, maintains a significantly higher proportion of PEERs on faculty as compared to two national datasets. Additionally, we identify factors that contributed to hiring of PEERs into tenure and tenure-track positions. We observed a significant increase in the hiring of PEERs concurrent with the implementation of a co-hiring policy (p= 0.04) which allowed a single search to make two hires when at least one candidate was a PEER. In contrast, three key informants at sister departments reported that co-hiring policies did not result in PEER hires, but instead different practices were effective. In line with one of these practices, we observe a possible association between search committees with at least one PEER member and PEER hiring (p = 0.055). Further, the presence of particular faculty members (Agents of Change) on search committees is associated with PEER hiring. In this case study the combination of a co-hire policy based on the principle of interest-convergence to redress hiring inequities, along with the presence of agents of change, increased faculty PEER representation in STEMM departments.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1080/00221546.2023.2168411
