skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: NIH peer review: Criterion scores completely account for racial disparities in overall impact scores
Previous research has found that funding disparities are driven by applications’ final impact scores and that only a portion of the black/white funding gap can be explained by bibliometrics and topic choice. Using National Institutes of Health R01 applications for council years 2014–2016, we examine assigned reviewers’ preliminary overall impact and criterion scores to evaluate whether racial disparities in impact scores can be explained by application and applicant characteristics. We hypothesize that differences in commensuration—the process of combining criterion scores into overall impact scores—disadvantage black applicants. Using multilevel models and matching on key variables including career stage, gender, and area of science, we find little evidence for racial disparities emerging in the process of combining preliminary criterion scores into preliminary overall impact scores. Instead, preliminary criterion scores fully account for racial disparities—yet do not explain all of the variability—in preliminary overall impact scores.  more » « less
Award ID(s):
1759825
PAR ID:
10254035
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Science Advances
Volume:
6
Issue:
23
ISSN:
2375-2548
Page Range / eLocation ID:
eaaz4868
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Structural racism and individual discrimination contribute to racial inequalities in poor housing conditions in the United States. Less is known about whether and how structural racism and individual discrimination shape a parallel, but distinct, process that is also consequential for family wellbeing: experiencing housing unit maintenance delays. Maintenance delays transform acute problems into chronic stressors and increase exposure to physical hazards over time. Using the 2013 American Housing Survey, I examine racial/ethnic disparities in maintenance delays across non-Hispanic White, Black, Hispanic, Asian, and American Indian/Alaska Native renters. Given that 2.3 million low-income households rent using Housing Choice Vouchers (HCVs), a federal housing assistance program with requirements around repair timing, I also examine how renting with a voucher shapes maintenance delays. There are three principal findings. First, White renters are more likely to report timely repairs than either Black or Hispanic renters. Second, for Black renters, both structural racism experienced in rental markets and individual discrimination drive this disparity, whereas Hispanic renters’ diverging maintenance experiences are largely explained by pathways impacted by structural racism. Third, renting with an HCV is not associated with repair timeliness for any racial/ethnic group. Taken together, the findings suggest that racial/ethnic disparities in substandard housing emerge not only through unequal exposure to housing quality problems but also through unequal responses to these issues. 
    more » « less
  2. We analyzed a population-based cohort ( N = 10,922) to investigate the onset and stability of racial and ethnic disparities in advanced (i.e., above the 90 th percentile) science and mathematics achievement during elementary school as well as the antecedent, opportunity, and propensity factors that explained these disparities. About 13% to 16% of White students versus 3% to 4% of Black or Hispanic students displayed advanced science or mathematics achievement during kindergarten. The antecedent factor of family socioeconomic status and the propensity factors of student science, mathematics, and reading achievement by kindergarten consistently explained whether students displayed advanced science or mathematics achievement during first, second, third, fourth, or fifth grade. These and additional factors substantially or fully explained initially observed disparities between Black or Hispanic and White students in advanced science or mathematics achievement during elementary school. Economic and educational policies designed to increase racial and ethnic representation in STEM course taking, degree completion, and workforce participation may need to begin by elementary school. 
    more » « less
  3. Importance Prior research has established that Hispanic and non-Hispanic Black residents in the US experienced substantially higher COVID-19 mortality rates in 2020 than non-Hispanic White residents owing to structural racism. In 2021, these disparities decreased. Objective To assess to what extent national decreases in racial and ethnic disparities in COVID-19 mortality between the initial pandemic wave and subsequent Omicron wave reflect reductions in mortality vs other factors, such as the pandemic’s changing geography. Design, Setting, and Participants This cross-sectional study was conducted using data from the US Centers for Disease Control and Prevention for COVID-19 deaths from March 1, 2020, through February 28, 2022, among adults aged 25 years and older residing in the US. Deaths were examined by race and ethnicity across metropolitan and nonmetropolitan areas, and the national decrease in racial and ethnic disparities between initial and Omicron waves was decomposed. Data were analyzed from June 2021 through March 2023. Exposures Metropolitan vs nonmetropolitan areas and race and ethnicity. Main Outcomes and Measures Age-standardized death rates. Results There were death certificates for 977 018 US adults aged 25 years and older (mean [SD] age, 73.6 [14.6] years; 435 943 female [44.6%]; 156 948 Hispanic [16.1%], 140 513 non-Hispanic Black [14.4%], and 629 578 non-Hispanic White [64.4%]) that included a mention of COVID-19. The proportion of COVID-19 deaths among adults residing in nonmetropolitan areas increased from 5944 of 110 526 deaths (5.4%) during the initial wave to a peak of 40 360 of 172 515 deaths (23.4%) during the Delta wave; the proportion was 45 183 of 210 554 deaths (21.5%) during the Omicron wave. The national disparity in age-standardized COVID-19 death rates per 100 000 person-years for non-Hispanic Black compared with non-Hispanic White adults decreased from 339 to 45 deaths from the initial to Omicron wave, or by 293 deaths. After standardizing for age and racial and ethnic differences by metropolitan vs nonmetropolitan residence, increases in death rates among non-Hispanic White adults explained 120 deaths/100 000 person-years of the decrease (40.7%); 58 deaths/100 000 person-years in the decrease (19.6%) were explained by shifts in mortality to nonmetropolitan areas, where a disproportionate share of non-Hispanic White adults reside. The remaining 116 deaths/100 000 person-years in the decrease (39.6%) were explained by decreases in death rates in non-Hispanic Black adults. Conclusions and Relevance This study found that most of the national decrease in racial and ethnic disparities in COVID-19 mortality between the initial and Omicron waves was explained by increased mortality among non-Hispanic White adults and changes in the geographic spread of the pandemic. These findings suggest that despite media reports of a decline in disparities, there is a continued need to prioritize racial health equity in the pandemic response. 
    more » « less
  4. Where machine-learned predictive risk scores inform high-stakes decisions, such as bail and sentencing in criminal justice, fairness has been a serious concern. Recent work has characterized the disparate impact that such risk scores can have when used for a binary classification task. This may not account, however, for the more diverse downstream uses of risk scores and their non-binary nature. To better account for this, in this paper, we investigate the fairness of predictive risk scores from the point of view of a bipartite ranking task, where one seeks to rank positive examples higher than negative ones. We introduce the xAUC disparity as a metric to assess the disparate impact of risk scores and define it as the difference in the probabilities of ranking a random positive example from one protected group above a negative one from another group and vice versa. We provide a decomposition of bipartite ranking loss into components that involve the discrepancy and components that involve pure predictive ability within each group. We use xAUC analysis to audit predictive risk scores for recidivism prediction, income prediction, and cardiac arrest prediction, where it describes disparities that are not evident from simply comparing within-group predictive performance. 
    more » « less
  5. The large labor markets of big cities offer greater possibilities for workers to gain skills and experience through successively better employment opportunities. This ”experience effect” contributes to the higher average wages that are found in big cities compared to the economy as a whole. Racial wage inequality is also higher in bigger cities than in the economy on average. We offer an explanation for this pattern, demonstrating that there is substantial racial inequality in the economic returns to work experience acquired in big cities. Using data from the National Longitudinal Survey of Youth, 1979 we find that each year of work experience in a big city increases Black and Latinx workers’ wages by about one quarter to half as much as White workers’ wages. A substantial amount of this inequality can be explained by further racial disparities in the benefits of high-skill work experience. This research identifies a heretofore unknown source of inequality that is distinctly urban in nature, and expands our knowledge of the challenges to reaching inter-racial wage equality. 
    more » « less