An official website of the United States government
Recent developments in Neural Relation Extraction (NRE) have made significant strides towards Automated Knowledge Base Construction (AKBC). While much attention has been dedicated towards improvements in accuracy, there have been no attempts in the literature to our knowledge to evaluate social biases in NRE systems. We create WikiGenderBias, a distantly supervised dataset with a human annotated test set. WikiGenderBias has sentences specifically curated to analyze gender bias in relation extraction systems. We use WikiGenderBias to evaluate systems for bias and find that NRE systems exhibit gender biased predictions and lay groundwork for future evaluation of bias in NRE. We also analyze how name anonymization, hard debiasing for word embeddings, and counterfactual data augmentation affect gender bias in predictions and performance.
more »
« less
Quantifying 60 Years of Gender Bias in Biomedical Research with Word Embeddings
Gender bias in biomedical research can have an adverse impact on the health of real people. For example, there is evidence that heart disease-related funded research generally focuses on men. Health disparities can form between men and at-risk groups of women (i.e., elderly and low-income) if there is not an equal number of heart disease-related studies for both genders. In this paper, we study temporal bias in biomedical research articles by measuring gender differences in word embeddings. Specifically, we address multiple questions, including, How has gender bias changed over time in biomedical research, and what health-related concepts are the most biased? Overall, we find that traditional gender stereotypes have reduced over time. However, we also find that the embeddings of many medical conditions are as biased today as they were 60 years ago (e.g., concepts related to drug addiction and body dysmorphia).
more »
« less
- Award ID(s):
- 1947697
- PAR ID:
- 10181315
- Date Published:
- Journal Name:
- Proceedings of the 19th SIGBioMed Workshop on Biomedical Language Processing
- Page Range / eLocation ID:
- 1 to 13
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Image recognition systems offer the promise to learn from images at scale without requiring expert knowledge. However, past research suggests that machine learning systems often produce biased output. In this article, we evaluate potential gender biases of commercial image recognition platforms using photographs of U.S. members of Congress and a large number of Twitter images posted by these politicians. Our crowdsourced validation shows that commercial image recognition systems can produce labels that are correct and biased at the same time as they selectively report a subset of many possible true labels. We find that images of women received three times more annotations related to physical appearance. Moreover, women in images are recognized at substantially lower rates in comparison with men. We discuss how encoded biases such as these affect the visibility of women, reinforce harmful gender stereotypes, and limit the validity of the insights that can be gathered from such data.more » « less
-
The overarching goal of this research project is to provide a novel contribution to perceived bias research by testing the hypothesis that mere exposure to instances of subtle gender bias in STEM settings can have important effects on observers, depending on whether they recognize such events as gender bias or do not see it as bias. The goal of the first of five experiments was to assess how witnessing subtle gender bias events influences explicit stereotype activation among people who recognize the events as gender stereotyping as well as those who do not. We utilized video materials that were developed and tested in our previous NSF research that show a group of four engineering students, 2 women and 2 men, working together on an engineering design task. There are two versions of the video: one in which the students engaged in subtle gender bias (bias version), and one in which the students engaged in neutral interactions (control version). Over 400 participants were recruited from a large midwestern research university from computer science and engineering majors in which 30% or fewer majors are women. The survey included assessments of perceptions of gender stereotyping in the video, general stereotype endorsement and STEM stereotype endorsement, and three individual difference measures (gender-based rejection sensitivity, sexism sensitivity and negative emotionality) used as covariates in analyses. We found that participants who saw the bias video reported greater explicit stereotyping when they failed to recognize gender bias in the video. When they did recognize bias, they reported explicit stereotyping at levels similar to those in the control condition. This pattern suggests that exposure to subtle gender bias events may have activated gender stereotypes, but when participants recognized the events as gender bias, they tempered their explicit stereotyping.more » « less
-
The overarching goal of this research project is to provide a novel contribution to perceived bias research by testing the hypothesis that mere exposure to instances of subtle gender bias in STEM settings can have important effects on observers, depending on whether they recognize such events as gender bias or do not see it as bias. The goal of the first of five experiments was to assess how witnessing subtle gender bias events influences explicit stereotype activation among people who recognize the events as gender stereotyping as well as those who do not. We utilized video materials that were developed and tested in our previous NSF research that show a group of four engineering students, 2 women and 2 men, working together on an engineering design task. There are two versions of the video: one in which the students engaged in subtle gender bias (bias version), and one in which the students engaged in neutral interactions (control version). Over 400 participants were recruited from a large midwestern research university from computer science and engineering majors in which 30% or fewer majors are women. The survey included assessments of perceptions of gender stereotyping in the video, general stereotype endorsement and STEM stereotype endorsement, and three individual difference measures (gender-based rejection sensitivity, sexism sensitivity and negative emotionality) used as covariates in analyses. We found that participants who saw the bias video reported greater explicit stereotyping when they failed to recognize gender bias in the video. When they did recognize bias, they reported explicit stereotyping at levels similar to those in the control condition. This pattern suggests that exposure to subtle gender bias events may have activated gender stereotypes, but when participants recognized the events as gender bias, they tempered their explicit stereotyping.more » « less
-
Women experience higher morbidity than men, despite living longer. This is often attributed to biological differences between the sexes; however, the majority of societies in which these disparities are observed exhibit gender norms that favor men. We tested the hypothesis that female-biased gender norms ameliorate gender disparities in health by comparing gender differences in inflammation and hypertension among the matrilineal and patrilineal Mosuo of China. Widely reported gender disparities in health were reversed among matrilineal Mosuo compared with patrilineal Mosuo, due to substantial improvements in women’s health, with no concomitant detrimental effects on men. These findings offer evidence that gender norms limiting women’s autonomy and biasing inheritance toward men adversely affect the health of women, increasing women’s risk for chronic diseases with tremendous global health impact.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.18653/v1/2020.bionlp-1.1
