While there is evidence to support the existence of identity-based disparities, inequities, and biases in the academic journal peer-review process, little research supports the presence of this bias in the peer-review process for academic journals in science education. Through an analysis of six leading journals in science education, we aimed to investigate the extent to which diversity, equity, and inclusion (DEI), as well as the presence of bias in the peer-review process, are addressed by these journals. We analyzed trends in the gender/sex, geographical affiliation, race/ethnicity, and the presence of equity-centered research focus for members of these journals' editors and editorial boards. We found that although gender/sex is well-balanced in these journals' editors and editorial boards, they are typically North American centric, and White individuals are overwhelmingly represented. Four journals had a quarter or more of individuals who pursue equity-centered research. Only two journals provided detailed information on how manuscripts are reviewed in their author submission guidelines. All used a double-blind approach to peer-review. One of the journals includes an explicit position on DEI. Based on the analyses and reflections on our own experiences, we recommend science education journals consider ways to probe whether bias does exist in their peer-review process, diversify their board to be more inclusive of scholars from communities historically marginalized, and move to a triple-blind approach to their peer-review process as mechanisms to mitigate bias in the journal peer review.
more »
« less
Exploring racial equity in the science education journal review process
Across a broad range of disciplines, research has found that inequity is systemic in the journal review process. Collectively, however, this study does not specifically examine racial inequity. Moreover, literature on the peer review process in science education, in particular, does not foreground equity as a subject of study. The present study aims to address this void by examining racial equity in the peer review process with a specific focus on journals in science education. Data are collected from lead editors of major science education journals through the form of interviews, focus groups, and critical arts-based methods. The two research questions driving data collection are (a) In what ways does the science education journal peer review process promote racial equity? and (b) How are science education journal editors’ perceptions of racial inequity reflected in the peer review process? McNair and colleagues’ racial equity framework informs the explorations of journal review in science education from the lead editors’ perspectives. From our findings, we offer four suggestions for moving toward greater racial equity in the science education peer review process.
more »
« less
- Award ID(s):
- 2029956
- NSF-PAR ID:
- 10331183
- Date Published:
- Journal Name:
- Science Education
- Volume:
- 106
- Issue:
- 5
- ISSN:
- 0036-8326
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This paper describes the Engineering Education Research (EER) Peer Review Training (PERT) project, which is designed to develop EER scholars’ peer review skills through mentored reviewing experiences. Supported by the National Science Foundation, the overall programmatic goals of the PERT project are to establish and evaluate a mentored reviewer program for 1) EER journal manuscripts and 2) EER grant proposals. Concurrently, the project seeks to explore how EER scholars develop schema for evaluating EER scholarship, whether these schema are shared in the community, and how schema influence recommendations made to journal editors during the peer review process. To accomplish these goals, the PERT project leveraged the previously established Journal of Engineering Education (JEE) Mentored Reviewer Program, where two researchers with little reviewing experience are paired with an experienced mentor to complete three manuscript reviews collaboratively. In this paper we report on focus group and exit survey findings from the JEE Mentored Reviewer Program and discuss revisions to the program in response to those findings.more » « less
-
This paper describes the Engineering Education Research (EER) Peer Review Training (PERT) project, which is designed to develop EER scholars’ peer review skills through mentored reviewing experiences. Supported by the National Science Foundation, the overall programmatic goals of the PERT project are to establish and evaluate a mentored reviewer program for 1) EER journal manuscripts and 2) EER grant proposals. Concurrently, the project seeks to explore how EER scholars develop schema for evaluating EER scholarship, whether these schema are shared in the community, and how schema influence recommendations made to journal editors during the peer review process. To accomplish these goals, the PERT project leveraged the previously established Journal of Engineering Education (JEE) Mentored Reviewer Program, where two researchers with little reviewing experience are paired with an experienced mentor to complete three manuscript reviews collaboratively. In this paper we report on focus group and exit survey findings from the JEE Mentored Reviewer Program and discuss revisions to the program in response to those findings.more » « less
-
ABSTRACT CONTEXT The peer review process plays a critical role in ensuring the quality of work published within a field and advancing the knowledge within the research community. However, for many members of the community, the process of peer review largely remains a black box to many scholars, especially those with less experience within the community. Therefore, there is a need to illuminate the peer review process for the research community. PURPOSE OR GOAL To more transparently reveal the contents of the black box around the peer review process, we interviewed editors (associate and deputy editors) for the Journal of Engineering Education (JEE) to provide editor perspectives on the overall peer review process. The goal of this paper is to clearly articulate the behind-the-scenes processes of peer review as well as the expectations and perceptions of the editors with respect to publishing within JEE. By bringing these processes to light, we hope that more members of the field will be aware of the overall process and the associated expectations for contributing to the field. APPROACH OR METHODOLOGY/METHODS To meet the goals of this study, we conducted semi-structured interviews with six editors of JEE who worked in the field of engineering education research (EER), as a part of a larger project exploring the boundaries of the field as expressed within the peer reviews process. The interviewer from the research team followed a protocol but also asked additional questions to elicit more details in some cases. The interviews were recorded, transcribed, and thematically coded using an open-coding process. ACTUAL OR ANTICIPATED OUTCOMES Based on the analysis of the editor interviews, we present three critical aspects of the peer review process: the types of editors, the process that editors typically conduct to identify reviewers, and the types of decisions through the process. Additionally, we highlight considerations and advice from the editors to help members of the EER community develop. CONCLUSIONS/RECOMMENDATIONS/SUMMARY The current study makes the editors’ perspectives and decision-making processes more explicit to readers. These decision-making processes are full of careful considerations and also challenges. By doing so, we hope to help the members of the EER community gain a better understanding of what is going on backstage of the peer review process.more » « less
-
Many scientific fields of study use formally established evidence standards during the peer review and evaluation process, such as Consolidated Standards of Reporting Trials (CONSORT) in medical research, the What Works Clearinghouse (WWC) used in education in the United States, or the APA Journal Article Reporting Standards (JARS) in psychology. The basis for these standards is community agreement on what to report in empirical studies. Such standards achieve two key goals. First, they make it easier to compare studies, facilitating replications, through transparent reporting and sharing of data, which can provide confidence that multiple research teams can obtain the same results. Second, they establish community agreement on how to report on and evaluate studies using different methodologies. The discipline of computer science does not have formalized evidence standards, even for major conferences or journals. This Dagstuhl Seminar has three primary objectives: 1. To establish a process for creating or adopting an existing evidence standard for empirical research in computer science. 2. To build a community of scholars that can discuss what a general standard should include. 3. To kickstart the discussion with scholars from software engineering, human-computer interac- tion, and computer science education. In order to better discuss and understand the implications of such standards across several empirical subfields of computer science and to facilitate adoption, we brought together participants from a range of backgrounds; including academia and industry, software engineering, computer- human interaction and computer science education, as well as representatives from several prominent journals.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1002/sce.21719
