More Like this

1. Building Research Skills through Being a Peer Reviewer

   Benson, L.; Bates, R.; Jensen, K.; Lichtenstein, G.; Watts, K.; Ko, M; Albayati, B. (July 2021, ASEE Annual Conference proceedings)

   null (Ed.)

   This paper describes a peer reviewer mentoring program called the Engineering Education Research Peer Review Training (EER PERT) project and serves as a pilot study on longitudinal effects on researchers’ productivity and the impact of their work, differences in these factors for those who review journal manuscripts and those who review grant proposals, and what aspects of peer review training (knowledge, resources, collaborations, etc.) participants actually carry forward in their own research. Overall, the project seeks to investigate how engineering education research (EER) scholars develop skills and schema for reviewing scholarship, particularly in terms of developing constructive reviews that build expertise and advance knowledge. The Journal of Engineering Education (JEE) Mentored Reviewer Program constitutes the first phase of the EER PERT project. In this paper, we report on goals, structure and activities for the JEE Mentored Reviewer Program, pilot data from participants’ applications and exit surveys that will inform the EER PERT project in terms of participants’ developing skills and schema for reviewing and conducting EER, and provide initial suggestions from the training program that may benefit scholars new to EER. 

   more » « less
2. Building Research Skills through Being a Peer Reviewer

   Benson, Lisa; Bates, Rebecca A.; Jensen, Karin; Lichtenstein, Gary; Watts, Kelsey; Ko, Mia; Albayati, Balsam (January 2021, American Society for Engineering Education)

   null (Ed.)

   This paper describes a peer reviewer mentoring program called the Engineering Education Research Peer Review Training (EER PERT) project and serves as a pilot study on longitudinal effects on researchers’ productivity and the impact of their work, differences in these factors for those who review journal manuscripts and those who review grant proposals, and what aspects of peer review training (knowledge, resources, collaborations, etc.) participants actually carry forward in their own research. Overall, the project seeks to investigate how engineering education research (EER) scholars develop skills and schema for reviewing scholarship, particularly in terms of developing constructive reviews that build expertise and advance knowledge. The Journal of Engineering Education (JEE) Mentored Reviewer Program constitutes the first phase of the EER PERT project. In this paper, we report on goals, structure and activities for the JEE Mentored Reviewer Program, pilot data from participants’ applications and exit surveys that will inform the EER PERT project in terms of participants’ developing skills and schema for reviewing and conducting EER, and provide initial suggestions from the training program that may benefit scholars new to EER. 

   more » « less
3. Building a Community of Mentors in Engineering Education Research Through Peer Review Training

   Jensen, Karin; Ko, Evan; Lichtenstein, Gary; Watts, Kelsey; Bates, Rebecca A; Benson, Lisa (August 2022, ASEE Annual Conference proceedings)

   This paper describes the Engineering Education Research (EER) Peer Review Training (PERT) project, which is designed to develop EER scholars’ peer review skills through mentored reviewing experiences. Supported by the National Science Foundation, the overall programmatic goals of the PERT project are to establish and evaluate a mentored reviewer program for 1) EER journal manuscripts and 2) EER grant proposals. Concurrently, the project seeks to explore how EER scholars develop schema for evaluating EER scholarship, whether these schema are shared in the community, and how schema influence recommendations made to journal editors during the peer review process. To accomplish these goals, the PERT project leveraged the previously established Journal of Engineering Education (JEE) Mentored Reviewer Program, where two researchers with little reviewing experience are paired with an experienced mentor to complete three manuscript reviews collaboratively. In this paper we report on focus group and exit survey findings from the JEE Mentored Reviewer Program and discuss revisions to the program in response to those findings. 

   more » « less
4. Building a Community of Mentors in Engineering Education Research Through Peer Review Training

   Jensen, K.; Bates, R.; Lichtenstein, G.; Watts, K.; Ko, E.; Benson, L. (June 2022, 2022 Annual American Society of Engineering Education (ASEE) Conference and Exposition)

   This paper describes the Engineering Education Research (EER) Peer Review Training (PERT) project, which is designed to develop EER scholars’ peer review skills through mentored reviewing experiences. Supported by the National Science Foundation, the overall programmatic goals of the PERT project are to establish and evaluate a mentored reviewer program for 1) EER journal manuscripts and 2) EER grant proposals. Concurrently, the project seeks to explore how EER scholars develop schema for evaluating EER scholarship, whether these schema are shared in the community, and how schema influence recommendations made to journal editors during the peer review process. To accomplish these goals, the PERT project leveraged the previously established Journal of Engineering Education (JEE) Mentored Reviewer Program, where two researchers with little reviewing experience are paired with an experienced mentor to complete three manuscript reviews collaboratively. In this paper we report on focus group and exit survey findings from the JEE Mentored Reviewer Program and discuss revisions to the program in response to those findings. 

   more » « less
5. A Community-Driven Process for Developing NSF Review Panelists

   Bates, R. A.; Benson, L.; Sims, R.; Watts, K.; Jensen, K.; Ko, E.; Lichtenstein, G. (June 2023, Proceedings ASEE annual conference)

   Peer review of grant proposals is critical to the National Science Foundation (NSF) funding process for STEM disciplinary and education research. Despite this, scholars receive little training in effective and constructive review of proposals beyond definitions of review criteria and an overview of strategies to avoid bias and communicate clearly. Senior researchers often find that their reviewing skills improve and develop over time, but variations in reviewer starting points can have a negative impact on the value of reviews for their intended audiences of program officers, who make funding recommendations, and principal investigators, who drive the research or want to improve their proposals. Building on the journal review component of the Engineering Education Research Peer Review Training (EER PERT) project, which is designed to develop EER scholars’ peer review skills through mentored reviewing experiences, this paper describes a program designed to provide professional development for proposal reviewing and provides initial evaluation results. 

   more » « less