skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Board 111: A Systematic Review of Instruments Used to Evaluate the Effectiveness of the Entering Mentoring Curriculum
Effective mentorship has been linked to improving research skills and productivity, reducing the risk of anxiety and depression, and maintaining students' academic persistence in STEM fields. Recognizing the enormous effect of mentoring on students’ academic careers and confidence, many universities and research institutions provide training programs to faculty to enhance their mentoring skills and knowledge and strengthen mentoring relationships. Many existing mentor programs for faculty adopt the evidence-based Entering Mentoring training curriculum, originally developed by a team of researchers and practitioners at the University of Wisconsin Madison for research faculty in STEM disciplines [1]. From the program evaluation perspective, measuring a training program's results and determining whether intended outcomes are achieved (i.e., the outcome evaluation) can tell whether a program achieves its goals. The results of the evaluation further inform program organizers of needed improvements. Therefore, having good knowledge of these assessment tools and their appropriate usage is essential to planning and evaluating mentoring programs. After the Entering Mentoring training curriculum was launched, various assessment tools and approaches have been utilized by different training program evaluations. This study systematically and thoroughly reviews the extant empirical studies in STEM fields (including intervention and program evaluation studies) that used the Entering Mentoring training curriculum since it was first introduced (2005 to 2023). The goal is to examine: (1) what outcome variables have been assessed to indicate the effectiveness of the Entering Mentoring training curriculum, and (2) what measurement instruments have been used to quantify the outcome variables? Finally, a further discussion is provided, particularly on selecting the appropriate tool based on research goals and resources. The findings of this study not only offer timely insight into research trends on the evaluation of the Entering Mentoring training curriculum in STEM fields but also guide professionals of mentoring training evaluation in identifying important outcome variables and selecting appropriate instrument tools.  more » « less
Award ID(s):
2130403
PAR ID:
10476912
Author(s) / Creator(s):
; ;
Publisher / Repository:
American Society for Engineering Education
Date Published:
Journal Name:
ASEE Annual Conference & Exposition
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The National Science Foundation (NSF) Emerging Frontiers and Innovation (EFRI) Research Experience and Mentoring (REM) program nationally supports hands-on research and ongoing mentorship in STEM fields at various universities and colleges. The NSF EFRI-REM Mentoring Catalyst initiative was designed to build and train these robust, interactive research mentoring communities that are composed of faculty, postdoctoral associates and graduate student mentors, to broaden participation of underrepresented groups in STEM research who are funded through NSF EFRI-REM. This work-in-progress paper describes the first five years of this initiative, where interactive training programs were implemented from multiple frameworks of effective mentoring. Principal investigators, postdoctoral associates and graduate students are often expected to develop and establish mentoring plans without any formal training in how to be effective mentors. Since the start of this initiative, over 300 faculty, postdoctoral associates and graduate students have been trained on promising practices, strategies, and tools to enhance their research mentoring experiences. In addition to formal mentor training, opportunities to foster a community of practice with current mentors and past mentor training participants (sage mentors) were provided. During these interactions, promising mentoring practices were shared to benefit the mentors and the different mentoring populations that the EFRI-REMs serve. The community of practice connected a diverse group of institutions and faculty to help the EFRI-REM community in its goal of broadening participation across a range of STEM disciplines. Those institutions are then able to discuss, distill and disseminate best practices around the mentoring of participants through targeted mentored training beyond the EFRI-REM at their home institutions. Not only does the EFRI-REM Catalyst initiative focus on broadening participation via strategic training of research mentors, it also empowers mentees, including undergraduate and graduate students and postdoctoral associates, in their research experiences through an entering research undergraduate course and formal mentoring training workshops. Future expansion to other academic units (e.g., colleges, universities) builds on the research collaborations and the initiatives developed and presented in this work-in-progress paper. A long-term goal is to provide insights via collaborative meetings (e.g., webinars, presentations) for STEM and related faculty who are assembling an infrastructure (e.g., proposals for the ERFI-REM program) across a range of research structures. In summary, this work-in-progress paper provides a description of the design and implementation of this initiative, preliminary findings, expanding interactions to other NSF supported Engineering Research Centers, and the future directions of the EFRI-REM Mentoring Catalyst initiative. 
    more » « less
  2. Traditional PhD training in STEM fields places a strong emphasis on developing doctoral students' academic skills, encompassing research, academic writing, as well as sharing of knowledge through publications and conference presentations, etc. However, with the ever evolving expectations of graduate training, particularly in applied fields, the demand for PhD has transcended the confines of academia. For instance, nearly 90% of engineering PhDs will not enter academia, which underscores the discrepancy between the current PhD training programs and the preparation of students for future careers. To better support doctoral students especially for those who intend to pursue positions in industry including corporate R&D labs, national labs, defense organizations, healthcare institutes, etc., Lehigh University launched an innovative program called Pasteur Partners PhD (P3) specifically for the training of such doctoral students. It is a student-centered doctoral training program based on use-inspired research in partnership with industry. A preliminary evaluation of the P3 program, which was developed with support from NSF’s IGE program, revealed that students benefited significantly from gaining practical skills through industry involvement such as co-advising, resulting in a clearer understanding of how the industry operates, which, in turn, enhanced their employability in the industry [1]. The University administration also provided significant support for the program. However, a broader implementation of P3 encountered challenges and hesitancy from faculty members. Mostly the senior faculty who already had preexisting connections with industry and junior faculty from certain departments were more receptive to joining the P3 program than others. Could this be a result of the prevailing emphasis of the graduate education system on research output (publications) rather than the training of students for their subsequent careers? What other reasons could there be for the faculty’s lack of enthusiasm for the training of their PhD students following P3 track? To answer above questions and examine the challenges and obstacles that the faculty members feel for student centered doctoral training from an institutional and system perspective, we are conducting a survey specifically targeting faculty members in STEM fields. It seeks to comprehensively understand faculty members’ perspective on the primary objectives of doctoral training within different STEM fields. By exploring these objectives, the survey aims to uncover how they vary across disciplines and what faculty members perceive as the most significant goals in their areas of expertise. Moreover, the survey is designed to shed light on the challenges and hurdles faced by faculty members in their pursuit of these training objectives. Faculty participants are encouraged to identify and articulate the specific obstacles they encounter, whether they pertain to institutional constraints, resource limitations, demands of perceived professional success or other factors that impede the realization of these goals. In addition, the survey takes a close look at the resources that faculty members believe would be beneficial in addressing these challenges and improving the effectiveness of doctoral training. This insight is essential for designing support systems that can empower faculty to contribute to the training of doctoral workforce for the benefit of society at large. The survey seeks to gain valuable perspectives on the qualities and skills considered essential for the success of PhD students. These insights will inform curriculum development and help prepare students better for a wider range of career paths. The results of the survey, currently underway, are presented. 
    more » « less
  3. This work in progress paper presents an overview of the Hispanic Alliance for the Graduate Education and the Professoriate (H-AGEP) program. H-AGEP is working on developing and implementing a new model to improve the preparation and transition of Hispanic STEM doctoral students into community college faculty positions. The partnership is a collaborative effort between the City College of New York (CCNY) (lead institution) and The University of Texas at El Paso (UTEP) along with a group of partner community colleges: LaGuardia Community College, Queensborough Community College, and El Paso Community College. The H-AGEP model consists of three main elements: (1) a training and mentoring program for effective STEM teaching at community colleges; (2) a training program for effective mentoring of community college students in STEM research; and (3) a professional development program to address career preparation, transitioning, and advancement at academic careers in community colleges. H-AGEP research goals are: (1) to consider the collected evaluation and research data to determine what intervention activities are most impactful, and (2) to better understand the career-decision making process of Hispanic STEM doctoral students regarding whether they will seek employment at community colleges and other two-year institutions. An interesting aspect of the partnership is that the institutions in El Paso, Texas, serve primarily a Mexican-American student population while the New York institutions serve primarily a Hispanic population of Caribbean origin. This provides the unique opportunity to compare Hispanic students from both groups. The program evaluation: (1) documents and provides feedback on H-AGEP activities and model implementation; and (2) assesses the extent to which H-AGEP is achieving its intended outcomes. Assessment results on the first cohort of students in the program show the value of including community college faculty as career and teaching mentors in the program. Furthermore, the effect of model interventions in students from the first cohort show positive advances in improving teaching skills, increasing student professional networks, and increasing interest and awareness in careers at community college. 
    more » « less
  4. Despite interest and potential in STEM (Science, Technology, Engineering and Mathematics), neurodivergent (ND) individuals face underrepresentation and marginalization. These individuals experience low rates of degree completion and even higher dropout rates from STEM programs. In the workplace, elevated levels of unemployment among individuals with disabilities underscore the need to address obstacles to persistence in STEM programs and pathways to the workforce. The AIE-STEMPLOS (Access to Innovative Education in Science, Technology, Engineering, and Mathematics-Providing Learning Opportunities and Scholarship) program at Landmark College, launched in 2021, aims to empower ND STEM scholars by leveraging effective mentoring strategies to support degree completion and career development in STEM fields. Supported by the National Science Foundation (NSF) through scholarship funding (S-STEM), the program's primary goals are to support domestic low-income, academically talented ND scholars in Computer Science and Life Science, create a robust culture of mentorship within the STEM department, and strengthen scholarly professional development. We generally refer to students as scholars in this program as that is the language preferred by the NSF. The mentoring component is designed to enhance psychosocial and professional development through faculty, group, and peer mentoring. Employing tools like the Birkman Method, mentor maps and Individual Development Plans (IDP), the program fosters self-understanding and community among scholars. Evaluation methods include qualitative and quantitative assessments, with data showing high satisfaction with mentor-mentee relationships, robust engagement in professional development activities, and significant improvements in scholars' professional outlook and STEM identity. This comprehensive approach integrates faculty mentors, career counselors, and weekly cohort meetings for mentoring and professional development activities. This paper will highlight the faculty and group/ peer mentoring components of the program, demonstrating how inclusive educational strategies can promote diversity within STEM fields. 
    more » « less
  5. The Alternative Pathways to Excellence (APEX) Program at the University of St. Thomas, funded by NSF as an S-STEM Track 2 project, aims to solidify transfer pathways, and assist Engineering students by providing financial, academic, and practical support. The successful integration of transfer students into engineering programs presents a unique set of challenges and opportunities for higher education institutions. The APEX program offers a spectrum of student support services, both structured and informal mentoring, curricular and co-curricular supports, and collaborative activities. The program is designed to forge accessible pathways into engineering careers for students with high academic potential, who are facing financial constraints by granting annual S-STEM scholarships to a select group of students. This paper describes a layered mentoring approach adopted by our team that encompasses both pre-application and post-application phases. We explore the pivotal roles played by peers, faculty members, and industry advisors in mentoring aspiring engineers through their educational journey. The paper describes the support structures and strategies implemented before students apply to engineering programs, shedding light on how early mentoring can influence students' preparedness and motivation to pursue engineering degrees. This paper also reports on the ongoing mentoring and support mechanisms vital for transfer students during their engineering studies. Peer mentoring, faculty mentoring, and industry advisor mentorship are all integral components of this stage. Furthermore, the paper discusses the training routines and strategies employed to prepare faculty, industry advisors, and peer mentors for their roles in supporting engineering students. This training ensures that mentors are equipped with the necessary skills and knowledge to guide students effectively, foster their academic growth, and nurture their professional aspirations. 
    more » « less