skip to main content


Title: Chatbots: A Tool to Supplement the Future Faculty Mentoring of Doctoral Engineering Students
Aim/Purpose: The purpose of this paper is to explore the efficacy of simulated interactive virtual conversations (chatbots) for mentoring underrepresented minority doctoral engineering students who are considering pursuing a career in the professoriate or in industry. Background: Chatbots were developed under the National Science Foundation INCLUDES Design and Developments Launch Pilot award (17-4458) and provide career advice with responses from a pre-programmed database populated by renowned emeriti engineering faculty. Chatbots have been engineered to fulfill a myriad of roles, such as undergraduate student advisement, but no research has been found that addresses their use with supplemental future faculty mentoring for doctoral students.Methodology: Chatbot efficacy is examined through a phenomenological design with focus groups with underrepresented minority doctoral engineering students. No theoretical or conceptual frameworks exist relative to chatbots designed for future faculty mentoring; therefore, an adaptation and implementation of the conceptual model posited on movie recommendations was utilized to ground this study. The four-stage process of phenomenological data analysis was followed: epoché, horizontalization, imaginative variation, and synthesis.Contribution: No studies have investigated the utility of chatbots in providing supplemental mentoring to future faculty. This phenomenological study contributes to this area of investigation and provides greater consideration into the unmet mentoring needs of these students, as well as the potential of utilizing chatbots for supplementary mentoring, particularly for those who lack access to high quality mentoring.Findings: Following the data analysis process, the essence of the findings was, while underrepresented minority doctoral engineering students have ample unmet mentoring needs and overall are satisfied with the user interface and trustworthiness of chatbots, their intent to use them is mixed due to a lack of personalization in this type of supplemental mentoring relationship.Recommendations for Practitioners: One of the major challenges faced by underrepresented doctoral engineering students is securing quality mentoring relationships that socialize them into the engineering culture and community of practice. While creating opportunities for students and incentivizing faculty to engage in the work of mentoring is needed, we must also consider the ways in which to leverage technology to offer supplemental future faculty mentoring virtually. Recommendation for Researchers: Additional research on the efficacy of chatbots in providing career-focused mentoring to future faculty is needed, as well as how to enhance the functionality of chatbots to create personal connections and networking opportunities, which are hallmarks of traditional mentoring relationships.Impact on Society: An understanding of the conceptual pathway that can lead to greater satisfaction with chatbots may serve to expand their use in the realm of mentoring. Scaling virtual faculty mentoring opportunities may be an important breakthrough in meeting mentoring needs across higher education.Future Research: Future chatbot research must focus on connecting chatbot users with human mentors; standardizing the process for response creation through additional data collection with a cadre of diverse, renowned faculty; engaging subject matter experts to conduct quality verification checks on responses; testing new responses with potential users; and launching the chatbots for a broad array of users.  more » « less
Award ID(s):
1744500
NSF-PAR ID:
10187478
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
International Journal of Doctoral Studies
Volume:
15
ISSN:
1556-8881
Page Range / eLocation ID:
373 to 392
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This research paper explores the potential use of chatbots (simulated interactive virtual conversations) in future faculty mentoring. In this case, a mentee asks career advice of a chatbot that draws responses from a pre-programmed database populated by renowned emeriti engineering faculty. Chatbots are being developed under the National Science Foundation INCLUDES Design and Developments Launch Pilot award (17-4458). Their efficacy for future faculty mentoring is explored through a phenomenological design grounded by the Efficacy of Chatbots for Future Faculty Mentoring conceptual framework utilizing focus groups with underrepresented minority (URM) doctoral engineering students. Chatbots were found to be effective as a supplementary mentoring option as URM doctoral students have ample unmet mentoring needs. Yet, intent to use this type of mentoring was mixed, despite high satisfaction ratings on positive user interface and perceived trustworthiness, because of the lack of personalization in this type of mentoring relationship. The preferred presentation method for this research paper is a traditional lecture, although a demonstration of the chatbot will be provided to afford session participants the opportunity to view and offer feedback on its perceived utility. 
    more » « less
  2. Improving undergraduate STEM teaching for diverse students is dependent to some extent on increasing the representation of Black, Indigenous and People of Color (BIPOC) and women in the ranks of faculty in engineering departments. However, new faculty members, whether they had postdoctoral training or not, report that they were not adequately prepared for academia. To address this need, a professional development program was developed for underrepresented doctoral and postdoctoral students, which focused on various strategies to be successful in teaching, research and service aspects of academic positions. The program included an intensive two-week summer session, with follow-up mentoring during the academic year, and was conducted from 2017 to 2020 with three cohorts of fellows recruited from across the country. To evaluate the impact of the program on the participants’ perceptions of their preparation for academic careers, a follow up survey was sent in May 2021 to the three former cohorts of participants (n=61), and responses were received from 37 of them. The survey asked participants to reflect on areas that they felt most prepared for in their academic positions, and areas that they felt least prepared for. The survey also asked participants to discuss additional supports they would have liked to have been provided with to better prepare them given their current positions (academic, industry, etc.). Results from the survey indicated that 92% of participants found the professional development program prepared them for the responsibilities and expectations to succeed in academic positions. Over 90% agreed that the program prepared them for the application process for a tenure track search, and 89% agreed the program prepared them for the primary components of the startup package. In addition, participants reported that the program increased their preparation in developing teaching philosophy (100%), developing learning outcomes (97%), and using active learning strategies during teaching (91%). The majority agreed that the program helped prepare them to teach students with various cultural backgrounds, and to develop and use assessment strategies. Participants were also asked to discuss the impact of the Covid 19 pandemic on their career trajectory, and most of them reported being somewhat impacted (65%) to extremely impacted (29%). Participants reported few or no job openings, cancelations of interviews, delays in research which impacted the rate of completing degrees, and publications, which affected the participants’ application competitiveness. Furthermore, working from home and balancing family and academic responsibilities affected their productivity. Based on the survey results, funds were secured to provide an additional day of professional training to cover any items not addressed during summer training, as well as any issues, challenges, or concerns they might have encountered while fulfilling their academic position. Thirty-three ACADEME fellows have indicated that they will participate in the new professional development, held in May 2022. Results from this analysis, and preliminary topics and outcomes of the supplemental activities are discussed. The findings contribute to the literature by increasing knowledge of specific challenges that new faculty encounter and can inform future efforts to support minorities and women in engineering doctoral programs. 
    more » « less
  3. Improving undergraduate STEM teaching for diverse students is dependent to some extent on increasing the representation of Black, Indigenous and People of Color (BIPOC) and women in the ranks of faculty in engineering departments. However, new faculty members, whether they had postdoctoral training or not, report that they were not adequately prepared for academia. To address this need, a professional development program was developed for underrepresented doctoral and postdoctoral students, which focused on various strategies to be successful in teaching, research and service aspects of academic positions. The program included an intensive two-week summer session, with follow-up mentoring during the academic year, and was conducted from 2017 to 2020 with three cohorts of fellows recruited from across the country. To evaluate the impact of the program on the participants’ perceptions of their preparation for academic careers, a follow up survey was sent in May 2021 to the three former cohorts of participants (n=61), and responses were received from 37 of them. The survey asked participants to reflect on areas that they felt most prepared for in their academic positions, and areas that they felt least prepared for. The survey also asked participants to discuss additional supports they would have liked to have been provided with to better prepare them given their current positions (academic, industry, etc.). Results from the survey indicated that 92% of participants found the professional development program prepared them for the responsibilities and expectations to succeed in academic positions. Over 90% agreed that the program prepared them for the application process for a tenure track search, and 89% agreed the program prepared them for the primary components of the startup package. In addition, participants reported that the program increased their preparation in developing teaching philosophy (100%), developing learning outcomes (97%), and using active learning strategies during teaching (91%). The majority agreed that the program helped prepare them to teach students with various cultural backgrounds, and to develop and use assessment strategies. Participants were also asked to discuss the impact of the Covid 19 pandemic on their career trajectory, and most of them reported being somewhat impacted (65%) to extremely impacted (29%). Participants reported few or no job openings, cancelations of interviews, delays in research which impacted the rate of completing degrees, and publications, which affected the participants’ application competitiveness. Furthermore, working from home and balancing family and academic responsibilities affected their productivity. Based on the survey results, funds were secured to provide an additional day of professional training to cover any items not addressed during summer training, as well as any issues, challenges, or concerns they might have encountered while fulfilling their academic position. Thirty-three ACADEME fellows have indicated that they will participate in the new professional development, held in May 2022. Results from this analysis, and preliminary topics and outcomes of the supplemental activities are discussed. The findings contribute to the literature by increasing knowledge of specific challenges that new faculty encounter and can inform future efforts to support minorities and women in engineering doctoral programs. 
    more » « less
  4. The importance of diversifying the national STEM workforce is well-established in the literature (Marrongelle, 2018). This need extends to graduate education in the STEM fields, leading N.C. A&T to invest considerably in graduate education and wraparound support initiatives that help graduate students build science identity and competencies for careers both within and beyond academia. The NSF-funded Bridges to the Doctorate project will integrate culturally reflective mentoring and professional development specifically designed for Black, Latinx, and Native American Ph.D. students. This holistic, graduate student development model includes academic and professional skill-building for STEM careers alongside targeted support for pursuing fellowship opportunities. This paper discusses the planned mentoring approach for the aforementioned program and previous approaches to mentoring graduate students used at N.C. A&T. The BD Fellows program will support formal and informal mentoring relationships, as mentoring contributes towards retention in STEM graduate programs (Ragins, 2007). BD Fellows will participate in monthly one-hour seminars on how to identify, establish, and maintain informal mentoring relationships (Schwartz et al., 2018; Parnes et al., 2020), while STEM faculty will attend seminars on leveraging their social networks as vital sources of mentorship for the BD Fellows. Using a multi-pronged collaborative approach, this model integrates the evidence-based domains of self-efficacy (Laurencelle & Scanlan, 2018; Lent et al., 1994; Lent et al., 2008), science/research identity (Lent et al., 2015; Zimmerman, 2000), and social cognitive career theory (Lent et al., 2005; Lent and Brown, 2006) to recruit, enroll, and graduate LSAMP Fellows with STEM doctoral degrees. Guided by the theories, the following questions will be addressed: (1) To what extent is culturally reflective mentoring identified as a critical driver of B2D Fellows’ success? (2) To what extent are the program’s training components fostering increases in B2D Fellow’s self-efficacy, competency, and science identity? (3) What is the strength of the correlation between participation in the program training components, mentoring activities, and persistence in graduate school? (4) To what extent does the perceived importance of self-efficacy, competency, and science identity differ by race/ethnicity and gender? These data will be analyzed using both formative and summative assessments of program outcomes. Quantitative data will include pre-, post-, and exit surveys. Qualitative data will assess the impact of mentoring and program support. This study will be guided by established protocols that have been approved by the N.C. A&T IRB. It is anticipated that our BD Fellows program will significantly impact the retention and graduation rates of underrepresented minority STEM graduate students in our doctoral programs, thus producing a diverse workforce of STEM professionals. Materials from the program recruiting cycle, mentoring workshops, and the structured fellowship application process will be disseminated freely to other LSAMP and minority-serving institutions across the country. Strategies and outcomes of this project will be published in peer-reviewed journals and shared in conference proceedings. 
    more » « less
  5. Broadening participation in engineering among underrepresented minority students remains a big challenge for institutions of higher education. Since a large majority of underrepresented students attend community colleges, engineering transfer programs at these community colleges can play an important role in addressing this challenge. However, for most community college engineering programs, developing strategies and programs to increase the number and diversity of students successfully pursuing careers in engineering is especially challenging due to limited expertise, shrinking resources, and continuing budget crises. This paper is a description of how a small engineering transfer program at a Hispanic-Serving community college in California developed effective partnerships with high schools, other institutions of higher education, and industry partners in order to create opportunities for underrepresented community college students to excel in engineering. Developed through these partnerships are programs for high school students, current community college students, and community college engineering faculty. Programs for high school students include a) the Summer Engineering Institute – a two-week residential summer camp for sophomore and junior high school students, and b) the STEM Institute – a three-week program for high school freshmen to explore STEM fields. Academic and support programs for college students include: a) Math Jam – a one-week intensive math placement test review and preparation program; b) a scholarship and mentoring program academically talented and financially needy STEM students; c) a two-week introduction to research program held during the winter break to prepare students for research internships; d) a ten-week summer research internship program; e) Physics Jam – an intensive program to prepare students for success in Physics; f) Embedded Peer Instruction Cohort – a modified Supplemental Instruction program for STEM courses; g) STEM Speaker Series – a weekly presentation by professionals talking about their career and educational paths. Programs for community college STEM faculty and transfer programs include: a) Summer Engineering Teaching Institute – a two-day teaching workshop for community college STEM faculty; b) Joint Engineering Program – a consortium of 28 community college engineering programs all over California to align curriculum, improve teaching effectiveness, improve the engineering transfer process, and strengthen community college engineering transfer programs; c) Creating Alternative Learning Strategies for Transfer Engineering Programs – a collaborative program that aims to increase access to engineering courses for community college students through online instruction and alternative classroom models; and d) California Lower-Division Engineering Articulation Workshop – to align the engineering curriculum. In addition to describing the development and implementation of these programs, the paper will also provide details on how they have contributed to increasing the interest, facilitating the entry, improving the retention and enhancing the success of underrepresented minority students in engineering, as well as contributing to the strengthening of the community college engineering education pipeline. 
    more » « less