skip to main content


Title: Academic Success and Retention of Underprepared Students
The Academy of Engineering Success (AcES) program, established in 2012 and supported by NSF S-STEM award number 1644119 throughout 2016-2021, employs literature-based, best practices to support and retain underprepared and underrepresented students in engineering through graduation with the ultimate goal of diversifying the engineering workforce. A total of 71 students, including 21 students supported by S-STEM scholarships, participated in the AcES program between 2016-2019 at a large R1 institution in the mid-Atlantic region. All AcES students participate in a common program during their first year, comprised of: a one-week summer bridge experience, a common fall professional development course and spring “Engineering in History” course, and a common academic advisor. These students also have opportunities for: (1) faculty-student, student-student, and industry mentor-student interaction, (2) academic support and student success education, and (3) major and career exploration – all designed to help students develop feelings of institutional inclusion, engineering self-efficacy and identity, and academic and professional success skills. They also participate in the GRIT, Longitudinal Assessment of Engineering Self-Efficacy (LAESE), and the Motivated Strategies for Learning Questionnaire (MSLQ) surveys plus individual and focus group interviews at the start, midpoint, and end of each fall semester and at the end of the spring semester. The surveys provide a measure of students’ GRIT, their beliefs related to the intrinsic value of engineering and learning, their feelings of inclusion and test anxiety, and their self-efficacy related to engineering, math, and coping skills. The interviews provide information related to the student experience, feelings of inclusion, and program impact. Institutional data, combined with the survey and interview responses, are used to examine four research questions designed to examine the relationship of the elements of the AcES program to participants’ academic success and retention in engineering. Early analyses of the student retention data and survey responses from the 2017 and 2018 cohorts indicated students who ultimately left engineering before the start of their second year initially scored higher in areas of engineering self-efficacy and test anxiety, than those who stayed in engineering, while those who retained to the second year began their engineering education with lower self-efficacy scores, but higher scores related to the belief in the intrinsic value of engineering, learning strategy use, and coping self-efficacy. These results suggest that students who start with unrealistically high expectations of their performance leave engineering at higher rates than students who start with lower personal performance expectations, but have stronger value of the field and strategies for meeting challenges. These data appear to support the Kruger-Dunning effect in which students with limited knowledge of a specific field overestimate their abilities to perform in that area or underestimate the level of effort success may require. This paper will add an analysis of the academic success and retention data from 2019 cohort to this research, discuss the impact of COVID-19 to this program and research, as well as illuminate the quantitative results with the qualitative data from individual and focus group interviews regarding the aspects of the AcES program that impact student success, their expectations and methods for overcoming academic challenges, and their feelings of motivation and inclusion.  more » « less
Award ID(s):
1644119
NSF-PAR ID:
10296670
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
2021 ASEE Virtual Annual Conference Content Access, Virtual Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. POSTER. Presented at the Symposium (9/12/2019) Abstract: The Academy of Engineering Success (AcES) employs literature-based, best practices to support and retain underrepresented students in engineering through graduation with the ultimate goal of diversifying the engineering workforce. AcES was established in 2012 and has been supported via NSF S-STEM award number 1644119 since 2016. The 2016, 2017, and 2018 cohorts consist of 12, 20, and 22 students, respectively. Five S-STEM supported scholarships were awarded to the 2016 cohort, seven scholarships were awarded to students from the 2017 cohort, and six scholarships were awarded to students from the 2018 cohort. AcES students participate in a one-week summer bridge experience, a common fall semester course focused on professional development, and a common spring semester course emphasizing the role of engineers in societal development. Starting with the summer bridge experience, and continuing until graduation, students are immersed in curricular and co-curricular activities with the goals of fostering feelings of institutional inclusion and belonging in engineering, providing academic support and student success skills, and professional development. The aforementioned goals are achieved by providing (1) opportunities for faculty-student, student-student, and industry mentor-student interaction, (2) academic support, and student success education in areas such as time management and study skills, and (3) facilitated career and major exploration. Four research questions are being examined, (1) What is the relationship between participation in the AcES program and participants’ academic success?, (2) What aspects of the AcES program most significantly impact participants’ success in engineering, (3) How do AcES students seek to overcome challenges in studying engineering, and (4) What is the longitudinal impact of the AcES program in terms of motivation, perceptions, feelings of inclusion, outcome expectations of the participants and retention? Students enrolled in the AcES program participate in the GRIT, LAESE, and MSLQ surveys, focus groups, and one-on-one interviews at the start and end of each fall semester and at the end of the spring semester. The surveys provide a measure of students’ GRIT, general self-efficacy, engineering self-efficacy, test anxiety, math outcome efficacy, intrinsic value of learning, inclusion, career expectations, and coping efficacy. Focus group and interview responses are analyzed in order to answer research questions 2, 3, and 4. Survey responses are analyzed to answer research question 4, and institutional data such as GPA is used to answer research question 1. An analysis of the 2017 AcES cohort survey responses produced a surprising result. When the responses of AcES students who retained were compared to the responses of AcES students who left engineering, those who left engineering had higher baseline values of GRIT, career expectations, engineering self-efficacy, and math outcome efficacy than those students who retained. A preliminary analysis of the 2016, 2017, and 2018 focus group and one-on-one interview responses indicates that the Engineering Learning Center, tutors, organized out of class experiences, first-year seminar, the AcES cohort, the AcES summer bridge, the AcES program, AcES Faculty/Staff, AcES guest lecturers, and FEP faculty/Staff are viewed as valuable by students and cited with contributing to their success in engineering. It is also evident that AcES students seek help from peers, seek help from tutors, use online resources, and attend office hours to overcome their challenges in studying engineering. 
    more » « less
  2. The Academy of Engineering Success (AcES) program employs known best practices to support engineering students with the goal of retaining them through graduation and diversifying the engineering workforce. The AcES program started in 2012 and has been supported by NSF SSTEM award number DUE-1644119 since 2016. Cohorts from 2016, 2017, 2018, and 2019 consist of 12, 20, 22, and 17 students, respectively. Twenty-one renewable S-STEM supported scholarships have been awarded to students since 2016. AcES students participate in a one-week pre-fall bridge experience, a common fall professional development course, and a course emphasizing the role of engineers in societal development in the spring semester. Starting in the bridge experience and continuing until graduation, students participate in curricular and co-curricular activities with the goals of: (1) fostering feelings of belonging in engineering and institutional inclusion, (2) encouraging professional development, and (3) supporting academic achievement and student success. These goals are achieved by providing: (1) opportunities for interaction between students and peers, faculty, and industry mentors; (2) major and career exploration opportunities; and (3) academic support and student success education in areas such as time management and study skills. AcES students participate in the GRIT, LAESE, and MSLQ surveys, as well as in focus groups and one-on-one interviews at the start and end of each fall semester and at the end of the spring semester. The surveys provide a quantitative measure of students’ GRIT, general self-efficacy, engineering self-efficacy, test anxiety, math outcome efficacy, intrinsic value of learning, inclusion, career expectations, and coping efficacy. Qualitative data from the focus group and individual interview responses are used to provide insight into the quantitative survey results. Surprisingly, a previous analysis of the 2017 cohort survey responses revealed that students who left engineering had higher baseline values of GRIT, career expectations, engineering self-efficacy, and math outcome efficacy than those students who retained. Hence, the 2018 cohort survey responses were analyzed in relation to retention and are presented along with qualitative results to provide a holistic understanding of student retention. Results from both the 2017 and 2018 cohorts are presented and discussed in the paper and poster. 
    more » « less
  3. The Academy of Engineering Success (AcES), supported by an NSF S-STEM grant since 2016, employs literature-based, best practices to support and retain students in engineering. AcES students participate in a one-week summer bridge experience; a common fall semester course focused on professional development, time management and study skills, and career exploration; and a common spring semester course emphasizing the role of engineers in societal development. Students are also immersed in co-curricular activities with the goals of fostering feelings of institutional inclusion and belonging in engineering, providing academic support and student success skills, and professional development. AcES students participate in the GRIT, LAESE, and MSLQ surveys at the start and end of each fall semester and at the end of the spring semester each year. Focus group data is collected at the beginning, middle and end of each semester and one-on-one interviews occur at the start and end of each semester. The surveys provide a measure of students’ GRIT, general self-efficacy, engineering self-efficacy, test anxiety, math outcome efficacy, intrinsic value of learning, inclusion, career expectations, and coping efficacy. A previous study, based on an analysis of the 2017 AcES cohort survey responses, produced a surprising result. When the responses of AcES students who retained were compared to the responses of AcES students who left engineering, those who left engineering had higher baseline values of GRIT, career expectations, engineering self-efficacy, and math outcome efficacy than those students who retained. These results appear to support the Kruger-Dunning effect. This paper presents the subsequent analysis of two years of participant data, the 2017 and 2018 cohorts, to further explore the possibility or the strength of this effect for these students and investigates possible reasons for the results. 
    more » « less
  4. While much has changed in the seven years since the 2016 start of our NSF S-STEM Program, the WVU Academy of Engineering Success (AcES), the goal to increase the number of graduating engineers and contribute to the diversification of the engineering workforce has remained constant [1], [2]. AcES has endeavored to attract, support, and retain through graduation talented, but underprepared (non-calculus-ready) first-time, full-time engineering and computing undergraduate students from underrepresented populations by implementing established, research-based student success and retention strategies. During the seven (7) years of NSF funding, this program has served 71 students and supported 28 students with renewable S-STEM scholarships. Past research used surveys and individual and focus group interviews to measure AcES scholars' feelings of institutional inclusion, engineering self-efficacy and identity, and assessment of their own development of academic and professional success skills [1], [2]. Results supported the Kruger-Dunning Effect, "a cognitive bias in which unskilled people do not recognize their incompetence in specific areas and often overestimate their abilities" [3], [4], [5]. Specifically, students who did not retain to the second year tended to enter college with unrealistic expectations regarding: (1) the time and effort required to succeed in a challenging major and (2) their ability to succeed with little effort. Students tended to underestimate the challenges and overestimate their ability to meet the challenges. [2], [3], [5]. Instead of focusing on those who left the program, this work focuses on AcES scholars who have completed or nearly completed an engineering or computing degree even through the additional complications and challenges presented by the COVID-19 pandemic. From these successful graduates, we hope to learn what elements of the AcES program were the most impactful to and supportive of their journey. The lessons learned are shared to inform other, future engineering education programs. 
    more » « less
  5. This paper describes the evolution of the NSF S-STEM "The Academy of Engineering Success (AcES)" program, which started in 2012 at West Virginia University (WVU), a large, mid-Atlantic, R1 institution, and received NSF S-STEM funding beginning in 2016 and corporate sponsorship beginning in 2021. The program was designed around research-based strategies to support and retain talented, but underprepared (non-calculus-ready) and underrepresented first-time, full-time engineering undergraduate students with the intention of contributing to the diversification of the engineering workforce by increasing the number of graduating engineers [1], [2]. This program has served over 100 students and provided financial support to 28 students through renewable NSF S-STEM scholarships. Based on the results of surveys, individual and focus group interviews, and student feedback, past research has focused on AcES participants' feelings of institutional inclusion, engineering self-efficacy and identity, and their assessment of their own development of academic and professional success skills [1], [2]. Past studies have reported support for the Kruger-Dunning Effect, "a cognitive bias in which unskilled people do not recognize their incompetence in specific areas and often overestimate their abilities" [3], [4], [5]. Specifically, the students who ultimately left engineering before their second year tended to enter college with unrealistic expectations of the difficulty of the major, an underestimate of the time and effort demands needed to be successful, and an overestimate of their ability to succeed with little effort [2], [3], [5]. This paper focuses on the evolution of the program throughout several time periods, the lessons learned, and the insight gained regarding the most positively impactful and supportive programmatic elements. These insights come from feedback from students who have completed or nearly completed their engineering degree and have persisted through the challenges of an engineering education, even with the additional complications and challenges of COVID. Additional observations are made by the program leaders. These insights are shared with the engineering educational community to inform other, future programs. 
    more » « less