skip to main content


Title: Impacts Resulting from a Large-Scale First-Year Engineering and Computer Science Program on Students’ Successful Persistence Toward Degree Completion
There is a critical need for more students with engineering and computer science majors to enter into, persist in, and graduate from four-year postsecondary institutions. Increasing the diversity of the workforce by inclusive practices in engineering and science is also a profound identified need. According to national statistics, the largest groups of underrepresented minority students in engineering and science attend U.S. public higher education institutions. Most often, a large proportion of these students come to colleges and universities with unique challenges and needs, and are more likely to be first in their family to attend college. In response to these needs, engineering education researchers and practitioners have developed, implemented and assessed interventions to provide support and help students succeed in college, particularly in their first year. These interventions typically target relatively small cohorts of students and can be managed by a small number of faculty and staff. In this paper, we report on “work in progress” research in a large-scale, first-year engineering and computer science intervention program at a public, comprehensive university using multivariate comparative statistical approaches. Large-scale intervention programs are especially relevant to minority serving institutions that prepare growing numbers of students who are first in their family to attend college and who are also under-resourced, financially. These students most often encounter academic difficulties and come to higher education with challenging experiences and backgrounds. Our studied first-year intervention program, first piloted in 2015, is now in its 5th year of implementation. Its intervention components include: (a) first-year block schedules, (b) project-based introductory engineering and computer science courses, (c) an introduction to mechanics course, which provides students with the foundation needed to succeed in a traditional physics sequence, and (d) peer-led supplemental instruction workshops for calculus, physics and chemistry courses. This intervention study responds to three research questions: (1) What role does the first-year intervention’s components play in students’ persistence in engineering and computer science majors across undergraduate program years? (2) What role do particular pedagogical and cocurricular support structures play in students’ successes? And (3) What role do various student socio-demographic and experiential factors play in the effectiveness of first-year interventions? To address these research questions and therefore determine the formative impact of the firstyear engineering and computer science program on which we are conducting research, we have collected diverse student data including grade point averages, concept inventory scores, and data from a multi-dimensional questionnaire that measures students’ use of support practices across their four to five years in their degree program, and diverse background information necessary to determine the impact of such factors on students’ persistence to degree. Background data includes students’ experiences prior to enrolling in college, their socio-demographic characteristics, and their college social capital throughout their higher education experience. For this research, we compared students who were enrolled in the first-year intervention program to those who were not enrolled in the first-year intervention. We have engaged in cross-sectional 2 data collection from students’ freshman through senior years and employed multivariate statistical analytical techniques on the collected student data. Results of these analyses were interesting and diverse. Generally, in terms of backgrounds, our research indicates that students’ parental education is positively related to their success in engineering and computer science across program years. Likewise, longitudinally (across program years), students’ college social capital predicted their academic success and persistence to degree. With regard to the study’s comparative research of the first-year intervention, our results indicate that students who were enrolled in the first-year intervention program as freshmen continued to use more support practices to assist them in academic success across their degree matriculation compared to students who were not in the first-year program. This suggests that the students continued to recognize the value of such supports as a consequence of having supports required as first-year students. In terms of students’ understanding of scientific or engineering-focused concepts, we found significant impact resulting from student support practices that were academically focused. We also found that enrolling in the first-year intervention was a significant predictor of the time that students spent preparing for classes and ultimately their grade point average, especially in STEM subjects across students’ years in college. In summary, we found that the studied first-year intervention program has longitudinal, positive impacts on students’ success as they navigate through their undergraduate experiences toward engineering and computer science degrees.  more » « less
Award ID(s):
1727054
NSF-PAR ID:
10176870
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
ASEE Annual Conference Proceedings 2020
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Need/Motivation (e.g., goals, gaps in knowledge) The ESTEEM implemented a STEM building capacity project through students’ early access to a sustainable and innovative STEM Stepping Stones, called Micro-Internships (MI). The goal is to reap key benefits of a full-length internship and undergraduate research experiences in an abbreviated format, including access, success, degree completion, transfer, and recruiting and retaining more Latinx and underrepresented students into the STEM workforce. The MIs are designed with the goals to provide opportunities for students at a community college and HSI, with authentic STEM research and applied learning experiences (ALE), support for appropriate STEM pathway/career, preparation and confidence to succeed in STEM and engage in summer long REUs, and with improved outcomes. The MI projects are accessible early to more students and build momentum to better overcome critical obstacles to success. The MIs are shorter, flexibly scheduled throughout the year, easily accessible, and participation in multiple MI is encouraged. ESTEEM also establishes a sustainable and collaborative model, working with partners from BSCS Science Education, for MI’s mentor, training, compliance, and building capacity, with shared values and practices to maximize the improvement of student outcomes. New Knowledge (e.g., hypothesis, research questions) Research indicates that REU/internship experiences can be particularly powerful for students from Latinx and underrepresented groups in STEM. However, those experiences are difficult to access for many HSI-community college students (85% of our students hold off-campus jobs), and lack of confidence is a barrier for a majority of our students. The gap between those who can and those who cannot is the “internship access gap.” This project is at a central California Community College (CCC) and HSI, the only affordable post-secondary option in a region serving a historically underrepresented population in STEM, including 75% Hispanic, and 87% have not completed college. MI is designed to reduce inequalities inherent in the internship paradigm by providing access to professional and research skills for those underserved students. The MI has been designed to reduce barriers by offering: shorter duration (25 contact hours); flexible timing (one week to once a week over many weeks); open access/large group; and proximal location (on-campus). MI mentors participate in week-long summer workshops and ongoing monthly community of practice with the goal of co-constructing a shared vision, engaging in conversations about pedagogy and learning, and sustaining the MI program going forward. Approach (e.g., objectives/specific aims, research methodologies, and analysis) Research Question and Methodology: We want to know: How does participation in a micro-internship affect students’ interest and confidence to pursue STEM? We used a mixed-methods design triangulating quantitative Likert-style survey data with interpretive coding of open-responses to reveal themes in students’ motivations, attitudes toward STEM, and confidence. Participants: The study sampled students enrolled either part-time or full-time at the community college. Although each MI was classified within STEM, they were open to any interested student in any major. Demographically, participants self-identified as 70% Hispanic/Latinx, 13% Mixed-Race, and 42 female. Instrument: Student surveys were developed from two previously validated instruments that examine the impact of the MI intervention on student interest in STEM careers and pursuing internships/REUs. Also, the pre- and post (every e months to assess longitudinal outcomes) -surveys included relevant open response prompts. The surveys collected students’ demographics; interest, confidence, and motivation in pursuing a career in STEM; perceived obstacles; and past experiences with internships and MIs. 171 students responded to the pre-survey at the time of submission. Outcomes (e.g., preliminary findings, accomplishments to date) Because we just finished year 1, we lack at this time longitudinal data to reveal if student confidence is maintained over time and whether or not students are more likely to (i) enroll in more internships, (ii) transfer to a four-year university, or (iii) shorten the time it takes for degree attainment. For short term outcomes, students significantly Increased their confidence to continue pursuing opportunities to develop within the STEM pipeline, including full-length internships, completing STEM degrees, and applying for jobs in STEM. For example, using a 2-tailed t-test we compared means before and after the MI experience. 15 out of 16 questions that showed improvement in scores were related to student confidence to pursue STEM or perceived enjoyment of a STEM career. Finding from the free-response questions, showed that the majority of students reported enrolling in the MI to gain knowledge and experience. After the MI, 66% of students reported having gained valuable knowledge and experience, and 35% of students spoke about gaining confidence and/or momentum to pursue STEM as a career. Broader Impacts (e.g., the participation of underrepresented minorities in STEM; development of a diverse STEM workforce, enhanced infrastructure for research and education) The ESTEEM project has the potential for a transformational impact on STEM undergraduate education’s access and success for underrepresented and Latinx community college students, as well as for STEM capacity building at Hartnell College, a CCC and HSI, for students, faculty, professionals, and processes that foster research in STEM and education. Through sharing and transfer abilities of the ESTEEM model to similar institutions, the project has the potential to change the way students are served at an early and critical stage of their higher education experience at CCC, where one in every five community college student in the nation attends a CCC, over 67% of CCC students identify themselves with ethnic backgrounds that are not White, and 40 to 50% of University of California and California State University graduates in STEM started at a CCC, thus making it a key leverage point for recruiting and retaining a more diverse STEM workforce. 
    more » « less
  2. This Research-to-Practice full paper presents findings from the ASSETS program – a comprehensive support ecosystem developed to improve retention and reduce time to graduation for engineering transfer students. ASSETS builds on the momentum established by two statewide initiatives in Tennessee that place transfer students at the forefront: (1) Tennessee Promise – a nationally recognized scholarship program launched in 2015 that provides last-dollar scholarships for low-income students to attend any state community college, and (2) Tennessee Reconnect – a lastdollar grant established in 2018 that allows adults who do not have an associate degree to attend a community or technical college tuition-free. With over 100,000 students enrolled in these programs to date, the number of students transferring to four-year institutions is expected to increase exponentially in the coming years. Historically, transfer students have been at higher risk of attrition due to known academic and social barriers. This is especially true for the Engineering disciplines. In an effort to address these obstacles, we have developed the Academic Intervention, Social Supports, and Scholarships for Engineering Transfer Students (ASSETS) program. In its third year of operation, with 35 enrolled ASSETS scholars, the program is well underway. Among our findings, we have recognized the critical importance of nurturing a community of transfer students that emphasizes equity, diversity, and inclusion. Establishing such a community involves more than just adopting established best practices. It requires a shift in mindset on behalf of the student regarding what is required to succeed, as well as on the part of faculty on what is expected of incoming students. This paper presents the findings and outcomes of the ASSETS program towards providing support to and enhancing the success of engineering transfer students. 
    more » « less
  3. Wright College, an urban open-access community college, independently accredited within a larger community college system, is a federally recognized Hispanic-Serving Institution (HSI) with the largest community college enrollment of Hispanic students in its state. In 2018, Wright College received an inaugural National Science Foundation-Hispanic Serving Institution (NSF:HSI) research project grant “Building Capacity: Building Bridges into Engineering and Computer Science”. The project's overall goals are to increase underrepresented students pursuing an associate degree (AES) in engineering and computer science and streamline two transitions: high school to community college and 2-year to 4-year institutions. Through the grant, Wright College created a holistic and programmatic framework that examines and correlates engineering students' self-efficacy (the belief that students will succeed as engineers) and a sense of belonging with student success. The project focuses on Near-STEM ready students (students who need up to four semesters of math remediation before moving into Calculus 1). The project assesses qualitative and quantitative outcomes through surveys and case study interviews supplemented with retention, persistence, transfer, associate and bachelor's degree completion rates, and time for degree completion. The key research approach is to correlate student success data with self-efficacy and belonging measures. Outcomes and Impacts Three years into the project, Wright College Engineering and Computer Science Program was able to: • Develop and implement the Contextualized Summer Bridge with a total of 132 Near-STEM participants. One hundred twenty-seven (127) completed; 100% who completed the Bridge eliminated up to two years of math remediation, and 54% were directly placed in Calculus 1. All successful participants were placed in different engineering pathways, and 11 students completed Associate in Engineering Science (AES) and transferred after two years from the Bridge. • Increase enrollment by 940% (25 to 235 students) • Retain 93% of first-year students (Fall to fall retention). Seventy-five percent (75%) transferred after two years from initial enrollment. • Develop a holistic and programmatic approach for transfer model, thus increasing partnerships with 4-year transfer institutions resulting in the expansion of guaranteed/dual admissions programs with scholarships, paid research experience, dual advising, and students transferring as juniors. • Increase diversity at Wright College by bridging the academic gap for Near-STEM ready students. • Increase self-efficacy and belonging among all Program participants. • Increase institutionalized collaborations responsible for Wright College's new designation as the Center of Excellence for Engineering and Computer Science. • Increase enrollment, retention, and transfer of Hispanic students instrumental for Wright College Seal of Excelencia recognition. Lessons Learned The framework established during the first year of the grant overwhelmingly increased belonging and self-efficacy correlated with robust outcomes. However, the COVID-19 pandemic provided new challenges and opportunities in the second and third years of the grant. While adaptations were made to compensate for the negative impact of the pandemic, the face-to-face interactions were critical to support students’ entry into pathways and persistence within the Program. 
    more » « less
  4. Research and evidence-based practices that center sense of belonging and engineering identity development drive strong outcomes for undergraduate students in engineering—especially those who are first-generation college students, from low-income families, and identify as other underrepresented groups in engineering (Deil-Amen, 2011; Hurtado, Cabrera, Lin, & Arellano, 2009; Patrick & Prybutok, 2018). The process from ideation to organizational implementation is not well-documented in the literature on student success, leaving a gap in practitioners’ understanding of how to bring strong, research-informed practices to fruition in their institutions. Implementation is arguably as important as the design of a student intervention and knowing how to implement a good idea is an art and a science. This paper explores the various people and processes that take theory to practice for a National Science Foundation Improving Undergraduate STEM Education funded program. In this paper, I invoke an autoethnographic approach to reflect on the experience of designing a student-facing program while managing the organizational systems that empower or restrain transformative organizational change for students. Autoethnography as a methodology can be a helpful mode to understanding practice, as the researcher can move more fluidly between their lived experience and the organizational, sociological, or psychosocial theory that it mirrors (Berry & Hodges, 2015). The proposed paper discusses my team’s approaches to working with stakeholders and gatekeepers in our organization and in our community to execute a program designed to build sense of belonging and engineering identity while supporting academic attainment of underserved student populations using Community Cultural Wealth (Yosso, 2005) and Street-Level Bureaucracy (Lipsky, 1980) as theoretical lenses. A small, summer-intensive program required the cooperation and capital of gatekeepers across the campus of our large, research university in the southwestern United States. This program, which serves students from marginalized ethnic and socioeconomic backgrounds in engineering disciplines, became the basis for an NSF Improving Undergraduate STEM Education award. Students spent part of their summer (six weeks during the pilot program, which evolved to ten weeks for the second cohort) taking summer classes that helped them advance into their sophomore year of an engineering degree. They also took a career development class, which featured regular field trips to various regional engineering employers. Outcomes from the pilot program and subsequent year are promising, and include high rates of persistence, strong academic performance, and increased sense of engineering identity, but this paper focuses on the structure of the program, the need for collaborators, and the way that the team implemented an initiative which challenges the assumptions of stakeholders from within and outside of the institution. Major themes discussed are personal reflections of the process of coalition-building, gaining buy-in from critical partners on-campus and in the community, and co-investing in programmatic improvement with early cohorts of participating students. 
    more » « less
  5. In this Work-in-Progress paper, we report on the challenges and successes of a large-scale First- Year Engineering and Computer Science Program at an urban comprehensive university, using quantitative and qualitative assessment results. Large-scale intervention programs are especially relevant to comprehensive minority serving institutions (MSIs) that serve a high percentage of first-generation college students who often face academic and socioeconomic barriers. Our program was piloted in 2015 with 30 engineering students, currently enrolls 60 engineering and computer science students, and is expected to grow to over 200 students by Fall 2020. The firstyear program interventions include: (i) block schedules for each cohort in the first year; (ii) redesigned project-based introduction to engineering and introduction to computer science courses; (iii) an introduction to mechanics course, which provides students with the foundation needed to succeed in the traditional physics sequence; and (iv) peer-led supplemental instruction (SI) workshops for Calculus, Physics and Chemistry. A faculty mentorship program was implemented to provide additional support to students, but was phased out after the first year. Challenges encountered in the process of expanding the program include administrative, such as scheduling and training faculty and SI leaders; barriers to improvement of math and science instruction; and more holistic concerns such as creating a sense of community and identity for the program. Quantitative data on academic performance includes metrics such as STEM GPA and persistence, along with the Force Concept Inventory (FCI) for physics. Qualitative assessments of the program have used student and instructor surveys, focus groups, and individual interviews to measure relationships among factors associated with college student support and to extract student perspectives on what works best for them. Four years of data tell a mixed story, in which the qualitative effect of the interventions on student confidence and identity is strong, while academic performance is not yet significantly different than that of comparison groups. One of the most significant results of the program is the development of a FYrE Professional Learning Community which includes faculty (both tenure-track and adjunct), department chairs, staff, and administrators from across the campus. 
    more » « less