skip to main content


Title: Insights Gathered from the National Survey of Student Education (NSSE) About Engineering/Computer Science Participation in High-impact Educational Practices at Two Western Land-grant Institutions
Student engagement, especially among Engineering and Computer science majors (E/CS), has been a priority for researchers. Although considerable efforts have been made to improve college students' engagement and interest, underrepresented minority groups and first-generation students are still at risk of dropping out of engineering majors due to lack of inclusiveness, motivation, and other related factors. According to Kuh (2008), student participation in High-Impact Educational Practices (HIEP) is correlated with student outcomes such as persistence, performance, achievement, and intent to complete their current major. The present study reviews the existing National Survey of Student Engagement (NSSE, 2012, 2017) data from two western land-grant universities to fully capture participation through the survey of first-year students and seniors (N = 674). The HIEP considered include service-learning, learning communities, research with faculty, internship or field experience, study abroad, and culminating senior experience. These practices are designed to encourage meaningful interactions between faculty and students, foster collaboration with students within different demographics groups, and facilitate learning outside the classroom. Insights were gleaned from how the students interacted with HIEP based on special characteristics such as sex, race, age, enrollment status, and residence. The purpose of the present study is to examine the extent to which E/CS students participate in HIEP and its effects on student outcomes. This study also offers comparisons or possible relationships between student demographics, student success, and HIEP involvement. For example, the participation rates of HIEP on different engineering and computer science majors, including civil, chemical, electrical, mechanical, and materials engineering, etc., are analyzed to examine the practices that work for a particular E/CS major. The present study reports findings from NSSE 2012 and 2017 surveys. Results show that among the E/CS seniors, service-learning, learning community, and study abroad program are the HIEP with the lowest participation rate with 41% (service-learning), 59% (learning community), and 68% (study abroad program), indicating that they do not plan to engage in these practices in their senior year. Conversely, internships and culminating senior experiences had the most participation among E/CS seniors with 52% (internships) and 68% (culminating senior experiences. Interestingly, first-year students showed a significant interest to participate in the following HIEP: internships, study abroad programs, and culminating senior experiences – with 76% (internships), 47% (study abroad program), and 68% (culminating senior experiences) indicating plans to engage in these practices. Finally, findings show that participation or engagement in HIEP is a significant predictor of student learning outcomes. Findings of this review may serve as a guide for future research in E/CS student participation in HIEP. The paper concludes with theoretical and practical implications of the findings on student engagement and learning. Key words: NSSE, high impact educational practices, Engagement  more » « less
Award ID(s):
1927218
NSF-PAR ID:
10343579
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2021 ASEE Annual Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The science, technology, engineering and mathematics (STEM) workforce contributes to the U.S. economy by supporting 67% of jobs and 69% of the gross domestic product [1]. Currently, there is an increased demand for engineering and computer science (E/CS) professionals, particularly those from underrepresented (e.g., gender, racial, ethnic) and underserved (socio-economic, geographically isolated) groups who bring diversity of thought and experience to the national E/CS workforce [2]. Correspondingly, educational institutions are called upon to develop capabilities to attract, engage, and retain students from these diverse backgrounds in E/CS programs of study. To encourage and enable diverse students to opt into and persist within E/CS programs of study, there is a critical need to engage students in supportive and enriching opportunities from which to learn and grow. The importance of student engagement for promoting student growth and development has been researched to such an extent that its utility is widely agreed upon [5]. Importantly, it has been shown that both academic and extracurricular aspects of a student’s learning processes are characterized by engagement [6]. High Impact Educational Practices (HIP) provide useful opportunities for deep student engagement and, thus, positively influence student retention and persistence [4]. Kuh [3] identified eleven curricular and extracurricular HIP (i.e., collaborative assignments and projects, common intellectual experiences, eportfolios, first year seminars and experiences, global learning and study abroad, internships, learning communities, senior culminating experiences, service and community-based learning, undergraduate research, and writing intensive courses). In computer science and engineering education fields, however, the extent to which HIP affects persistence and retention has not been fully investigated. This project aims to examine E/CS undergraduate student engagement in HIP and to understand the factors that contribute to positive engagement experiences. 
    more » « less
  2. Currently, substantial efforts are underway to improve the engagement and retention of engineering and computer science (E/CS) students in their academic programs. Student participation in specific activities known as High Impact Educational Practices (HIP) has been shown to improve student outcomes across a variety of degree fields. Thus, we suggest that understanding how and why E/CS students, especially those from historically underrepresented groups, participate in HIP is vital for supporting efforts aimed at improving E/CS student engagement and retention. The aim of the current study is to examine the participation of E/CS undergraduates enrolled at two western land-grant institutions (both institutions are predominantly white; one is an emerging Hispanic-serving institution) across five HIEP (i.e., global learning and study aboard internships, learning communities, service and community-based learning, and undergraduate research) that are offered outside of required E/CS curricula and are widely documented in the research literature. As part of a larger study, researchers developed an online questionnaire to explore student HIP participation and then surveyed E/CS students (n = 576) across both land-grant institutions. Subsequently, researchers will use survey results to inform the development of focus groups interview protocols. Focus group interviews will be conducted with purposefully selected E/CS students who participated in the survey. Combined survey and focus group data will then be analyzed to more deeply understand why and how E/CS students participate in the HIP at their university. This research paper reports on the frequency distribution analysis of the survey data generated with E/CS undergraduates enrolled at one of the two land grant institutions. The combined sample included E/CS undergraduates from the following demographic groups: female (34 %), Asian (10 %), Black or African American (2%), Hispanic or Latinx (6%), Native American or Alaskan Native (1%), Native Hawaiian or Other Pacific Islander (1%), White (81 %), and multiracial (4 %). Results show that most (38%) E/CS students reported participating in internships, while study abroad programs garnered the smallest level of E/CS student participation (5%) across all five HIP. Internships were found most likely to engage diverse students: Female (42%), Hispanic or Latinx (24%), Multiracial (44%), Asian (31%), First-generation (29%), and nontraditional students—other than those categorized as highly nontraditional—all reported participating in internships more than any other HIP. Notable differences in participation across E/CS and demographic groups were found for other HIPs. Results further revealed that 43% of respondents did not participate in any extracurricular HIP and only 19% participated in two or more HIP. Insights derived from the survey and used to inform ongoing quantitative and qualitative analyses are discussed. Keywords: community-based learning, high impact educational practices, HIP, internships learning communities, service learning, study aboard, undergraduate research 
    more » « less
  3. Effects of High Impact Educational Practices on Engineering and Computer Science Student Participation, Persistence, and Success at Land Grant Universities: Award# RIEF-1927218 – Year 2 Abstract Funded by the National Science Foundation (NSF), this project aims to investigate and identify associations (if any) that exist between student participation in High Impact Educational Practices (HIP) and their educational outcomes in undergraduate engineering and computer science (E/CS) programs. To understand the effects of HIP participation among E/CS students from groups historically underrepresented and underserved in E/CS, this study takes place within the rural, public university context at two western land grant institutions (one of which is an Hispanic-serving institution). Conceptualizing diversity broadly, this study considers gender, race and ethnicity, and first-generation, transfer, and nontraditional student status to be facets of identity that contribute to the diversity of academic programs and the technical workforce. This sequential, explanatory, mixed-methods study is guided by the following research questions: 1. To what extent do E/CS students participate in HIP? 2. What relationships (if any) exist between E/CS student participation in HIP and their educational outcomes (i.e., persistence in major, academic performance, and graduation)? 3. How do contextual factors (e.g., institutional, programmatic, personal, social, financial, etc.) affect E/CS student awareness of, interest in, and participation in HIP? During Project Year 1, a survey driven quantitative study was conducted. A survey informed by results of the National Survey of Student Engagement (NSSE) from each institution was developed and deployed. Survey respondents (N = 531) were students enrolled in undergraduate E/CS programs at either institution. Frequency distribution analyses were conducted to assess the respondents’ level of participation in extracurricular HIPs (i.e., global learning and study aboard, internships, learning communities, service and community-based learning, and undergraduate research) that have been shown in the literature to positively impact undergraduate student success. Further statistical analysis was conducted to understand the effects of HIP participation, coursework enjoyability, and confidence at completing a degree on the academic success of underrepresented and nontraditional E/CS students. Exploratory factor analysis was used to derive an "academic success" variable from five items that sought to measure how students persevere to attain academic goals. Results showed that a linear relationship in the target population exists and that the resultant multiple regression model is a good fit for the data. During the Project Year 2, survey results were used to develop focus group interview protocols and guide the purposive selection of focus group participants. Focus group interviews were conducted with a total of 27 undergraduates (12 males, 15 females, 16 engineering students, 11 computer science students) across both institutions via video conferencing (i.e., ZOOM) during the spring and fall 2021 semesters. Currently, verified focus group transcripts are being systematically analyzed and coded by a team of four trained coders to identify themes and answer the research questions. This paper will provide an overview of the preliminary themes so far identified. Future project activities during Project Year 3 will focus on refining themes identified during the focus group transcript analysis. Survey and focus group data will then be combined to develop deeper understandings of why and how E/CS students participate in the HIP at their university, taking into account the institutional and programmatic contexts at each institution. Ultimately, the project will develop and disseminate recommendations for improving diverse E/CS student awareness of, interest in, and participation in HIP, at similar land grant institutions nationally. 
    more » « less
  4. This paper presents the progress made in the first year of a five-year NSF ER2 (Ethical and Responsible Research)-funded project on ethical and responsible research and practices in science and engineering undertaken at a large public university in the southwestern United States. The objective of this research is to improve instructor training, interventions, and student outcomes in high schools and universities to improve awareness and commitment to ethical practices in STEM coursework. The paper will describe the progress made in several components of the grant: i) Preliminary analysis of measures of ethical knowledge, reasoning skills, attitudes, and practices of several hundred undergraduate freshmen and seniors, correlated with demographic data, based on data captured in the first year of the grant; ii) Progress made in the development of the concept of “ethical self-efficacy” and an instrument to measure it for freshmen and senior engineering students, and in assessing how it relates to ethical competency and student background; iii) Implications of these analyses in the construction of a three-week professional development program that guides high school STEM teachers through the development of learning modules on ethical issues related to their courses; iv) The assessment of the undergraduate engineering curriculum in two majors to determine appropriate courses for ethics interventions to help students understand how technical activities fit within broader social, economic, and environmental contexts; the construction of these interventions; and the development of measures to track their success; and, v) Initial steps toward measuring impact of other experiences (e.g., undergraduate research, internships, service learning) and courses (e.g., humanities, social science, and business courses) on development of ethical practices, on assessments taken in senior engineering capstone courses. 
    more » « less
  5. Need/Motivation (e.g., goals, gaps in knowledge) The ESTEEM implemented a STEM building capacity project through students’ early access to a sustainable and innovative STEM Stepping Stones, called Micro-Internships (MI). The goal is to reap key benefits of a full-length internship and undergraduate research experiences in an abbreviated format, including access, success, degree completion, transfer, and recruiting and retaining more Latinx and underrepresented students into the STEM workforce. The MIs are designed with the goals to provide opportunities for students at a community college and HSI, with authentic STEM research and applied learning experiences (ALE), support for appropriate STEM pathway/career, preparation and confidence to succeed in STEM and engage in summer long REUs, and with improved outcomes. The MI projects are accessible early to more students and build momentum to better overcome critical obstacles to success. The MIs are shorter, flexibly scheduled throughout the year, easily accessible, and participation in multiple MI is encouraged. ESTEEM also establishes a sustainable and collaborative model, working with partners from BSCS Science Education, for MI’s mentor, training, compliance, and building capacity, with shared values and practices to maximize the improvement of student outcomes. New Knowledge (e.g., hypothesis, research questions) Research indicates that REU/internship experiences can be particularly powerful for students from Latinx and underrepresented groups in STEM. However, those experiences are difficult to access for many HSI-community college students (85% of our students hold off-campus jobs), and lack of confidence is a barrier for a majority of our students. The gap between those who can and those who cannot is the “internship access gap.” This project is at a central California Community College (CCC) and HSI, the only affordable post-secondary option in a region serving a historically underrepresented population in STEM, including 75% Hispanic, and 87% have not completed college. MI is designed to reduce inequalities inherent in the internship paradigm by providing access to professional and research skills for those underserved students. The MI has been designed to reduce barriers by offering: shorter duration (25 contact hours); flexible timing (one week to once a week over many weeks); open access/large group; and proximal location (on-campus). MI mentors participate in week-long summer workshops and ongoing monthly community of practice with the goal of co-constructing a shared vision, engaging in conversations about pedagogy and learning, and sustaining the MI program going forward. Approach (e.g., objectives/specific aims, research methodologies, and analysis) Research Question and Methodology: We want to know: How does participation in a micro-internship affect students’ interest and confidence to pursue STEM? We used a mixed-methods design triangulating quantitative Likert-style survey data with interpretive coding of open-responses to reveal themes in students’ motivations, attitudes toward STEM, and confidence. Participants: The study sampled students enrolled either part-time or full-time at the community college. Although each MI was classified within STEM, they were open to any interested student in any major. Demographically, participants self-identified as 70% Hispanic/Latinx, 13% Mixed-Race, and 42 female. Instrument: Student surveys were developed from two previously validated instruments that examine the impact of the MI intervention on student interest in STEM careers and pursuing internships/REUs. Also, the pre- and post (every e months to assess longitudinal outcomes) -surveys included relevant open response prompts. The surveys collected students’ demographics; interest, confidence, and motivation in pursuing a career in STEM; perceived obstacles; and past experiences with internships and MIs. 171 students responded to the pre-survey at the time of submission. Outcomes (e.g., preliminary findings, accomplishments to date) Because we just finished year 1, we lack at this time longitudinal data to reveal if student confidence is maintained over time and whether or not students are more likely to (i) enroll in more internships, (ii) transfer to a four-year university, or (iii) shorten the time it takes for degree attainment. For short term outcomes, students significantly Increased their confidence to continue pursuing opportunities to develop within the STEM pipeline, including full-length internships, completing STEM degrees, and applying for jobs in STEM. For example, using a 2-tailed t-test we compared means before and after the MI experience. 15 out of 16 questions that showed improvement in scores were related to student confidence to pursue STEM or perceived enjoyment of a STEM career. Finding from the free-response questions, showed that the majority of students reported enrolling in the MI to gain knowledge and experience. After the MI, 66% of students reported having gained valuable knowledge and experience, and 35% of students spoke about gaining confidence and/or momentum to pursue STEM as a career. Broader Impacts (e.g., the participation of underrepresented minorities in STEM; development of a diverse STEM workforce, enhanced infrastructure for research and education) The ESTEEM project has the potential for a transformational impact on STEM undergraduate education’s access and success for underrepresented and Latinx community college students, as well as for STEM capacity building at Hartnell College, a CCC and HSI, for students, faculty, professionals, and processes that foster research in STEM and education. Through sharing and transfer abilities of the ESTEEM model to similar institutions, the project has the potential to change the way students are served at an early and critical stage of their higher education experience at CCC, where one in every five community college student in the nation attends a CCC, over 67% of CCC students identify themselves with ethnic backgrounds that are not White, and 40 to 50% of University of California and California State University graduates in STEM started at a CCC, thus making it a key leverage point for recruiting and retaining a more diverse STEM workforce. 
    more » « less