More Like this

1. Impacts Resulting from a Large-Scale First-Year Engineering and Computer Science Program on Students’ Successful Persistence Toward Degree Completion

   Ragusa, Gisele; Allen, Emily L.; Menezes, Gustavo B. (June 2020, ASEE Annual Conference Proceedings 2020)

   There is a critical need for more students with engineering and computer science majors to enter into, persist in, and graduate from four-year postsecondary institutions. Increasing the diversity of the workforce by inclusive practices in engineering and science is also a profound identified need. According to national statistics, the largest groups of underrepresented minority students in engineering and science attend U.S. public higher education institutions. Most often, a large proportion of these students come to colleges and universities with unique challenges and needs, and are more likely to be first in their family to attend college. In response to these needs, engineering education researchers and practitioners have developed, implemented and assessed interventions to provide support and help students succeed in college, particularly in their first year. These interventions typically target relatively small cohorts of students and can be managed by a small number of faculty and staff. In this paper, we report on “work in progress” research in a large-scale, first-year engineering and computer science intervention program at a public, comprehensive university using multivariate comparative statistical approaches. Large-scale intervention programs are especially relevant to minority serving institutions that prepare growing numbers of students who are first in their family to attend college and who are also under-resourced, financially. These students most often encounter academic difficulties and come to higher education with challenging experiences and backgrounds. Our studied first-year intervention program, first piloted in 2015, is now in its 5th year of implementation. Its intervention components include: (a) first-year block schedules, (b) project-based introductory engineering and computer science courses, (c) an introduction to mechanics course, which provides students with the foundation needed to succeed in a traditional physics sequence, and (d) peer-led supplemental instruction workshops for calculus, physics and chemistry courses. This intervention study responds to three research questions: (1) What role does the first-year intervention’s components play in students’ persistence in engineering and computer science majors across undergraduate program years? (2) What role do particular pedagogical and cocurricular support structures play in students’ successes? And (3) What role do various student socio-demographic and experiential factors play in the effectiveness of first-year interventions? To address these research questions and therefore determine the formative impact of the firstyear engineering and computer science program on which we are conducting research, we have collected diverse student data including grade point averages, concept inventory scores, and data from a multi-dimensional questionnaire that measures students’ use of support practices across their four to five years in their degree program, and diverse background information necessary to determine the impact of such factors on students’ persistence to degree. Background data includes students’ experiences prior to enrolling in college, their socio-demographic characteristics, and their college social capital throughout their higher education experience. For this research, we compared students who were enrolled in the first-year intervention program to those who were not enrolled in the first-year intervention. We have engaged in cross-sectional 2 data collection from students’ freshman through senior years and employed multivariate statistical analytical techniques on the collected student data. Results of these analyses were interesting and diverse. Generally, in terms of backgrounds, our research indicates that students’ parental education is positively related to their success in engineering and computer science across program years. Likewise, longitudinally (across program years), students’ college social capital predicted their academic success and persistence to degree. With regard to the study’s comparative research of the first-year intervention, our results indicate that students who were enrolled in the first-year intervention program as freshmen continued to use more support practices to assist them in academic success across their degree matriculation compared to students who were not in the first-year program. This suggests that the students continued to recognize the value of such supports as a consequence of having supports required as first-year students. In terms of students’ understanding of scientific or engineering-focused concepts, we found significant impact resulting from student support practices that were academically focused. We also found that enrolling in the first-year intervention was a significant predictor of the time that students spent preparing for classes and ultimately their grade point average, especially in STEM subjects across students’ years in college. In summary, we found that the studied first-year intervention program has longitudinal, positive impacts on students’ success as they navigate through their undergraduate experiences toward engineering and computer science degrees. 

   more » « less
2. Flipped Classroom and its Impact on Student Engagement

   https://doi.org/10.18260/1-2--32850  

   Aji, Chadia; Khan, M. Javed (July 2019, ASEE annual conference)

   This paper will provide the first-year results of the impact of implementing the flipped approach in lower level math and aerospace engineering courses. A quasi-experimental between-groups research design was used for assessing the effectiveness of this methodology. The control group consisted of students who were in the same course but in sections with traditional teaching delivery while the intervention group consisted of students who were registered in the sections with the flipped approach. All students were from underrepresented groups. A positive impact on the students’ attitudes and learning strategies was observed as a result of the flipped classroom with active learning. Data pertaining to the effectiveness of the flipped classroom pedagogy is shared in this paper. Analysis of students’ cognitive engagement and their attitudes towards flipped classroom is discussed. The paper also includes best practices, their impact on student performance, and challenges in implementing a flipped classroom pedagogy. 

   more » « less
3. A CS1 Spatial Skills Intervention and the Impact on Introductory Programming Abilities

   https://doi.org/10.1145/3328778.3366829  

   Bockmon, Ryan; Cooper, Stephen; Koperski, William; Gratch, Jonathan; Sorby, Sheryl; Dorodchi, Mohsen (February 2020, SIGCSE 2020)

   null (Ed.)

   This paper discusses the results of replicating and extending a study performed by Cooper et al. examining the relationship between students’ spatial skills and their success in learning to program. Whereas Cooper et al. worked with high school students participating in a summer program, we worked with college students taking an introductory computing course. Like Cooper et al.’s study, we saw a correlation between a student’s spatial skills and their success in learning computing. More significantly, we saw that after applying an intervention to teach spatial skills, students demonstrated improved performance both on a standard spatial skills assessment as well as on a CS content instrument. We also saw a correlation between students’ enjoyment in computing and improved performance both on a standard spatial skills assessment and on a CS content instrument, a result not observed by Cooper et al. 

   more » « less
4. Random Forests for Evaluating Pedagogy and Informing Personalized Learning

   Spoon, K; Beemer, J.; Whitmer, J.C.; Fan, J.; Frazee, J. P.; Stronach, J.; Bohonak, A. J.; Levine, R. A. (January 2016, Journal of educational data mining)

   Random forests are presented as an analytics foundation for educational data mining tasks. The focus is on course- and program-level analytics including evaluating pedagogical approaches and interventions and identifying and characterizing at-risk students. As part of this development, the concept of individualized treatment effects (ITE) is introduced as a method to provide personalized feedback to students. The ITE quantifies the effectiveness of intervention and/or instructional regimes for a particular student based on institutional student information and performance data. The proposed random forest framework and methods are illustrated on a study of the efficacy of a supplemental, weekly, one-unit problem-solving session in a large enrollment, bottleneck introductory statistics course. The analytics tools are used to identify factors for student success, characterize students benefitting from the supplemental instruction section, develop an objective criterion to, at the beginning of the semester, identify and advise these students into that section, and suggest intervention initiatives for at-risk groups in the course. 

   more » « less
5. Advancing Student Success Through Integrated Sociocultural and Academic Intervention Strategies

   Sudarshan Kurwadkar, Salvador Mayoral (June 2022, ASEE annual conference exposition)

   Promoting equitable undergraduate engineering education is an overarching concern at many minority-serving institutions (MSI). In addition, historical analysis of student performance in lower-division math and engineering courses at one of the largest MSI revealed an achievement gap in performance between the underrepresented minority students and other students. Furthermore, critical analysis of underlying factors overwhelmingly suggests that academic intervention coupled with sociocultural intervention may be a possible solution to help address this problem. Academic and sociocultural intervention strategies were designed and implemented in lower-division math courses through the National Science Foundation-funded project, “Building Capacity: Advancing Student Success in Undergraduate Engineering and Computer Science (ASSURE-US).” These strategies involved application-based math courses targeted explicitly at undergraduate engineering students. Results of academic intervention strategies in the lower-division math courses at one of the largest MSI demonstrate mixed effectiveness. The results of the academic intervention in lower-division Calculus I (N=150) show that 36% of students reported that the intervention was helpful and helped them learn math, while 38% were neutral. Overall, students reported having difficulty connecting the projects with the mathematics being taught. Similarly, only 10% of students expressed satisfaction with the redesigned intervention modules implemented in Integral Calculus II (N=90), while 52% were neutral. The sociocultural interventions include activities facilitated through the Student-Teacher Interaction Council. These activities include motivational speakers, exam preparation and stress-relief workshop, campus resources and college financial planning workshops, peer advising and learning communities, summer research, and faculty development and support. Results of the sociocultural intervention strategies show that 39% of students reported that the ASSURE-US project helped them identify role models in their discipline, while 34% reported that the project helped them identify and connect to a mentor. Students also reported higher awareness of campus resources, including mental health resources and academic support, with 89% and 90% of students reporting fully or partial understanding of these resources. The academic and sociocultural interventions of the ASSURE-US project were initially designed for in-person, hands-on, project-based, and student-faculty-involved activities; however, due to the COVID-19 pandemic, many of these activities were reimagined and redesigned for virtual instruction. The outcomes of this project so far were significantly impacted by the pandemic. 

   more » « less