skip to main content


Title: “What Will I Experience in My College STEM Courses?” An Investigation of Student Predictions about Instructional Practices in Introductory Courses
The instructional practices used in introductory college courses often differ dramatically from those used in high school courses, and dissatisfaction with these practices is cited by students as a prominent reason for leaving science, technology, engineering, and mathematics (STEM) majors. To better characterize the transition to college course work, we investigated the extent to which incoming expectations of course activities differ based on student demographic characteristics, as well as how these expectations align with what students will experience. We surveyed more than 1500 undergraduate students in large introductory STEM courses at three research-intensive institutions during the first week of classes about their expectations regarding how class time would be spent in their courses. We found that first-generation and first-semester students predict less lecture than their peers and that class size had the largest effect on student predictions. We also collected classroom observation data from the courses and found that students generally underpredicted the amount of lecture observed in class. This misalignment between student predictions and experiences, especially for first-generation and first-semester college students and students enrolled in large- and medium-size classes, has implications for instructors and universities as they design curricula for introductory STEM courses with explicit retention goals.  more » « less
Award ID(s):
1712060 1712074
NSF-PAR ID:
10171934
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
CBE—Life Sciences Education
Volume:
18
Issue:
4
ISSN:
1931-7913
Page Range / eLocation ID:
ar60
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Background

    Large introductory lecture courses are frequently post-secondary students’ first formal interaction with science, technology, engineering, and mathematics (STEM) disciplines. Grade outcomes in these courses are often disparate across student populations, which, in turn, has implications for student retention. This study positions such disparities as a manifestation of systemic inequities along the dimensions of sex, race/ethnicity, income, and first-generation status and investigates the extent to which they are similar across peer institutions.

    Results

    We examined grade outcomes in a selected set of early STEM courses across six large, public, research-intensive universities in the United States over ten years. In this sample of more than 200,000 STEM course enrollments, we find that course grade benefits increase significantly with the number of systemic advantages students possess at all six institutions. The observed trends in academic outcomes versus advantage are strikingly similar across universities despite the fact that we did not control for differences in grading practices, contexts, and instructor and student populations. The findings are concerning given that these courses are often students’ first post-secondary STEM experiences.

    Conclusions

    STEM course grades are typically lower than those in other disciplines; students taking them often pay grade penalties. The systemic advantages some student groups experience are correlated with significant reductions in these grade penalties at all six institutions. The consistency of these findings across institutions and courses supports the claim that inequities in STEM education are a systemic problem, driven by factors that go beyond specific courses or individual institutions. Our work provides a basis for the exploration of contexts where inequities are exacerbated or reduced and can be used to advocate for structural change within STEM education. To cultivate more equitable learning environments, we must reckon with how pervasive structural barriers in STEM courses negatively shape the experiences of marginalized students.

     
    more » « less
  2. Abstract

    Introductory STEM courses represent entry points into a major, and student experiences in these courses can affect both their persistence and success in STEM disciplines. Identifying course-based student concerns may help instructors detect negative perceptions, areas of struggle, and potential barriers to success. Using an open-response survey question, we identified 13 common concerns expressed by students in introductory STEM courses. We converted these student-generated concerns into closed-ended items that were administered at the beginning and middle of the semester to students in 22 introductory STEM course sections across three different institutions. Students were asked to reflect on each item on a scale from very concerned to not concerned. A subset of these concerns was used to create a summary score of course-based concern for each student. Overall levels of student concern decreased from the first week to the middle of the semester; however, this pattern varied across different demographic groups. In particular, when controlling for initial concern and course grades, female students held higher levels of concern than their peers. Since student perceptions can impact their experiences, addressing concerns through communication and instructional practices may improve students’ overall experiences and facilitate their success.

     
    more » « less
  3. The drive to encourage young people to pursue degrees and careers in engineering has led to an increase in student populations in engineering programs. For some institutions, such as large public research institutions, this has led to large class sizes for courses that are commonly taken across multiple programs. While this decision is reasonable from an operational and resource management perspective, research on large classes have shown that students suffer decreased engagement, motivation and achievement. Instructors, on the other hand, report having difficulty establishing rapport with their students and a growing inability to monitor students’ learning gains and provide quality individualized feedback. To address these issues, our project draws from Lattuca and Stark’s Academic Plan model, which incorporates a thorough consideration of factors influencing curricular activities that can be applied at the course, program, and institutional levels, and assumes that instructors are key actors in curriculum development and revision. We aim to revitalize feedback loops to help instructors and departments continuously improve. Recognizing that we must understand both individual and systems level perspectives, we prioritize regular engagement between faculty and institutional support structures to collaboratively identify problems and systematically establish continuous improvement. In the first phase of this NSF IUSE Institutional Transformation project, we focus on specifically prompting and studying the experiences of 8 instructors of foundational engineering courses usually taught in large class sizes across 4 different departments at a large public research institution. We collected qualitative data (semi-structured interviews, reflective journals, course-related documents) and quantitative data (student surveys and institution-provided transcript data) to answer research questions (e.g., what data do faculty teaching large foundational undergraduate engineering courses identify as being useful so that they may enhance students’ experiences and outcomes within the classes that they teach and across students’ multiple large classes?) at the intersection of learning analytics and faculty change. The data was used as a baseline to further refine data collection protocols, identify data that faculty consider meaningful and useful for managing large foundational engineering courses, and consider ways of productively leveraging institutional data to improve the learning experience in these courses. Data collection for the first phase is ongoing and will continue through the Spring 2018 semester. Findings for this paper will include high-level insights from Fall interviews with instructors as well as data visualizations created from the population-level data characterizing student performance in the foundational courses within the context of pre-college characteristics (e.g., SAT scores) and/or other academic outcomes (e.g., major switching within or out of engineer, degree attainment). 
    more » « less
  4. There is a critical need for more students with engineering and computer science majors to enter into, persist in, and graduate from four-year postsecondary institutions. Increasing the diversity of the workforce by inclusive practices in engineering and science is also a profound identified need. According to national statistics, the largest groups of underrepresented minority students in engineering and science attend U.S. public higher education institutions. Most often, a large proportion of these students come to colleges and universities with unique challenges and needs, and are more likely to be first in their family to attend college. In response to these needs, engineering education researchers and practitioners have developed, implemented and assessed interventions to provide support and help students succeed in college, particularly in their first year. These interventions typically target relatively small cohorts of students and can be managed by a small number of faculty and staff. In this paper, we report on “work in progress” research in a large-scale, first-year engineering and computer science intervention program at a public, comprehensive university using multivariate comparative statistical approaches. Large-scale intervention programs are especially relevant to minority serving institutions that prepare growing numbers of students who are first in their family to attend college and who are also under-resourced, financially. These students most often encounter academic difficulties and come to higher education with challenging experiences and backgrounds. Our studied first-year intervention program, first piloted in 2015, is now in its 5th year of implementation. Its intervention components include: (a) first-year block schedules, (b) project-based introductory engineering and computer science courses, (c) an introduction to mechanics course, which provides students with the foundation needed to succeed in a traditional physics sequence, and (d) peer-led supplemental instruction workshops for calculus, physics and chemistry courses. This intervention study responds to three research questions: (1) What role does the first-year intervention’s components play in students’ persistence in engineering and computer science majors across undergraduate program years? (2) What role do particular pedagogical and cocurricular support structures play in students’ successes? And (3) What role do various student socio-demographic and experiential factors play in the effectiveness of first-year interventions? To address these research questions and therefore determine the formative impact of the firstyear engineering and computer science program on which we are conducting research, we have collected diverse student data including grade point averages, concept inventory scores, and data from a multi-dimensional questionnaire that measures students’ use of support practices across their four to five years in their degree program, and diverse background information necessary to determine the impact of such factors on students’ persistence to degree. Background data includes students’ experiences prior to enrolling in college, their socio-demographic characteristics, and their college social capital throughout their higher education experience. For this research, we compared students who were enrolled in the first-year intervention program to those who were not enrolled in the first-year intervention. We have engaged in cross-sectional 2 data collection from students’ freshman through senior years and employed multivariate statistical analytical techniques on the collected student data. Results of these analyses were interesting and diverse. Generally, in terms of backgrounds, our research indicates that students’ parental education is positively related to their success in engineering and computer science across program years. Likewise, longitudinally (across program years), students’ college social capital predicted their academic success and persistence to degree. With regard to the study’s comparative research of the first-year intervention, our results indicate that students who were enrolled in the first-year intervention program as freshmen continued to use more support practices to assist them in academic success across their degree matriculation compared to students who were not in the first-year program. This suggests that the students continued to recognize the value of such supports as a consequence of having supports required as first-year students. In terms of students’ understanding of scientific or engineering-focused concepts, we found significant impact resulting from student support practices that were academically focused. We also found that enrolling in the first-year intervention was a significant predictor of the time that students spent preparing for classes and ultimately their grade point average, especially in STEM subjects across students’ years in college. In summary, we found that the studied first-year intervention program has longitudinal, positive impacts on students’ success as they navigate through their undergraduate experiences toward engineering and computer science degrees. 
    more » « less
  5. The 2021 return to face-to-face teaching and proctored exams revealed significant gaps in student learning during remote instruction. The challenge of supporting underperforming students is not expected to abate in the next 5-10 years as COVID-19-related learning losses compound structural inequalities in K-12 education. More recently, anecdotal evidence across courses shows declines in classroom attendance and student engagement. Lack of engagement indicates emotional barriers rather than intellectual deficiencies, and its growth coincides with the ongoing mental health epidemic. Regardless of the underlying reasons, professors are now faced with the unappealing choice of awarding failing grades to an uncomfortably large fraction of classes or awarding passing grades to students who do not seem prepared for the workforce or adult life in general. Faculty training, if it exists, addresses neither the scale of this situation nor the emotional/identity aspects of the problem. There is an urgent need for pedagogical remediation tools that can be applied without additional TA or staff resources, without training in psychiatry, and with only five or eight weeks remaining in the semester. This work presents two work-in-progress interventions for engineering faculty who face the challenges described above. In the first intervention, students can improve their exam score by submitting videos of reworked exams. The requirement of voiceover forces students to understand the thought process behind problems, even if they have copied the answers from a friend. Incorporating peer review into the assignment reduces the workload for instructor grading. This intervention has been successfully implemented in sophomore- and senior-level courses with positive feedback from both faculty and students. In the second intervention, students who fail the midterm are offered an automatic passing exam grade (typically 51%) in exchange for submitting a knowledge inventory and remediation plan. Students create a glossary of terms and concepts from the class and rank them by their level of understanding. Recent iterations of the remediation plan also include reflections on emotions and support networks. In February 2023, the project team will scale the interventions to freshman-level Introductory Programming, which has 400 students and the highest fail/withdrawal rate in the college. The large sample size will enable more robust statistics to correlate exam scores, intervention rubric items, and surveys on assignment effectiveness. Piloting interventions in a variety of environments and classes will establish best pedagogical practices that minimize instructors’ workload and decision fatigue. The ultimate goal of this project is to benefit students and faculty through well-defined and systematic interventions across the curriculum. 
    more » « less