skip to main content


Title: STEM courses are harder: evaluating inter-course grading disparities with a calibrated GPA model
Abstract Background

Grades in college and university STEM courses are an important determinant of student persistence in STEM fields. Recent studies have used the grade offset/grade penalty method to explore why students have lower grades in STEM courses than their GPAs would predict. The results of these studies are in doubt; however, as they use GPA as a reliable measure of academic performance, which is a disputed assumption. Using a predictive model of student performance, it is possible to produce a more accurate measure of academic performance than the observed GPA and discover if STEM courses are graded more stringently, and under which circumstances.

Results

A weighted logistic model of GPA better predicts academic performance than the observed GPA. Using this calibrated GPA it is found that the grade offset method predicts that STEM courses, departments, and programs grade significantly more stringently than non-STEM courses. The average grade difference between STEM and non-STEM course grades and GPAs is around four tenths of a grade point. An exception is general education courses offered by STEM departments, which are graded with the same leniency as non-STEM courses. Grade offset calculations that use the observed GPA systematically underestimate the negative offset in STEM grading relative to calculations that use the calibrated GPA. The calibrated GPA is much more highly correlated with standardized tests such as the ACT (r = 0.49) than the observed GPA is (r = 0.25).

Conclusion

Observed GPA is a systematically biased measure of academic performance, and should not be used as a basis for determining the presence of grading inequity. Logistic models of GPA provide a more reliable measure of academic performance. When comparing otherwise academically similar students, we find that STEM students have substantially lower grades and GPAs, and that this is the consequence of harder (more stringent) grading in STEM courses.

 
more » « less
NSF-PAR ID:
10363912
Author(s) / Creator(s):
;
Publisher / Repository:
Springer Science + Business Media
Date Published:
Journal Name:
International Journal of STEM Education
Volume:
9
Issue:
1
ISSN:
2196-7822
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Background

    Large introductory lecture courses are frequently post-secondary students’ first formal interaction with science, technology, engineering, and mathematics (STEM) disciplines. Grade outcomes in these courses are often disparate across student populations, which, in turn, has implications for student retention. This study positions such disparities as a manifestation of systemic inequities along the dimensions of sex, race/ethnicity, income, and first-generation status and investigates the extent to which they are similar across peer institutions.

    Results

    We examined grade outcomes in a selected set of early STEM courses across six large, public, research-intensive universities in the United States over ten years. In this sample of more than 200,000 STEM course enrollments, we find that course grade benefits increase significantly with the number of systemic advantages students possess at all six institutions. The observed trends in academic outcomes versus advantage are strikingly similar across universities despite the fact that we did not control for differences in grading practices, contexts, and instructor and student populations. The findings are concerning given that these courses are often students’ first post-secondary STEM experiences.

    Conclusions

    STEM course grades are typically lower than those in other disciplines; students taking them often pay grade penalties. The systemic advantages some student groups experience are correlated with significant reductions in these grade penalties at all six institutions. The consistency of these findings across institutions and courses supports the claim that inequities in STEM education are a systemic problem, driven by factors that go beyond specific courses or individual institutions. Our work provides a basis for the exploration of contexts where inequities are exacerbated or reduced and can be used to advocate for structural change within STEM education. To cultivate more equitable learning environments, we must reckon with how pervasive structural barriers in STEM courses negatively shape the experiences of marginalized students.

     
    more » « less
  2. Abstract Background

    Supplemental instruction (SI) is a well-established mode of direct academic support, used in a wide variety of courses. Some reports have indicated that SI and similar peer-led academic support models particularly benefit students identifying with historically underserved racial/ethnic groups in STEM. However, these studies have not explicitly examined the role of prior academic experiences, an important consideration in college success. We report on the impact of a modified SI model, Peer Supplemental Instruction (PSI), on student success in introductory STEM courses at a diverse access institution. This study focuses on PSI’s impact on the academic performance of students identifying with historically underserved racial/ethnic groups, while also considering the effects of prior academic experiences.

    Results

    Data were aggregated for nine courses over five semesters to produce a robust data set (n = 1789). PSI attendees were representative of the overall student population in terms of previous academic experiences/performance (as determined by high school GPA) and self-identified racial/ethnic demographics. Frequent PSI attendance was correlated with a significant increase in AB rates (average increase of 29.0 percentage points) and reduction in DFW rates (average decrease of 26.1 percentage points) when comparing students who attended 10 + vs. 1–2 PSI sessions. Overall, students identifying as Black/African American received the largest benefit from PSI. These students experienced a significant increase in their final course GPA when attending as few as 3–5 PSI sessions, and exhibited the largest increase in AB rates (from 28.7 to 60.5%) and decrease in DFW rates (from 47.1 to 14.8%) when comparing students who attended 10 + vs. 1–2 sessions. However, students with similar HS GPAs experienced similar benefits from PSI, regardless of self-identified race/ethnicity.

    Conclusions

    The data presented here suggest that PSI particularly benefitted underprepared students in their introductory STEM courses. Since students identifying with historically underserved racial/ethnic groups have traditionally had inequitable K–12 educational experiences, they enter college less prepared on average, and thus particularly benefit from PSI. PSI, in conjunction with additional strategies, may be a useful tool to help rectify the results of systemic educational inequities for students identifying with historically underserved racial/ethnic groups.

     
    more » « less
  3. Abstract

    The high school grade point average (GPA) is often adjusted to account for nominal indicators of course rigor, such as “honors” or “advanced placement.” Adjusted GPAs—also known as weighted GPAs—are frequently used for computing students’ rank in class and in the college admission process. Despite the high stakes attached to GPA, weighting policies vary considerably across states and high schools. Previous methods of estimating weighting parameters have used regression models with college course performance as the dependent variable. We discuss and demonstrate the suitability of the graded response model for estimating GPA weighting parameters and evaluating traditional weighting schemes. In our sample, which was limited to self‐reported performance in high school mathematics courses, we found that commonly used policies award more than twice the bonus points necessary to create parity for standard and advanced courses.

     
    more » « less
  4. null (Ed.)
    This Complete Research paper will describe the implementation of an introductory course (ENGR194) for first semester engineering students. The course is meant to improve retention and academic success of engineering first-year students in the College of Engineering at the University of Illinois at Chicago. The implementation of this course is part of an ongoing National Science Foundation (NSF) Scholarships in Science, Technology, Engineering, and Math (S-STEM) project. This paper reports on the impact of combinatorial enrollment in ENGR194 and a previously described two-week Summer Bridge Program (SBP) offered only for entering S-STEM scholars before their first semester. To measure the impact of this course on student retention and academic success, various evaluation metrics are compared for three separate Comparison Groups (C-Groups) of students. The results show that the ENGR194 course had a significant positive impact on the first-year retention rate. The results also revealed that students who participated in both ENGR194 and SBP (C-Group 1) made changes to their declared majors earlier than students who had only taken ENGR 123 or neither of the courses (C-Groups 2 and 3 respectively). Furthermore, students in C-Group 1 received better grades in math and science than their peers, and students in C-Groups 1 and 2 had significantly higher GPAs than their peers in C-Group 3. 
    more » « less
  5. Abstract Background

    Creativity is increasingly recognized as an important skill for success in the field of engineering, but most traditional, post‐secondary engineering education programs do not reward creative efforts. Failing to recognize creativity or creative efforts can have particularly negative effects for those students with attention deficit hyperactivity disorder (ADHD), who may exhibit enhanced divergent thinking ability yet struggle in the traditional educational environment.

    Purpose/Hypothesis

    This study was conducted to investigate how ADHD characteristics, academic aptitude, and one important component of creativity (divergent thinking) contribute to academic performance in engineering programs and how traditional markers of academic performance and ADHD characteristics predict divergent thinking.

    Design/Method

    Undergraduate engineering students (n= 60) completed measures of ADHD symptoms and divergent thinking. Scholastic Aptitude Test (SAT) scores and grade point average (GPA) were collected from university records, and hypotheses were tested using a series of multivariate regression models.

    Results

    Verbal SAT scores were the only positive predictor of overall GPA and engineering GPA. ADHD characteristics did not significantly predict overall GPA but negatively predicted engineering GPA. ADHD characteristics were the only positive predictor of divergent thinking ability.

    Conclusions

    ADHD characteristics negatively predict academic performance (i.e., GPA) in engineering programs but are more predictive of divergent thinking ability than traditional markers of academic performance.

     
    more » « less