Specifications and mastery grading schemes have been growing in popularity in higher education over the past several years, and reports of specifications grading and other alternative grading systems are emerging in the chemistry education literature. The general goal of these alternative grading approaches is to reduce the reliance on high-stakes exams and give students a more transparent pathway to achieving the course learning outcomes. More importantly, relying less on infrequent high-stakes exams may help reduce historical equity gaps in introductory gateway STEM courses. Herein, we describe the implementation of two versions of mastery grading systems in large enrollment general chemistry courses at a public R1 institution. Class-wide course outcomes, equity gaps in performance on a common final exam, and student feedback on their experience navigating these grading schemes are presented. We show that combining mastery grading with interactive courseware tools improved the average performance on a common final assessment for under-represented minority (URM) students by 7.1 percentage points relative to an active control course that used infrequent high-stakes exams.
more »
« less
Board 305: HSI Implementation and Evaluation Project: Commitment to Learning Instilled by Mastery-Based Undergraduate Program (CLIMB-UP)
This is a board presentation at the 2023 ASEE Annual Conference describing the HSI Implementation and Evaluation Project: Commitment to Learning Instilled by Mastery-Based Undergraduate Program (CLIMB-UP). Commitment to Learning Instilled by a Mastery-Based Undergraduate Program (CLIMBUP) is an NSF IUSE:HSI project centered on re-designing courses with high non-completion rates (C- or lower) that have implications towards students’ graduation, transfer ability and retention. Despite decades of effort to create active, inquiry-based learning practices in classrooms, our institution continues to see equity gaps and many required courses with noncompletion rates exceeding 50%. Grading practices have been identified as one of the main culprits in the persistence of equity gaps. As a Hispanic Serving Institution, we recognize and value the diversity of experience that our students bring to our campuses and are committed to utilizing their strengths by creating datadriven, equitable grading practices that give students space to take risks and bring alternative viewpoints to our classrooms and be rewarded. We believe a Mastery-Based Grading (MBG) approach can address problems that a traditional grading approach has caused. The CLIMB-UP project is building the infrastructure to support and train STEM faculty (both tenure-line and adjuncts) to redesign and teach a Mastery-Based Graded (MGB) course, and is conducting research on faculty experiences and on the change in student attitudes, mindsets, and outcomes.
more »
« less
- Award ID(s):
- 2122941
- PAR ID:
- 10466744
- Publisher / Repository:
- 2023 ASEE Annual Conference & Exposition
- Date Published:
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The purpose of this NSF grantees poster is to disseminate initial findings on faculty perception of mastery-based assessment in a project-based engineering program as part of an NSF Broadening Participation award. It is understood that pedagogical approaches influence more than what students learn but also impact their mindsets, motivation, and how they see themselves as engineers. Mastery-based teaching has seen growing popularity in engineering education as faculty strive to support students in achieving learning outcomes linked with continuous improvement to promote performance and persistence. However, this teaching approach has specific challenges as it requires significant restructuring of assessment practices including assignments, exams, evaluation processes, and grading. This work seeks to better understand faculty perspectives of assessment within mastery-based teaching to support a user-oriented perspective that can help other engineering faculty navigate the challenges of using evidence-based teaching practices in their own classrooms. This paper focuses on qualitative findings from an initial pilot study from a larger, NSF-funded Broadening Participation project at a small, Eastern private college. This exploratory pilot study includes the perceptions of two engineering faculty members using mastery teaching and assessment in a project-based engineering program. A semi-structured interview with multiple open-ended questions was used to prompt participants to share their experiences with assessment in relation to their self-efficacy around teaching and their perceptions of assessment in relation to their students’ learning, confidence, and agency. Directed content and thematic analysis were used to identify codes and develop themes in relation to how participants described certain features of assessment in their engineering program. Preliminary results will illustrate features of mastery assessment that faculty highlighted as particularly challenging or successful and related lessons learned. The initial themes and patterns identified in this preliminary pilot study will be used to set up a more focused secondary full data collection phase in the larger study. Additionally, this poster serves as an opportunity to initiate important dialogue around the implementation of mastery-based assessment and project-based learning in engineering programs and to better support engineering faculty in incorporating elements of mastery-based teaching and assessment.more » « less
-
Powell, Roger (Ed.)Abstract The teaching practices used in college science classrooms have a profound influence on which students pass their courses (and continue to major in science) and which are ‘weeded out.’ Students from traditionally marginalized backgrounds have lower grades and learning gains compared to their nonmarginalized peers in courses that rely heavily on lecture and high-stakes exams. This achievement gap narrows or disappears when instructors use student-centered, evidence-based teaching practices. These teaching practices can include actions that shape our classroom environment, communicate course material, and assess student learning. In this paper, we provide a summary of the evidence supporting the use of student-centered teaching practices, followed by examples of several effective evidence-based teaching practices that can be integrated into organismal courses. Examples include faculty mindset for inclusion, teaching practices to increase student confidence and to reduce stereotype threat, increasing course structure by spreading points among several different types of activities, several active learning methods, jigsaws, Scientist Spotlights, course-based undergraduate research experiences, and inquiry-based labs. Each example is linked to supporting resources to help instructors easily implement these practices in their classrooms. The American Society of Mammalogists endeavors to be equitable and inclusive through numerous initiatives, and modifying our teaching practices can increase equity and inclusion of future mammalogists into our own classrooms.more » « less
-
This research paper presents an autoethnographic study of a faculty-led community of practice assembled to promote reflection as a process to improve equity in engineering courses. The faculty participants (authors) committed to enact a variety of practices in self-reflection, reflection with colleagues, and reflection with students during one semester to build more equitable teaching and learning opportunities in their courses. This commitment came after participation in a series of DEI faculty development workshops in the previous semester and exploration of reflection practices during the formation of the community of practice. The theoretical framework central to this work is Lave and Wenger’s (1991) communities of practice that emphasizes members’ coming together around a common interest to share experiences, to collaboratively improve their work, and to solve shared problems. Communities of practice are increasingly common as vehicles for faculty development, especially to promote high-quality, equitable instruction (Borboa-Peterson, Ozaki, & Kelsch, 2021; Hoyt, et al., 2020). As such, this paper examines the impact of a community of practice on reflective teaching to advance the authors’ interest in expanding equity-oriented classroom teaching and learning opportunities for all faculty and students. Rooted in autoethnographic methodology (Belbase, Luitel, & Taylor, 2008), the study explores individual narratives and their intersections with the stories of other community members to better understand the experiences of engineering faculty who use purposeful reflection to promote educational equity. The authors construct a shared narrative that grew from the interactions with fellow community of practice members and explore the culture of engineering education at their institution and the opportunities and challenges of advancing more equitable teaching and learning. Findings include prevalent themes of successes and limitations to supporting equitable classrooms, the impact of a reflection-driven community of practice on individual teaching performances, and the strengths and challenges of enacted reflection techniques for engineering educators.more » « less
-
This NSF Grantees poster discusses an early phase Revolutionizing Engineering Departments (RED) project which is designed to address preparing engineering students to address large scale societal problems, the solutions of which integrate multiple disciplinary perspectives. These types of problems are often termed “convergent problems”. The idea of convergence captures how different domains of expertise contribute to solving a problem, but also the value of the network of connections between areas of knowledge that is built in undertaking such activities. While most existing efforts at convergence focus at the graduate and post-graduate levels, this project supports student development of capabilities to address convergent problems in an undergraduate disciplinary-based degree program in electrical and computer engineering. This poster discusses some of the challenges faced in implementing such learning including how to decouple engineering topics from societal concerns in ways that are relevant to undergraduate students yet retain aspects of convergence, negotiations between faculty on ways to balance discipline-specific skills with the breadth required for systemic understanding, and challenges in integrating relevant projects into courses with different faculty and instructional learning goals. One of the features of the project is that it builds on ideas from Communities of Transformation by basing activities on a coherent philosophical model that guides theories of change. The project has adopted Amartya Sen’s Development as Freedom or capabilities framework as the organizing philosophy. In this model the freedom for individuals to develop capabilities they value is viewed as both the means and end of development. The overarching goal of the project is then for students to build personalized frameworks based on their value systems which allow them to later address complex, convergent problems. Framework development by individual students is supported in the project through several activities: modifying grading practices to provide detailed feedback on skills that support convergence, eliciting self-narratives from students about their pathways through courses and projects with the goal of developing reflection, and carefully integrating educational software solutions that can reduce some aspects of faculty workload which is hypothesized to enable faculty to focus efforts on integrating convergent projects throughout the curriculum. The poster will present initial results on the interventions to the program including grading, software integration, projects, and narratives. The work presented will also cover an ethnographic study of faculty practices which serves as an early-stage baseline to calibrate longer-term changes.more » « less
An official website of the United States government

