skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Initial Findings of Engineering Faculties’ Perceptions of Mastery Assessment in a Project-based Engineering Program
The purpose of this NSF grantees poster is to disseminate initial findings on faculty perception of mastery-based assessment in a project-based engineering program as part of an NSF Broadening Participation award. It is understood that pedagogical approaches influence more than what students learn but also impact their mindsets, motivation, and how they see themselves as engineers. Mastery-based teaching has seen growing popularity in engineering education as faculty strive to support students in achieving learning outcomes linked with continuous improvement to promote performance and persistence. However, this teaching approach has specific challenges as it requires significant restructuring of assessment practices including assignments, exams, evaluation processes, and grading. This work seeks to better understand faculty perspectives of assessment within mastery-based teaching to support a user-oriented perspective that can help other engineering faculty navigate the challenges of using evidence-based teaching practices in their own classrooms. This paper focuses on qualitative findings from an initial pilot study from a larger, NSF-funded Broadening Participation project at a small, Eastern private college. This exploratory pilot study includes the perceptions of two engineering faculty members using mastery teaching and assessment in a project-based engineering program. A semi-structured interview with multiple open-ended questions was used to prompt participants to share their experiences with assessment in relation to their self-efficacy around teaching and their perceptions of assessment in relation to their students’ learning, confidence, and agency. Directed content and thematic analysis were used to identify codes and develop themes in relation to how participants described certain features of assessment in their engineering program. Preliminary results will illustrate features of mastery assessment that faculty highlighted as particularly challenging or successful and related lessons learned. The initial themes and patterns identified in this preliminary pilot study will be used to set up a more focused secondary full data collection phase in the larger study. Additionally, this poster serves as an opportunity to initiate important dialogue around the implementation of mastery-based assessment and project-based learning in engineering programs and to better support engineering faculty in incorporating elements of mastery-based teaching and assessment.  more » « less
Award ID(s):
2219807
PAR ID:
10526172
Author(s) / Creator(s):
; ;
Publisher / Repository:
American Society for Engineering Education Annual Conference
Date Published:
Format(s):
Medium: X
Location:
Portland, Oregon
Sponsoring Org:
National Science Foundation
More Like this
  1. The purpose of this work-in-progress research paper is to explore how mid-program engineering students perceive mastery-based assessment in a multidisciplinary, project-based engineering program. There have been calls in engineering education to support students beyond learning specific competencies but to also include curricular practices that help students see themselves as people who can do engineering. While it is understood that students’ mindsets and feelings of control over their own actions and outcomes are influential in how students see themselves as engineers, less is known about what specific classroom practices have this effect. Specifically, students experience assessment in relation to their learning throughout their engineering programs, but little is known about how their perceptions of these experiences impact their sense of agency or control over how and what they learn. This work explores how mastery-based learning and its associated assessment can be paired with a multidisciplinary project-based learning approach to influence students’ feelings of control and choice in their own engineering education. This paper focuses on qualitative findings from an initial pilot study for a larger, NSF-funded project at a small, Eastern private college. This exploratory pilot study includes the perceptions of four second-year engineering students enrolled in an undergraduate engineering program designed around integrated, multidisciplinary projects. A semi-structured interview with multiple open-ended questions was used to prompt participants to share their experiences with assessment in relation to their own learning, performance, confidence, and choices. Directed content and thematic analysis were used to identify codes and develop themes in relation to how participants described certain features of assessment in their engineering program. Preliminary results will illustrate students’ beliefs, learning, and perceptions of choice in relation to specific features of mastery-based assessment in a multidisciplinary project-based context. The initial themes and patterns identified in this preliminary pilot study will be used to set up a more focused secondary full data collection phase in the larger study and to initiate important conversation around the impacts of specific pedagogical choices on outcomes parallel to learning. By better understanding students’ perceptions of this pedagogical design, future classroom practices can be designed and oriented to support students in feeling agentic in their own engineering education and in becoming their version of an engineer. 
    more » « less
  2. As essential facilitators in the process of the formation of future engineers, engineering faculty determine which technologies students learn and adopt during their engineering studies. Faculty members’ ability to accept new and relevant engineering technologies (such as programming languages, software, and instruments) and adopt them in their curriculum directly affects the relevance of engineering graduates’ technical skills. Additionally, by adopting and teaching new and relevant technologies, engineering faculty model life-long technology adoption to their students. This paper summarizes the preliminary results of an NSF project funded through the Directorate for Engineering, Engineering Education and Centers. A main goal of the project is developing an understanding of the factors that support or inhibit engineering faculty technology acceptance. This paper focuses on a portion of the results related to facilitating conditions that support technology adoption that emerged from the qualitative analysis of interview transcripts from engineering faculty at a Midwestern, USA, technologically-focused university. The accompanying poster session will present these findings, as well as provide a deeper understanding of the data related to one facilitating condition – Peers and Mentors. 
    more » « less
  3. This project aims to enhance students’ learning in foundational engineering courses through oral exams based on the research conducted at the University of California San Diego. The adaptive dialogic nature of oral exams provides instructors an opportunity to better understand students’ thought processes, thus holding promise for improving both assessments of conceptual mastery and students’ learning attitudes and strategies. However, the issues of oral exam reliability, validity, and scalability have not been fully addressed. As with any assessment format, careful design is needed to maximize the benefits of oral exams to student learning and minimize the potential concerns. Compared to traditional written exams, oral exams have a unique design space, which involves a large range of parameters, including the type of oral assessment questions, grading criteria, how oral exams are administered, how questions are communicated and presented to the students, how feedback were provided, and other logistical perspectives such as weight of oral exam in overall course grade, frequency of oral assessment, etc. In order to address the scalability for high enrollment classes, key elements of the project are the involvement of the entire instructional team (instructors and teaching assistants). Thus the project will create a new training program to prepare faculty and teaching assistants to administer oral exams that include considerations of issues such as bias and students with disabilities. The purpose of this study is to create a framework to integrate oral exams in core undergraduate engineering courses, complementing existing assessment strategies by (1) creating a guideline to optimize the oral exam design parameters for the best students learning outcomes; and (2) Create a new training program to prepare faculty and teaching assistants to administer oral exams. The project will implement an iterative design strategy using an evidence-based approach of evaluation. The effectiveness of the oral exams will be evaluated by tracking student improvements on conceptual questions across consecutive oral exams in a single course, as well as across other courses. Since its start in January 2021, the project is well underway. In this poster, we will present a summary of the results from year 1: (1) exploration of the oral exam design parameters, and its impact in students’ engagement and perception of oral exams towards learning; (2) the effectiveness of the newly developed instructor and teaching assistants training programs (3) The development of the evaluation instruments to gauge the project success; (4) instructors and teaching assistants experience and perceptions. 
    more » « less
  4. null (Ed.)
    Purpose The purpose of this case study is to explore the perceptions of science, technology, engineering and mathematics (STEM) faculty members toward mentoring undergraduates. Design/methodology/approach Within the context of a student scholarship and faculty development project, funded by the National Science Foundation (NSF), STEM faculty members were interviewed at a small teaching-focused university in South Texas, United States. This research study utilized a qualitative case study approach based on semi-structured interviews with nine Mathematics and Computer Science faculty members. Transcripts were coded thematically, beginning with open coding and continuing with repeated rounds of comparison leading to the identification of four themes. Findings Four themes were identified in the data: describing settings where mentoring occurs, identifying the tasks of mentoring, developing skills for mentoring others and inhabiting the identity of a mentor. These findings suggest that increasing faculty engagement and effectiveness in mentoring STEM students may be a matter of broadening the definition of mentoring and helping faculty members develop the identity of a mentor. Practical implications In an effort to promote retention of students, specifically within STEM fields, many initiatives highlight the importance of faculty mentoring for undergraduate students. This research suggests that faculty members' perceptions of the role and structure of a mentoring relationship will shape this relationship and have an impact on student persistence and success. Originality/value While most studies of faculty–student mentoring focus on the experiences of students, this study explored faculty members' perceptions of that relationship. 
    more » « less
  5. The STEM Excellence through Engagement in Collaboration, Research, and Scholarship (SEECRS) project at Whatcom Community College is in year four of a five-year NSF S-STEM funded program aiming to support academically talented students with demonstrated financial need in biology, chemistry, geology, computer science, engineering, and physics. This program offered financial, academic, and professional support to three two-year cohorts of students and is in the final year of the third and final cohort of the currently funded grant cycle. The SEECRS project aimed to utilize a STEM-specific guided pathways approach to strengthen recruitment, retention, and matriculation of STEM students at the community college level. Over the course of the program 39 individuals received scholarship support. The program supported scholarship recipients through participation in the SEECRS Scholars Academy, a multi-pronged approach to student support combining elements of community building, faculty mentorship, targeted advising activities, authentic science practice, and social activities. Key elements of the program are: a required two-credit course that emphasized STEM identity development, course-based undergraduate research experiences (CUREs) in Biology, Chemistry and Engineering courses, funded summer research opportunities, and paring of each scholar with a faculty mentor. This paper presents data from the first four years of the program including participant outcomes and feedback on their experiences. Results from project evaluation activities such as pre and post surveys, focus groups, exit interviews, and faculty surveys are also presented and analyzed to compare how gains reported by program participants regarding such attributes as their STEM identities and sense of belonging compare to responses from a control group of students who did not participate in the program. Preliminary identification of some program best practices will also be presented. 
    more » « less