The purpose of this NSF grantees poster is to disseminate initial findings on faculty perception of mastery-based assessment in a project-based engineering program as part of an NSF Broadening Participation award. It is understood that pedagogical approaches influence more than what students learn but also impact their mindsets, motivation, and how they see themselves as engineers. Mastery-based teaching has seen growing popularity in engineering education as faculty strive to support students in achieving learning outcomes linked with continuous improvement to promote performance and persistence. However, this teaching approach has specific challenges as it requires significant restructuring of assessment practices including assignments, exams, evaluation processes, and grading. This work seeks to better understand faculty perspectives of assessment within mastery-based teaching to support a user-oriented perspective that can help other engineering faculty navigate the challenges of using evidence-based teaching practices in their own classrooms. This paper focuses on qualitative findings from an initial pilot study from a larger, NSF-funded Broadening Participation project at a small, Eastern private college. This exploratory pilot study includes the perceptions of two engineering faculty members using mastery teaching and assessment in a project-based engineering program. A semi-structured interview with multiple open-ended questions was used to prompt participants to share their experiences with assessment in relation to their self-efficacy around teaching and their perceptions of assessment in relation to their students’ learning, confidence, and agency. Directed content and thematic analysis were used to identify codes and develop themes in relation to how participants described certain features of assessment in their engineering program. Preliminary results will illustrate features of mastery assessment that faculty highlighted as particularly challenging or successful and related lessons learned. The initial themes and patterns identified in this preliminary pilot study will be used to set up a more focused secondary full data collection phase in the larger study. Additionally, this poster serves as an opportunity to initiate important dialogue around the implementation of mastery-based assessment and project-based learning in engineering programs and to better support engineering faculty in incorporating elements of mastery-based teaching and assessment.
more »
« less
Work-in-Progress: Seizing failure as an opportunity to learn: Undergraduate engineering students’ conceptions of failure and iteration
The purpose of this work-in-progress research paper is to explore how mid-program engineering students perceive mastery-based assessment in a multidisciplinary, project-based engineering program. There have been calls in engineering education to support students beyond learning specific competencies but to also include curricular practices that help students see themselves as people who can do engineering. While it is understood that students’ mindsets and feelings of control over their own actions and outcomes are influential in how students see themselves as engineers, less is known about what specific classroom practices have this effect. Specifically, students experience assessment in relation to their learning throughout their engineering programs, but little is known about how their perceptions of these experiences impact their sense of agency or control over how and what they learn. This work explores how mastery-based learning and its associated assessment can be paired with a multidisciplinary project-based learning approach to influence students’ feelings of control and choice in their own engineering education. This paper focuses on qualitative findings from an initial pilot study for a larger, NSF-funded project at a small, Eastern private college. This exploratory pilot study includes the perceptions of four second-year engineering students enrolled in an undergraduate engineering program designed around integrated, multidisciplinary projects. A semi-structured interview with multiple open-ended questions was used to prompt participants to share their experiences with assessment in relation to their own learning, performance, confidence, and choices. Directed content and thematic analysis were used to identify codes and develop themes in relation to how participants described certain features of assessment in their engineering program. Preliminary results will illustrate students’ beliefs, learning, and perceptions of choice in relation to specific features of mastery-based assessment in a multidisciplinary project-based context. The initial themes and patterns identified in this preliminary pilot study will be used to set up a more focused secondary full data collection phase in the larger study and to initiate important conversation around the impacts of specific pedagogical choices on outcomes parallel to learning. By better understanding students’ perceptions of this pedagogical design, future classroom practices can be designed and oriented to support students in feeling agentic in their own engineering education and in becoming their version of an engineer.
more »
« less
- Award ID(s):
- 2219807
- PAR ID:
- 10526170
- Publisher / Repository:
- American Society of Engineering Education Annual Conference
- Date Published:
- Format(s):
- Medium: X
- Location:
- Portland, Oregon
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Major challenges in engineering education include retention of undergraduate engineering students (UESs) and continued engagement after the first year when concepts increase in difficulty. Additionally, employers, as well as ABET, look for students to demonstrate non-technical skills, including the ability to work successfully in groups, the ability to communicate both within and outside their discipline, and the ability to find information that will help them solve problems and contribute to lifelong learning. Teacher education is also facing challenges given the recent incorporation of engineering practices and core ideas into the Next Generation Science Standards (NGSS) and state level standards of learning. To help teachers meet these standards in their classrooms, education courses for preservice teachers (PSTs) must provide resources and opportunities to increase science and engineering knowledge, and the associated pedagogies. To address these challenges, Ed+gineering, an NSF-funded multidisciplinary collaborative service learning project, was implemented into two sets of paired-classes in engineering and education: a 100 level mechanical engineering class (n = 42) and a foundations class in education (n = 17), and a fluid mechanics class in mechanical engineering technology (n = 23) and a science methods class (n = 15). The paired classes collaborated in multidisciplinary teams of 5-8 undergraduate students to plan and teach engineering lessons to local elementary school students. Teams completed a series of previously tested, scaffolded activities to guide their collaboration. Designing and delivering lessons engaged university students in collaborative processes that promoted social learning, including researching and planning, peer mentoring, teaching and receiving feedback, and reflecting and revising their engineering lesson. The research questions examined in this pilot, mixed-methods research study include: (1) How did PSTs’ Ed+gineering experiences influence their engineering and science knowledge?; (2) How did PSTs’ and UESs’ Ed+gineering experiences influence their pedagogical understanding?; and (3) What were PSTs’ and UESs’ overall perceptions of their Ed+gineering experiences? Both quantitative (e.g., Engineering Design Process assessment, Science Content Knowledge assessment) and qualitative (student reflections) data were used to assess knowledge gains and project perceptions following the semester-long intervention. Findings suggest that the PSTs were more aware and comfortable with the engineering field following lesson development and delivery, and often better able to explain particular science/engineering concepts. Both PSTs and UESs, but especially the latter, came to realize the importance of planning and preparing lessons to be taught to an audience. UESs reported greater appreciation for the work of educators. PSTs and UESs expressed how they learned to work in groups with multidisciplinary members—this is a valuable lesson for their respective professional careers. Yearly, the Ed+gineering research team will also request and review student retention reports in their respective programs to assess project impact.more » « less
-
The Improving Students’ Sociotechnical Literacy in Engineering project aims to integrate social justice topics with technical knowledge in a first-year engineering course. The approach involves redesigning an existing intro to computing course with justice-based activities, supported by an Equity Learning Assistant (ELA) program. This program trains upperclass students to facilitate in-class discussions on equity and social justice. The project targets improvements in students' critical sociotechnical literacy and engineering identity. Activities include analyzing ethically complex data sets and developing equity-focused projects, while encouraging students to integrate social, economic, and political dimensions into their engineering work. This initiative spans four years (one pilot year plus three NSF-funded iterations) and involves a multidisciplinary research team of engineers and education researchers.more » « less
-
This work in progress paper in the research to practice category identifies trends in how middle school youth from rural schools conceptualize failure after engaging in engineering-related learning activities. These trends inform better strategies that can be used in the PEERS, Partnering with Educators and Engineers in Rural Schools, program to ensure the goals of the program are met. The PEERS program moves beyond single exposure activities by engaging students in approximately six engineering-related learning activities throughout the year. This program partners researchers, teachers and local industry representatives aiming to (1) challenge misperceptions and create relevant conceptions of engineering; (2) maintain and expand situational interest; and, (3) integrate with individual interests, values, and social identities. Since failure is an integral part of the learning experience, students' conceptions of failure can influence the way students interact in these activities and the outcomes they experience from this program. Interviews were conducted with 38 students across the three rural communities involved in the PEERS program on their perceptions of failure. This paper presents two themes that emerged from initial coding of the interviews and explains how these themes will be used to inform future decisions for PEERS.more » « less
-
null (Ed.)The Academy of Engineering Success (AcES) program, established in 2012 and supported by NSF S-STEM award number 1644119 throughout 2016-2021, employs literature-based, best practices to support and retain underprepared and underrepresented students in engineering through graduation with the ultimate goal of diversifying the engineering workforce. A total of 71 students, including 21 students supported by S-STEM scholarships, participated in the AcES program between 2016-2019 at a large R1 institution in the mid-Atlantic region. All AcES students participate in a common program during their first year, comprised of: a one-week summer bridge experience, a common fall professional development course and spring “Engineering in History” course, and a common academic advisor. These students also have opportunities for: (1) faculty-student, student-student, and industry mentor-student interaction, (2) academic support and student success education, and (3) major and career exploration – all designed to help students develop feelings of institutional inclusion, engineering self-efficacy and identity, and academic and professional success skills. They also participate in the GRIT, Longitudinal Assessment of Engineering Self-Efficacy (LAESE), and the Motivated Strategies for Learning Questionnaire (MSLQ) surveys plus individual and focus group interviews at the start, midpoint, and end of each fall semester and at the end of the spring semester. The surveys provide a measure of students’ GRIT, their beliefs related to the intrinsic value of engineering and learning, their feelings of inclusion and test anxiety, and their self-efficacy related to engineering, math, and coping skills. The interviews provide information related to the student experience, feelings of inclusion, and program impact. Institutional data, combined with the survey and interview responses, are used to examine four research questions designed to examine the relationship of the elements of the AcES program to participants’ academic success and retention in engineering. Early analyses of the student retention data and survey responses from the 2017 and 2018 cohorts indicated students who ultimately left engineering before the start of their second year initially scored higher in areas of engineering self-efficacy and test anxiety, than those who stayed in engineering, while those who retained to the second year began their engineering education with lower self-efficacy scores, but higher scores related to the belief in the intrinsic value of engineering, learning strategy use, and coping self-efficacy. These results suggest that students who start with unrealistically high expectations of their performance leave engineering at higher rates than students who start with lower personal performance expectations, but have stronger value of the field and strategies for meeting challenges. These data appear to support the Kruger-Dunning effect in which students with limited knowledge of a specific field overestimate their abilities to perform in that area or underestimate the level of effort success may require. This paper will add an analysis of the academic success and retention data from 2019 cohort to this research, discuss the impact of COVID-19 to this program and research, as well as illuminate the quantitative results with the qualitative data from individual and focus group interviews regarding the aspects of the AcES program that impact student success, their expectations and methods for overcoming academic challenges, and their feelings of motivation and inclusion.more » « less
An official website of the United States government

