Several consensus reports cite a critical need to dramatically increase the number and diversity of STEM graduates over the next decade. They conclude that a change to evidence-based instructional practices, such as concept-based active learning, is needed. Concept-based active learning involves the use of activity-based pedagogies whose primary objectives are to make students value deep conceptual understanding (instead of only factual knowledge) and then to facilitate their development of that understanding. Concept-based active learning has been shown to increase academic engagement and student achievement, to significantly improve student retention in academic programs, and to reduce the performance gap of underrepresented students. Fostering students' mastery of fundamental concepts is central to real world problem solving, including several elements of engineering practice. Unfortunately, simply proving that these instructional practices are more effective than traditional methods for promoting student learning, for increasing retention in academic programs, and for improving ability in professional practice is not enough to ensure widespread pedagogical change. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist. In this project we seek to propagate the Concept Warehouse, a technological innovation designed to foster concept-based active learning, into Mechanical Engineering (ME) and to study student learning with this tool in five diverse institutional settings. The Concept Warehouse (CW) is a web-based instructional tool that we developed for Chemical Engineering (ChE) faculty. It houses over 3,500 ConcepTests, which are short questions that can rapidly be deployed to engage students in concept-oriented thinking and/or to assess students’ conceptual knowledge, along with more extensive concept-based active learning tools. The CW has grown rapidly during this project and now has over 1,600 faculty accounts and over 37,000 student users. New ConcepTests were created during the current reporting period; the current numbers of questions for Statics, Dynamics, and Mechanics of Materials are 342, 410, and 41, respectively. A detailed review process is in progress, and will continue through the no-cost extension year, to refine question clarity and to identify types of new questions to fill gaps in content coverage. There have been 497 new faculty accounts created after June 30, 2018, and 3,035 unique students have answered these mechanics questions in the CW. We continue to analyze instructor interviews, focusing on 11 cases, all of whom participated in the CW Community of Practice (CoP). For six participants, we were able to compare use of the CW both before and after participating in professional development activities (workshops and/or a community or practice). Interview results have been coded and are currently being analyzed. To examine student learning, we recruited faculty to participate in deploying four common questions in both statics and dynamics. In statics, each instructor agreed to deploy the same four questions (one each for Rigid Body Equilibrium, Trusses, Frames, and Friction) among their overall deployments of the CW. In addition to answering the question, students were also asked to provide a written explanation to explain their reasoning, to rate the confidence of their answers, and to rate the degree to which the questions were clear and promoted deep thinking. The analysis to date has resulted in a Work-In-Progress paper presented at ASEE 2022, reporting a cross-case comparison of two instructors and a Work-In-Progress paper to be presented at ASEE 2023 analyzing students’ metacognitive reflections of concept questions.
more »
« less
Understanding Context: Propagation and Effectiveness of the Concept Warehouse in Mechanical Engineering at Five Diverse Institutions and Beyond – Results from Year 1.
Several consensus reports cite a critical need to dramatically increase the number and diversity of STEM graduates over the next decade. They conclude that a change to evidence-based instructional practices, such as concept-based active learning, is needed. Concept-based active learning involves the use of activity-based pedagogies whose primary objectives are to make students value deep conceptual understanding (instead of only factual knowledge) and then to facilitate their development of that understanding. Concept-based active learning has been shown to increase academic engagement and student achievement, to significantly improve student retention in academic programs, and to reduce the performance gap of underrepresented students.
Fostering students' mastery of fundamental concepts is central to real world problem solving, including several elements of engineering practice. Unfortunately, simply proving that these instructional practices are more effective than traditional methods is not enough to ensure widespread pedagogical change. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist.
more »
« less
- Award ID(s):
- 1821638
- PAR ID:
- 10172020
- Date Published:
- Journal Name:
- ASEE Annual Conference proceedings
- ISSN:
- 1524-4644
- Page Range / eLocation ID:
- https://peer.asee.org/35419
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Supporting changes in undergraduate science, technology, engineering, and mathematics (STEM) instruction requires an understanding of the relationship between STEM instructors' conceptions and practices. In this study, the authors used the Teacher‐Centered Systematic Reform (TCSR) model as a framework to understand how instructors' conceptions are related to their instructional practices. This multiple methods study included interviews and classroom observations of 22 STEM instructors. We used qualitative methods to describe instructors' conceptions of how students learn and quantitative methods, including a hierarchical cluster analysis, to analyze the types of relationships that exist between their conceptions and practices. Results indicated instructors had a wide range of conceptions that exist along a continuum from teacher‐centered to student‐centered. While many faculty members perceived student‐centered practices as valuable, they conceptualized these practices in different ways. Instructors implemented a wide range of instructional practices, and these practices varied independently of conceptions. We identified three distinct clusters of participants based on the relationships between instructors' conceptions and practices: congruent lecturers, congruent active learning facilitators, and incongruent lecturers. In the first two clusters, instructors' conceptions were aligned with their instructional practices. However, incongruent lecturers thought that students learn through active learning approaches but primarily lectured in their courses. Instructors in this group described several personal and contextual factors that influenced the relationship between their conceptions and practices. The results include an in‐depth portrayal of one participant in each cluster. We found that student‐centered conceptions may be necessary but are not sufficient for instructors to implement active learning. Implications focus on instructional and institutional change efforts. To promote instructional change most effectively, it is important to address each component of the TCSR model, including personal and contextual factors. A focus on conceptions and practices alone may not sufficiently support faculty members in overcoming barriers that limit active learning instruction.
-
It has been well-established that concept-based active learning strategies increase student retention, improve engagement and student achievement, and reduce the performance gap of underrepresented students. Despite the evidence supporting concept-based instruction, many faculty continue to stress algorithmic problem solving. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist. Our project aims to propagate the Concept Warehouse (CW), an online innovation tool that was developed in the Chemical Engineering community, into Mechanical Engineering (ME). A portion of our work focuses on content development in mechanics, and includes statics, dynamics, and to a lesser extent strength of materials. Our content development teams had created 170 statics and 253 dynamics questions. Additionally, we have developed four different simulations to be embedded in online Instructional Tools – these are interactive modules that provided different physical scenarios to help students understand important concepts in mechanics. During initial interviews, we found that potential adopters needed coaching on the benefits of concept-based instruction, training on how to use the CW, and support on how to best implement the different affordances offered by the CW. This caused a slight shift in our initial research plans, and much of our recent work has concentrated on using faculty development activities to help us advertise the CW and encourage evidence-based practices. From these activities, we are recruiting participants for surveys and interviews to help us investigate how different contexts affect the adoption of educational innovations. A set of two summer workshops attracted over 270 applicants, and over 60 participants attended each synchronous offering. Other applicants were provided links to recordings of the workshop. From these participants, we recruited 20 participants to join our Community of Practice (CoP). These members are sharing how they use the CW in their classes, especially in the virtual environment. Community members discuss using evidence-based practices, different things that the CW can do, and suggest potential improvements to the tool. They will also be interviewed to help us determine barriers to adoption, how their institutional contexts and individual epistemologies affect adoption, and how they have used the CW in their classes. Our research will help us formulate strategies that others can use when attempting to propagate pedagogical innovations.more » « less
-
Instructional shifts required by equitable, reform‐based science instruction are challenging, especially in the elementary context. Such shifts require professional development (PD) that supports teacher internalization of new pedagogical strategies as well as changes in beliefs about how students learn. Because of this complexity, many PD programs struggle to foster lasting pedagogical shifts, necessitating further investigation into why some teachers successfully embrace reform practices while others do not. This qualitative study uses a nonlinear, iterative model of teacher learning (Interconnected Model of Professional Growth; Clarke & Hollingsworth, 2002) alongside professional noticing to help understand why elementary teachers in science PD differentially make sense of and internalize new pedagogies. Findings indicate that teachers most likely to adopt reform‐based instructional practices from the PD were those who clearly connected student learning to their instructional moves. In addition, teachers who more actively attended to student sensemaking and productive struggle took up pedagogies from the PD more substantively than did colleagues who attended solely to student engagement and affect. Finally, teachers who attended to and valued novel ideas from students’ lived experiences were more likely to change their beliefs about students’ capacity to learn science, and thus more likely to see the value of instructional practices from the PD. In sum, structuring PD to build on these specific teacher noticing skills can encourage more teachers to move away from traditional, teacher‐directed instructional practice, and more fully support reform‐based instructional practices.more » « less
-
While student-centered learning has been shown to improve learning experiences in the engineering classroom, adoption of these evidence-based strategies has been slow. Research has shown that faculty beliefs about teaching and limited exposure to formal training influence effective implementation of evidenced-based instructional practices. Thus, in an effort to explore ways to implement long-term instructional change in engineering higher education, a graduate-level course, the Instructional Incubator (I2), was developed to expose future educators to instructional design and evidence-based practices. In the I2, student participants developed new biomedical engineering short-courses in an active learning classroom. For the first two iterations of the I2, we examined how this immersive experience influenced participants’ perceived teaching abilities and understanding before and after enrolling in the I2. Both I2 cohorts reported an increase in knowledge of engineering education related terms and showed a shift away from behaviorist and cognitive beliefs about teaching and learning. Introductionmore » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
