Several consensus reports cite a critical need to dramatically increase the number and diversity of STEM graduates over the next decade. They conclude that a change to evidence-based instructional practices, such as concept-based active learning, is needed. Concept-based active learning involves the use of activity-based pedagogies whose primary objectives are to make students value deep conceptual understanding (instead of only factual knowledge) and then to facilitate their development of that understanding. Concept-based active learning has been shown to increase academic engagement and student achievement, to significantly improve student retention in academic programs, and to reduce the performance gap of underrepresented students. Fostering students' mastery of fundamental concepts is central to real world problem solving, including several elements of engineering practice. Unfortunately, simply proving that these instructional practices are more effective than traditional methods for promoting student learning, for increasing retention in academic programs, and for improving ability in professional practice is not enough to ensure widespread pedagogical change. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist. In this project we seek to propagate the Concept Warehouse, a technological innovation designed to foster concept-based active learning, into Mechanical Engineering (ME) and to study student learning with this tool in five diverse institutional settings. The Concept Warehouse (CW) is a web-based instructional tool that we developed for Chemical Engineering (ChE) faculty. It houses over 3,500 ConcepTests, which are short questions that can rapidly be deployed to engage students in concept-oriented thinking and/or to assess students’ conceptual knowledge, along with more extensive concept-based active learning tools. The CW has grown rapidly during this project and now has over 1,600 faculty accounts and over 37,000 student users. New ConcepTests were created during the current reporting period; the current numbers of questions for Statics, Dynamics, and Mechanics of Materials are 342, 410, and 41, respectively. A detailed review process is in progress, and will continue through the no-cost extension year, to refine question clarity and to identify types of new questions to fill gaps in content coverage. There have been 497 new faculty accounts created after June 30, 2018, and 3,035 unique students have answered these mechanics questions in the CW. We continue to analyze instructor interviews, focusing on 11 cases, all of whom participated in the CW Community of Practice (CoP). For six participants, we were able to compare use of the CW both before and after participating in professional development activities (workshops and/or a community or practice). Interview results have been coded and are currently being analyzed. To examine student learning, we recruited faculty to participate in deploying four common questions in both statics and dynamics. In statics, each instructor agreed to deploy the same four questions (one each for Rigid Body Equilibrium, Trusses, Frames, and Friction) among their overall deployments of the CW. In addition to answering the question, students were also asked to provide a written explanation to explain their reasoning, to rate the confidence of their answers, and to rate the degree to which the questions were clear and promoted deep thinking. The analysis to date has resulted in a Work-In-Progress paper presented at ASEE 2022, reporting a cross-case comparison of two instructors and a Work-In-Progress paper to be presented at ASEE 2023 analyzing students’ metacognitive reflections of concept questions.
more »
« less
Understanding Context: Propagation and Effectiveness of the Concept Warehouse in Mechanical Engineering at Five Diverse Institutions and Beyond – Results from Year 1.
Several consensus reports cite a critical need to dramatically increase the number and diversity of STEM graduates over the next decade. They conclude that a change to evidence-based instructional practices, such as concept-based active learning, is needed. Concept-based active learning involves the use of activity-based pedagogies whose primary objectives are to make students value deep conceptual understanding (instead of only factual knowledge) and then to facilitate their development of that understanding. Concept-based active learning has been shown to increase academic engagement and student achievement, to significantly improve student retention in academic programs, and to reduce the performance gap of underrepresented students.
Fostering students' mastery of fundamental concepts is central to real world problem solving, including several elements of engineering practice. Unfortunately, simply proving that these instructional practices are more effective than traditional methods is not enough to ensure widespread pedagogical change. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist.
more »
« less
- Award ID(s):
- 1821638
- NSF-PAR ID:
- 10172020
- Date Published:
- Journal Name:
- ASEE Annual Conference proceedings
- ISSN:
- 1524-4644
- Page Range / eLocation ID:
- https://peer.asee.org/35419
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
It has been well-established that concept-based active learning strategies increase student retention, improve engagement and student achievement, and reduce the performance gap of underrepresented students. Despite the evidence supporting concept-based instruction, many faculty continue to stress algorithmic problem solving. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist. Our project aims to propagate the Concept Warehouse (CW), an online innovation tool that was developed in the Chemical Engineering community, into Mechanical Engineering (ME). A portion of our work focuses on content development in mechanics, and includes statics, dynamics, and to a lesser extent strength of materials. Our content development teams had created 170 statics and 253 dynamics questions. Additionally, we have developed four different simulations to be embedded in online Instructional Tools – these are interactive modules that provided different physical scenarios to help students understand important concepts in mechanics. During initial interviews, we found that potential adopters needed coaching on the benefits of concept-based instruction, training on how to use the CW, and support on how to best implement the different affordances offered by the CW. This caused a slight shift in our initial research plans, and much of our recent work has concentrated on using faculty development activities to help us advertise the CW and encourage evidence-based practices. From these activities, we are recruiting participants for surveys and interviews to help us investigate how different contexts affect the adoption of educational innovations. A set of two summer workshops attracted over 270 applicants, and over 60 participants attended each synchronous offering. Other applicants were provided links to recordings of the workshop. From these participants, we recruited 20 participants to join our Community of Practice (CoP). These members are sharing how they use the CW in their classes, especially in the virtual environment. Community members discuss using evidence-based practices, different things that the CW can do, and suggest potential improvements to the tool. They will also be interviewed to help us determine barriers to adoption, how their institutional contexts and individual epistemologies affect adoption, and how they have used the CW in their classes. Our research will help us formulate strategies that others can use when attempting to propagate pedagogical innovations.more » « less
-
In response to the well-documented themes of unique challenges URM doctoral student experience (tokenism, stereotyping, microaggressions, etc.), faculty mentoring remains an especially critical resource to change the trajectory for URM students in graduate education. The purpose of this study is to examine the frst two years of change in institutional culture which will increase the number of URM doctoral students who pursue the STEM professoriate. The primary research question asked is “Can a focus on developing and mentoring faculty catalyze change in the culture and practices of their doctoral programs to increase faculty diversity?” Based on the idea that faculty are drivers of lasting institutional change, three diverse public universities collaborate to adapt and implement an institutional change project, called “AGEP-NC Alliance: A Change Model for Doctoral to Faculty Diversity in STEM,” that prioritizes cultural frameworks for deep change in postsecondary education (Gumpertz et al., 2019). Key model components include faculty learning communities; use of national faculty mentoring networks; and use of institutional diversity data. Culturally relevant mentoring is among several approaches of interest to STEM reformers to shift the focus to institutional-level change and not student defciencies. Operationalized as “cultural integrity,” the approach calls upon students’ racial and ethnic backgrounds as assets for reform in pedagogies and learning activities, while valuing those backgrounds as critical ingredients for acquiring academic capital and career success (Tierney, 1999). Kezar’s (2018) cultural framework for institutional change emphasizes knowledge formation in context as well as analysis of espoused meaning and values organizational members maintain. The researchers present the AGEP-NC Alliance as a narrative, rich case study and collaborative mentoring model, an approach allowing participant researchers to detail sustained data use in collaborative social interaction (Patton, 1990). Results will be shared that highlight faculty as cultural change agents, and organizational learning as a cultural process. Preliminary results show evidence of institutional change at several levels from classroom and laboratory practices to key departmental policies.more » « less
-
In response to the well-documented themes of unique challenges URM doctoral student experience (tokenism, stereotyping, microaggressions, etc.), faculty mentoring remains an especially critical resource to change the trajectory for URM students in graduate education. The purpose of this study is to examine the first two years of change in institutional culture which will increase the number of URM doctoral students who pursue the STEM professoriate. The primary research question asked is “Can a focus on developing and mentoring faculty catalyze change in the culture and practices of their doctoral programs to increase faculty diversity?” Based on the idea that faculty are drivers of lasting institutional change, three diverse public universities collaborate to adapt and implement an institutional change project, called “AGEP-NC Alliance: A Change Model for Doctoral to Faculty Diversity in STEM,” that prioritizes cultural frameworks for deep change in postsecondary education (Gumpertz et al., 2019). Key model components include faculty learning communities; use of national faculty mentoring networks; and use of institutional diversity data. Culturally relevant mentoring is among several approaches of interest to STEM reformers to shift the focus to institutional-level change and not student deficiencies. Operationalized as “cultural integrity,” the approach calls upon students’ racial and ethnic backgrounds as assets for reform in pedagogies and learning activities, while valuing those backgrounds as critical ingredients for acquiring academic capital and career success (Tierney, 1999). Kezar’s (2018) cultural framework for institutional change emphasizes knowledge formation in context as well as analysis of espoused meaning and values organizational members maintain. The researchers present the AGEP-NC Alliance as a narrative, rich case study and collaborative mentoring model, an approach allowing participant researchers to detail sustained data use in collaborative social interaction (Patton, 1990). Results will be shared that highlight faculty as cultural change agents, and organizational learning as a cultural process. Preliminary results show evidence of institutional change at several levels from classroom and laboratory practices to key departmental policies.more » « less
-
more » « less
Abstract Background An instructor’s conceptions of teaching and learning contribute to the establishment of learning environments that may benefit or hinder student learning. Previous studies have defined the continuum of teaching and learning conceptions, ranging from limited to complete, as well as the instructional practices that they help to inform (instructor-centered to student-centered), and the corresponding learning environments that these conceptions and practices establish, ranging from traditional to student-centered. Using the case of one STEM department at a research-intensive, minority serving institution, we explored faculty’s conceptions of teaching and learning and their resulting instructional practices, as well as uncovered their perspectives on the intradepartmental faculty interactions related to teaching. The study participants were drawn from both teaching-focused (called Professors of Teaching, PoTs) and traditional research (whom we call Research Professors, RPs) tenure-track faculty lines to identify whether differences existed amongst these two populations. We used interviews to explore faculty conceptions and analyzed syllabi to unveil how these conceptions shape instructional environments.
Results Overall, PoTs exhibited complete conceptions of teaching and learning that emphasized student ownership of learning, whereas RPs possessed intermediate conceptions that focused more on transmitting knowledge and helping students prepare for subsequent courses. While both PoTs and RPs self-reported the use of active learning pedagogies, RPs were more likely to also highlight the importance of traditional lecture. The syllabi analysis revealed that PoTs enacted more student-centered practices in their classrooms compared to RPs. PoTs appeared to be more intentionally available to support students outside of class and encouraged student collaboration, while RPs focused more on the timeliness of assessments and enforcing more instructor-centered approaches in their courses. Finally, the data indicated that RPs recognized PoTs as individuals who were influential on their own teaching conceptions and practices.
Conclusions Our findings suggest that departments should consider leveraging instructional experts who also possess a disciplinary background (PoTs) to improve their educational programs, both due to their student-centered impacts on the classroom environment and positive influence on their colleagues (RPs). This work also highlights the need for higher education institutions to offer appropriate professional development resources to enable faculty to reflect on their teaching and learning conceptions, aid in their pedagogical evolution, and guide the implementation of these conceptions into practice.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
