More Like this

1. Board 418: Understanding Context: Propagation and Effectiveness of the Concept Warehouse in Mechanical Engineering at Five Diverse Institutions and Beyond – Results from Year 4

   Self, B. P.; Koretsky, M.; Nolen, S. B.; Dal Bello, D. J.; Widmann, J. M.; Prince, M. J.; Papadopoulos, C. (June 2023, 2023 ASEE Annual Conference & Exposition)

   Several consensus reports cite a critical need to dramatically increase the number and diversity of STEM graduates over the next decade. They conclude that a change to evidence-based instructional practices, such as concept-based active learning, is needed. Concept-based active learning involves the use of activity-based pedagogies whose primary objectives are to make students value deep conceptual understanding (instead of only factual knowledge) and then to facilitate their development of that understanding. Concept-based active learning has been shown to increase academic engagement and student achievement, to significantly improve student retention in academic programs, and to reduce the performance gap of underrepresented students. Fostering students' mastery of fundamental concepts is central to real world problem solving, including several elements of engineering practice. Unfortunately, simply proving that these instructional practices are more effective than traditional methods for promoting student learning, for increasing retention in academic programs, and for improving ability in professional practice is not enough to ensure widespread pedagogical change. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist. In this project we seek to propagate the Concept Warehouse, a technological innovation designed to foster concept-based active learning, into Mechanical Engineering (ME) and to study student learning with this tool in five diverse institutional settings. The Concept Warehouse (CW) is a web-based instructional tool that we developed for Chemical Engineering (ChE) faculty. It houses over 3,500 ConcepTests, which are short questions that can rapidly be deployed to engage students in concept-oriented thinking and/or to assess students’ conceptual knowledge, along with more extensive concept-based active learning tools. The CW has grown rapidly during this project and now has over 1,600 faculty accounts and over 37,000 student users. New ConcepTests were created during the current reporting period; the current numbers of questions for Statics, Dynamics, and Mechanics of Materials are 342, 410, and 41, respectively. A detailed review process is in progress, and will continue through the no-cost extension year, to refine question clarity and to identify types of new questions to fill gaps in content coverage. There have been 497 new faculty accounts created after June 30, 2018, and 3,035 unique students have answered these mechanics questions in the CW. We continue to analyze instructor interviews, focusing on 11 cases, all of whom participated in the CW Community of Practice (CoP). For six participants, we were able to compare use of the CW both before and after participating in professional development activities (workshops and/or a community or practice). Interview results have been coded and are currently being analyzed. To examine student learning, we recruited faculty to participate in deploying four common questions in both statics and dynamics. In statics, each instructor agreed to deploy the same four questions (one each for Rigid Body Equilibrium, Trusses, Frames, and Friction) among their overall deployments of the CW. In addition to answering the question, students were also asked to provide a written explanation to explain their reasoning, to rate the confidence of their answers, and to rate the degree to which the questions were clear and promoted deep thinking. The analysis to date has resulted in a Work-In-Progress paper presented at ASEE 2022, reporting a cross-case comparison of two instructors and a Work-In-Progress paper to be presented at ASEE 2023 analyzing students’ metacognitive reflections of concept questions. 

   more » « less
2. Understanding Context: Propagation and Effectiveness of the Concept Warehouse in Mechanical Engineering at Five Diverse Institutions and Beyond – Results from Year 2

   https://doi.org/10.18260/1-2--35419  

   Self, B. P.; Koretsky, M. D.; Papadopoulos, C.; Widmann, J. M. (July 2021, ASEE annual conference exposition)

   It has been well-established that concept-based active learning strategies increase student retention, improve engagement and student achievement, and reduce the performance gap of underrepresented students. Despite the evidence supporting concept-based instruction, many faculty continue to stress algorithmic problem solving. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist. Our project aims to propagate the Concept Warehouse (CW), an online innovation tool that was developed in the Chemical Engineering community, into Mechanical Engineering (ME). A portion of our work focuses on content development in mechanics, and includes statics, dynamics, and to a lesser extent strength of materials. Our content development teams had created 170 statics and 253 dynamics questions. Additionally, we have developed four different simulations to be embedded in online Instructional Tools – these are interactive modules that provided different physical scenarios to help students understand important concepts in mechanics. During initial interviews, we found that potential adopters needed coaching on the benefits of concept-based instruction, training on how to use the CW, and support on how to best implement the different affordances offered by the CW. This caused a slight shift in our initial research plans, and much of our recent work has concentrated on using faculty development activities to help us advertise the CW and encourage evidence-based practices. From these activities, we are recruiting participants for surveys and interviews to help us investigate how different contexts affect the adoption of educational innovations. A set of two summer workshops attracted over 270 applicants, and over 60 participants attended each synchronous offering. Other applicants were provided links to recordings of the workshop. From these participants, we recruited 20 participants to join our Community of Practice (CoP). These members are sharing how they use the CW in their classes, especially in the virtual environment. Community members discuss using evidence-based practices, different things that the CW can do, and suggest potential improvements to the tool. They will also be interviewed to help us determine barriers to adoption, how their institutional contexts and individual epistemologies affect adoption, and how they have used the CW in their classes. Our research will help us formulate strategies that others can use when attempting to propagate pedagogical innovations. 

   more » « less
3. A Change Model that Helps Faculty Mentor Underrepresented Minorities (URM) Doctoral Students for the STEM Professoriate

   Grasso, M and (January 2020, The chronicle of mentoring coaching)

   In response to the well-documented themes of unique challenges URM doctoral student experience (tokenism, stereotyping, microaggressions, etc.), faculty mentoring remains an especially critical resource to change the trajectory for URM students in graduate education. The purpose of this study is to examine the frst two years of change in institutional culture which will increase the number of URM doctoral students who pursue the STEM professoriate. The primary research question asked is “Can a focus on developing and mentoring faculty catalyze change in the culture and practices of their doctoral programs to increase faculty diversity?” Based on the idea that faculty are drivers of lasting institutional change, three diverse public universities collaborate to adapt and implement an institutional change project, called “AGEP-NC Alliance: A Change Model for Doctoral to Faculty Diversity in STEM,” that prioritizes cultural frameworks for deep change in postsecondary education (Gumpertz et al., 2019). Key model components include faculty learning communities; use of national faculty mentoring networks; and use of institutional diversity data. Culturally relevant mentoring is among several approaches of interest to STEM reformers to shift the focus to institutional-level change and not student defciencies. Operationalized as “cultural integrity,” the approach calls upon students’ racial and ethnic backgrounds as assets for reform in pedagogies and learning activities, while valuing those backgrounds as critical ingredients for acquiring academic capital and career success (Tierney, 1999). Kezar’s (2018) cultural framework for institutional change emphasizes knowledge formation in context as well as analysis of espoused meaning and values organizational members maintain. The researchers present the AGEP-NC Alliance as a narrative, rich case study and collaborative mentoring model, an approach allowing participant researchers to detail sustained data use in collaborative social interaction (Patton, 1990). Results will be shared that highlight faculty as cultural change agents, and organizational learning as a cultural process. Preliminary results show evidence of institutional change at several levels from classroom and laboratory practices to key departmental policies. 

   more » « less
4. A Change Model that Helps Faculty Mentor Underrepresented Minorities (URM) Doctoral Students for the STEM Professoriate

   Grasso, M; Campbell, CD. (December 2020, The chronicle of mentoring coaching)

   In response to the well-documented themes of unique challenges URM doctoral student experience (tokenism, stereotyping, microaggressions, etc.), faculty mentoring remains an especially critical resource to change the trajectory for URM students in graduate education. The purpose of this study is to examine the first two years of change in institutional culture which will increase the number of URM doctoral students who pursue the STEM professoriate. The primary research question asked is “Can a focus on developing and mentoring faculty catalyze change in the culture and practices of their doctoral programs to increase faculty diversity?” Based on the idea that faculty are drivers of lasting institutional change, three diverse public universities collaborate to adapt and implement an institutional change project, called “AGEP-NC Alliance: A Change Model for Doctoral to Faculty Diversity in STEM,” that prioritizes cultural frameworks for deep change in postsecondary education (Gumpertz et al., 2019). Key model components include faculty learning communities; use of national faculty mentoring networks; and use of institutional diversity data. Culturally relevant mentoring is among several approaches of interest to STEM reformers to shift the focus to institutional-level change and not student deficiencies. Operationalized as “cultural integrity,” the approach calls upon students’ racial and ethnic backgrounds as assets for reform in pedagogies and learning activities, while valuing those backgrounds as critical ingredients for acquiring academic capital and career success (Tierney, 1999). Kezar’s (2018) cultural framework for institutional change emphasizes knowledge formation in context as well as analysis of espoused meaning and values organizational members maintain. The researchers present the AGEP-NC Alliance as a narrative, rich case study and collaborative mentoring model, an approach allowing participant researchers to detail sustained data use in collaborative social interaction (Patton, 1990). Results will be shared that highlight faculty as cultural change agents, and organizational learning as a cultural process. Preliminary results show evidence of institutional change at several levels from classroom and laboratory practices to key departmental policies. 

   more » « less
5. Not-so-secret watchers: What students can tell us about teaching

   Laursen, S; Archie, T (March 2025, Proceedings of the Annual Conference on Research in Undergraduate Mathematics Education)

   Cook, S; Katz, B P; Melhuish, K (Ed.)

   Projects to improve teaching as a means to improve learning need good tools to measure shifts in the use of effective research-based instructional strategies. We describe a survey tool to assess active and collaborative learning practices in college STEM by asking students to report what practices are used commonly in their course. Student reports correlate with their experience of the learning environment, and with their self-reported learning outcomes. Student means by section are corroborated by instructor-reported use of these practices and external observations. 

   more » « less