Background: The National Science Foundation (NSF) and other organizations have spent millions of dollars each year supporting well-designed educational innovations that positively impact the undergraduate engineering students who encounter them. However, many of these pedagogical innovations never experience widespread adoption. To further the ability of innovation developers to advance engineering education practice and achieve sustained adoption of their innovations, this paper explores how one community-based model, engineering education guilds, fosters propagation across institutions and individuals. Engineering education guilds seek to work at the forefront of educational innovation by creating networks of instructor change-agents who design and implement a particular innovation in their own context. The guilds of interest are the Consortium to Promote Reflection in Engineering Education (CPREE) and the Kern Entrepreneurial Engineering Network (KEEN). With these guilds as exemplars, this study’s purpose is (1) to articulate how the approaches of engineering education guilds align with existing literature on supporting sustained adoption of educational innovations and (2) to identify how these approaches can advance the science, technology, engineering and math (STEM) education community’s discussion of propagation practices through the use of the Designing for Sustained Adoption Assessment Instrument (DSAAI). The DSAAI is a conceptual framework based on research in sustained adoption of pedagogical innovations. It has previously been used in the form of a rubric to analyze dissemination and propagation plans of NSF educational grant recipients and was shown to predict the effectiveness of those propagation plans. Results: Through semi-structured interviews with two leaders from each guild, we observed strong alignment between the structures of CRPEE and KEEN and evidence-based sustained adoption characteristics. For example, both guilds identified their intended audience early in their formation, developed and implemented extensive plans for engaging and supporting potential adopters, and accounted for the complexity of the higher education landscape and their innovations in their propagation plans. Conclusions: Our results suggest that guilds could provide another approach to innovation, as their structures can be aligned with evidence-based methods for propagating pedagogical innovations. Additionally, while the DSAAI captures many of the characteristics of a welld-esigned propagation strategy, there are additional components that emerged as successful strategies used by the CPREE and KEEN guild leaders. These strategies, including having mutual accountability among adopters and connecting adoption of innovations to faculty reward structures in the form of recognition and funding should be considered as educational innovators work to encourage adoption of their innovations.
more »
« less
Adoption of Pedagogical Innovations: Resource Networks of Engineering Education Guilds
This Full Research paper uses resource network analysis to explore what resources faculty use when they make changes to their pedagogy, and how an engineering education “guild” is situated among those resources. The process of influencing
pedagogical change can be understood as lying along a spectrum. On one end of the spectrum is the dissemination model, where research is simply made available and instructors are expected to seek out new tools. On the other end is the propagation model, where researchers, developers, and instructors work as one cohesive team to get innovative tools into classrooms. While each of these models and the instructor
resources associated with them have been separately studied and defined, approaches on the spectrum between them remain understudied. Engineering education guilds employ an approach that falls along the dissemination-propagation spectrum; they
use both dissemination and propagation techniques to influence pedagogical changes. Despite lack of formal research on the subject, engineering education “guilds” have become an increasinglypopular vehicle for pedagogical change in engineering education
classrooms. One such engineering education guild is the Kern Entrepreneurial Engineering Network (KEEN), which is focused on integrating entrepreneurial mindset (EM) into engineering curricula. By constructing resource networks for educators who
have been exposed to KEEN, we aim to understand the role of KEEN among the myriad resources used by engineering educators when they integrate EM-related content into their classrooms. Results suggest that engineering education guilds are central to the resource networks of faculty looking to innovate their pedagogy, with the most popular resources all falling under the guild’s umbrella. These resources are also strongly interconnected, especially during the integration process. However, the resources networks of those who saw successful, complete, sustained adoption reached beyond the guild’s umbrella, forging connections with a variety of other materials from different sources.
more »
« less
- Award ID(s):
- 1927268
- NSF-PAR ID:
- 10300827
- Date Published:
- Journal Name:
- Frontiers in education
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Engineering education guilds, such as the Consortium to Promote Reflection in Engineering Education (CPREE) and the Kern Entrepreneurial Engineering Network (KEEN), seek to work at the forefront of educational innovation by creating networks of instructor change agents who design and implement a particular innovation in their own context to further the professional formation of engineers (PFE). While many of the innovations facilitated by CPREE and KEEN have been published extensively, it is unclear how successful the propagation of reflection and entrepreneurial mindset has been in the engineering education community. The major aim of this project is to characterize these two engineering education guilds with respect to their dissemination/propagation plans and, in the future, quantify the propagation of the innovations championed by CPREE and KEEN. The research questions we seek to answer in this paper are: (1) What are the planned dissemination/propagation approaches of well-established engineering education guilds? and (2) To what extent do their characteristics align with the Designing for Sustained Adoption Assessment Instrument (DSAAI)? The DSAAI was developed in 2016 to provide education developers, grant writing consultants, and funding agencies with a tool for assessing the propagation plans of researchers developing educational change strategies. To answer these questions, we conducted semi-structured interviews with the leaders of CPREE and KEEN. The transcriptions of the interviews will be used to create within-case reports for each guild. The within-case reports will consist of a rich description of the pedagogical innovation as well as the history of the guild and its goals. Using the DSAAI, we will qualitatively code the techniques that each guild is using to facilitate widespread adoption as well as the extent to which they are following a dissemination or propagation paradigm. Lastly, thematic analysis will be used to capture emerging themes that arise from the interviews.more » « less
-
more » « less
This work investigates how innovations propagate through two professional networks (guilds): the Kern Entrepreneurial Engineering Network (KEEN) and the Consortium to Promote Reflection in Engineering Education (CPREE). Previous research has demonstrated that the adoption of pedagogical innovations is supported by the socialization of the innovation among potential adopters. In this work, we use social network analysis to explore the impact of professional connections on innovation adoption. Our research questions are: (1) How does overall social structure differ between guilds? (2) How do measures of social network structures relate to innovation adoption? A survey was distributed to members of KEEN and CPREE to capture the interactions respondents had while adopting the guild’s innovation. Social networks were generated for each guild and each respondent. These networks were analyzed to identify relationships between social network measures and the frequency of use of the innovation. Responses to open-ended questions were analyzed using thematic coding. The guilds’ overall structures impacted the formation and structure of distinct clusters/cliques, but these differing structures did not appear to affect sustained adoption. Individuals’ ego networks demonstrated a weak negative correlation between the frequency of adoption and the individual’s ego network density. Our results imply that having a diverse network exposes instructors to more ideas or allows them to see one idea from many perspectives.
-
null (Ed.)Over the past two decades, educators have used computer-supported collaborative learning (CSCL) to integrate technology with pedagogy to improve student engagement and learning outcomes. Researchers have also explored the diverse affordances of CSCL, its contributions to engineering instruction, and its effectiveness in K-12 STEM education. However, the question of how students use CSCL resources in undergraduate engineering classrooms remains largely unexplored. This study examines the affordances of a CSCL environment utilized in a sophomore dynamics course with particular attention given to the undergraduate engineering students’ use of various CSCL resources. The resources include a course lecturebook, instructor office hours, a teaching assistant help room, online discussion board, peer collaboration, and demonstration videos. This qualitative study uses semi-structured interview data collected from nine mechanical engineering students (four women and five men) who were enrolled in a dynamics course at a large public research university in Eastern Canada. The interviews focused on the individual student’s perceptions of the school, faculty, students, engineering courses, and implemented CSCL learning environment. The thematic analysis was conducted to analyze the transcribed interviews using a qualitative data analysis software (Nvivo). The analysis followed a six step process: (1) reading interview transcripts multiple times and preliminary in vivo codes; (2) conducting open coding by coding interesting or salient features of the data; (3) collecting codes and searching for themes; (4) reviewing themes and creating a thematic map; (5) finalizing themes and their definitions; and (6) compiling findings. This study found that the students’ use of CSCL resources varied depending on the students’ personal preferences, as well as their perceptions of the given resource’s value and its potential to enhance their learning. For example, the dynamics lecturebook, which had been redesigned to encourage problem solving and note-taking, fostered student collaborative problem solving with their peers. In contrast, the professor’s example video solutions had much more of an influence on students’ independent problem-solving processes. The least frequently used resource was the course’s online discussion forum, which could be used as a means of communication. The findings reveal how computer-supported collaborative learning (CSCL) environments enable engineering students to engage in multiple learning opportunities with diverse and flexible resources to both address and to clarify their personal learning needs. This study strongly recommends engineering instructors adapt a CSCL environment for implementation in their own unique classroom context.more » « less
-
In this work-in-progress paper, we continue investigation into the propagation of the Concept Warehouse within mechanical engineering (Friedrichsen et al., 2017; Koretsky et al., 2019a). Even before the pandemic forced most instruction online, educational technology was a growing element in classroom culture (Koretsky & Magana, 2019b). However, adoption of technology tools for widespread use is often conceived from a turn-key lens, with professional development focused on procedural competencies and fidelity of implementation as the goal (Mills & Ragan, 2000; O’Donnell, 2008). Educators are given the tool with initial operating instructions, then left on their own to implement it in particular instructional contexts. There is little emphasis on the inevitable instructional decisions around incorporating the tool (Hodge, 2019) or on sustainable incorporation of technologies into existing instructional practice (Forkosh-Baruch et al., 2021). We consider the take-up of a technology tool as an emergent, rather than a prescribed process (Henderson et al., 2011). In this WIP paper, we examine how two instructors who we call Al and Joe reason through their adoption of a technology tool, focusing on interactions among instructors, tool, and students within and across contexts. The Concept Warehouse (CW) is a widely-available, web-based, open educational technology tool used to facilitate concept-based active learning in different contexts (Friedrichsen et al., 2017; Koretsky et al., 2014). Development of the CW is ongoing and collaboration-driven, where user-instructors from different institutions and disciplines can develop conceptual questions (called ConcepTests) and other learning and assessment tools that can be shared with other users. Currently there are around 3,500 ConcepTests, 1,500 faculty users, and 36,000 student users. About 700 ConcepTests have been developed for mechanics (statics and dynamics). The tool’s spectrum of affordances allows different entry points for instructor engagement, but also allows their use to grow and change as they become familiar with the tool and take up ideas from the contexts around them. Part of a larger study of propagation and use across five diverse institutions (Nolen & Koretsky, 2020), instructors were introduced to the tool, offered an introductory workshop and opportunity to participate in a community of practice (CoP), then interviewed early and later in their adoption. For this paper, we explore a bounded case study of the two instructors, Al and Joe, who took up the CW to teach Introductory Statics. Al and Joe were experienced instructors, committed to active learning, who presented examples from their ongoing adaptation of the tool for discussion in the community of practice. However, their decisions about how to integrate the tool fundamentally differed, including the aspects of the tool they took up and the ways they made sense of their use. In analyzing these two cases, we begin to uncover how these instructors navigated the dynamic nature of pedagogical decision making in and across contexts.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
