An official website of the United States government
Abstract This paper provides an experience report on a co‐design approach with teachers to co‐create learning analytics‐based technology to support problem‐based learning in middle school science classrooms. We have mapped out a workflow for such applications and developed design narratives to investigate the implementation, modifications and temporal roles of the participants in the design process. Our results provide precedent knowledge on co‐designing with experienced and novice teachers and co‐constructing actionable insight that can help teachers engage more effectively with their students' learning and problem‐solving processes during classroom PBL implementations. Practitioner notesWhat is already known about this topicSuccess of educational technology depends in large part on the technology's alignment with teachers' goals for their students, teaching strategies and classroom context.Teacher and researcher co‐design of educational technology and supporting curricula has proven to be an effective way for integrating teacher insight and supporting their implementation needs.Co‐designing learning analytics and support technologies with teachers is difficult due to differences in design and development goals, workplace norms, and AI‐literacy and learning analytics background of teachers.What this paper addsWe provide a co‐design workflow for middle school teachers that centres on co‐designing and developing actionable insights to support problem‐based learning (PBL) by systematic development of responsive teaching practices using AI‐generated learning analytics.We adapt established human‐computer interaction (HCI) methods to tackle the complex task of classroom PBL implementation, working with experienced and novice teachers to create a learning analytics dashboard for a PBL curriculum.We demonstrate researcher and teacher roles and needs in ensuring co‐design collaboration and the co‐construction of actionable insight to support middle school PBL.Implications for practice and/or policyLearning analytics researchers will be able to use the workflow as a tool to support their PBL co‐design processes.Learning analytics researchers will be able to apply adapted HCI methods for effective co‐design processes.Co‐design teams will be able to pre‐emptively prepare for the difficulties and needs of teachers when integrating middle school teacher feedback during the co‐design process in support of PBL technologies.
more »
« less
This content will become publicly available on September 19, 2026
Exploring AI intervention points in high-school engineering education: a research through co-design approach
PurposeChallenges in teaching the engineering design process (EDP) at the high-school level, such as promoting good documentation practices, are well-documented. While developments in educational artificial intelligence (AI) systems have the potential to assist in addressing these challenges, the open-ended nature of the EDP leads to challenges that often lack the specificity required for actionable AI development. In addition, conventional educational AI systems (e.g. intelligent tutoring systems) primarily target procedural domain tasks with well-defined outcomes and problem-solving strategies, while the EDP involves open-ended problems and multiple correct solutions, making AI intervention timing and appropriateness complex. Design/methodology/approachAuthors conducted a six-week-long Research through Co-Design (RtCD) process (i.e. a co-design process rooted in Research through Design) with two experienced high-school engineering teachers to co-construct actionable insight in the form of AI intervention points (AI-IPs) in engineering education where an AI system can effectively intervene to support them while highlighting their pedagogical practices. FindingsThis paper leveraged the design of task models to iteratively refine our prior understanding of teachers’ experiences with teaching the EDP into three AI-IPs related to documentation, ephemeral interactions between teachers and students and disruptive failures that can serve as a focus for intelligent educational system designs. Originality/valueThis paper discusses the implications of these AI-IPs for designing educational AI systems to support engineering education as well as the importance of leveraging RtCD methodologies to engage teachers in developing intelligent educational systems that align with their needs and afford them control over computational interventions in their classrooms.
more »
« less
- Award ID(s):
- 2119135
- PAR ID:
- 10652153
- Publisher / Repository:
- Emerald Insight
- Date Published:
- Journal Name:
- Information and Learning Sciences
- Volume:
- 126
- Issue:
- 7-8
- ISSN:
- 2398-5348
- Page Range / eLocation ID:
- 472 to 490
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
3D printing (3DP) has been becoming more and more popular throughout the education system from Kindergarten to University. High school is a critical period for students to decide their imminent university major selection which in turn will impact their future career choices. High school students are usually intrigued by hands-on tool such as 3DP which is also an important contributor to other courses such as robotics. The recent years have seen more investment and availability of 3DP in high schools, especially Career and Technical Education (CTE) programs. However, mere availability of 3DP is not enough for teachers to fully utilize its potential in their classrooms. While basic 3DP skills can be obtained through a few hours of training, the basic training is insufficient to ensure effective teaching Engineering Design Process (EDP) at the high school level. To address this problem, this project develops an EDP course tightly integrated with 3DP for preservice teachers (PST) who are going to enter the workforce in high schools. Engineering design process (EDP) has become an essential part for preservice teachers (PST), especially for high school STEM. 3DP brought transformative change to EDP which is an iterative process that needs virtual/physical prototyping. The new PST course on EDP will be purposefully integrated with an in-depth discussion of 3DP. The approach is to dissect a 3D printer’s hardware, explain each component’s function, introduce each component’s manufacturing methods, describe possible defects, and elucidate what works and what does not. This has at least four benefits: 1) PSTs will know what is possibly wrong when a printer or printing process fails, 2) PSTs will learn more manufacturing processes besides 3DP that can be used to support engineering design prototyping, 3) PSTs will know how to design something that can meet the manufacturing constraints, i.e., can be actually fabricated, and 4) reduce errors and frustrations caused by failed design and failed prints which happen frequently to novices in 3DP. After graduation, PSTs will bring the knowledge to their future high schools and will be more confident in teaching engineering design, reverse engineering, prototype development, manufacturing, and technology. The developed course will be implemented and assessed in a future semester.more » « less
-
The rapid expansion of Artificial Intelligence (AI) necessitates educating all students about AI. This, however, poses great challenges because most K-12 teachers have limited prior knowledge or experience of teaching AI. This exploratory study reports the design of an online professional development program aimed at preparing teachers for teaching AI in classrooms. The program includes a book club where teachers read a book about AI and learned key activities of an AI curriculum developed for middle schoolers, and a 2-week practicum where teachers co-taught the curriculum in a summer camp. The participants were 17 teachers from three school districts across the United States. Analysis of their surveys revealed an increase in teachers’ content knowledge and self-efficacy in teaching AI. Teachers reported that the book club taught them AI concepts and the practicum sharpened their teaching practices. Our findings reveal valuable insights on teacher training for the AI education field.more » « less
-
This research paper describes a study of elementary teacher learning in an online graduate program in engineering education for in-service teachers. While the existing research on teachers in engineering focuses on their disciplinary understandings and beliefs (Hsu, Cardella, & Purzer, 2011; Martin, et al., 2015; Nadelson, et al., 2015; Van Haneghan, et al., 2015), there is increasing attention to teachers' pedagogy in engineering (Capobianco, Delisi, & Radloff, 2018). In our work, we study teachers' pedagogical sense-making and reflection, which, we argue, is critical for teaching engineering design. This study takes place in [blinded] program, in which teachers take four graduate courses over fifteen months. The program was designed to help teachers not only learn engineering content, but also shift their thinking and practice to be more responsive to their students. Two courses focus on pedagogy, including what it means to learn engineering and instructional approaches to support this learning. These courses consist of four main elements, in which teachers: 1) Read data-rich engineering education articles to reflect on learning engineering; 2) Participate in online video clubs, looking at classroom videos of students’ engineering and commenting on what they notice; 3) Conduct interviews with learners about the mechanism of a pull-back car; and 4) Plan and teach engineering lessons, collecting and analyzing video from their classrooms. In the context of this program, we ask: what stances do teachers take toward learning and teaching engineering design? What shifts do we observe in their stances? We interviewed teachers at the start of the program and after each course. In addition to reflecting on their learning and teaching, teachers watched videos of students’ engineering and discussed what they saw as relevant for teaching engineering. We informally compared summaries from previous interviews to get a sense of changes in how participants talked about engineering, how they approached teaching engineering, and what they noticed in classroom videos. Through this process, we identified one teacher to focus on for this paper: Alma is a veteran 3rd-5th grade science teacher in a rural, racially-diverse public school in the southeastern region of the US. We then developed content logs of Alma's interviews and identified emergent themes. To refine these themes, we looked for confirming and disconfirming evidence in the interviews and in her coursework in the program. We coded each interview for these themes and developed analytic memos, highlighting where we saw variability and stability in her stances and comparing across interviews to describe shifts in Alma's reasoning. It was at this stage that we narrowed our focus to her stances toward the engineering design process (EDP). In this paper, we describe and illustrate shifts we observed in Alma's reasoning, arguing that she exhibited dramatic shifts in her stances toward teaching and learning the EDP. At the start of the program, she was stable in treating the EDP as a series of linear steps that students and engineers progress through. After engaging and reflecting on her own engineering in the first course, she started to express a more fluid stance when talking more abstractly about the EDP but continued to take it up as a linear process in her classroom teaching. By the end of the program, Alma exhibited a growing stability across contexts in her stance toward the EDP as a fluid set of overlapping practices that students and engineers could engage in.more » « less
-
Despite recent progress in the adoption of engineering at the K-12 level, the scarcity of high-quality engineering curricula remains a challenge. With support from a previous NSF grant, our research team iteratively developed the three-year middle school engineering curricula, STEM-ID. Through a series of contextualized challenges, the 18-week STEM-ID curricula incorporate foundational mathematics and science skills and practices and advanced manufacturing tools such as computer aided design (CAD) and 3D printing, while introducing engineering concepts like pneumatics, aeronautics, and robotics. Our current project, supported by an NSF DRK-12 grant, seeks to examine the effectiveness of STEM-ID when implemented in diverse schools within a large school district in the southeastern United States. This paper will present early findings of the project’s implementation research conducted over two school years with a total of ten engineering teachers in nine schools. Guided by the Innovation Implementation framework (Century & Cassata, 2014), our implementation research triangulates observation, interview, and survey data to describe overall implementation of STEM-ID as well as implementation of six critical components of the curricula: engaging students in the engineering design process (EDP), math-science integration, collaborative group work, contextualized challenges, utilization of advanced manufacturing technology, and utilization of curriculum materials. Implementation data provide clear evidence that each of the critical components of STEM-ID were evident as the curricula were enacted in participating schools. Our data indicate strong implementation of four critical components (utilization of materials, math-science integration, collaborative group work, and contextualized challenges) across teachers. Engaging students in the EDP and advanced-manufacturing technology were implemented, to varying degrees, by all but two teachers. As expected, implementation of critical components mirrored overall implementation patterns, with teachers who completed more of the curricula tending to implement the critical components more fully than those who did not complete the curricula. In addition to tracking implementation of critical components, the project is also interested in understanding contextual factors that influence enactment of the curricula, including characteristics of the STEM-ID curricula, teachers, and organizations (school and district). Interview and observation data suggest a number of teacher characteristics that may account for variations in implementation including teachers’ organization and time management skills, self-efficacy, and pedagogical content knowledge (PCK). Notably, prior teaching experience did not consistently translate into higher completion rates, emphasizing the need for targeted support regardless of teachers' backgrounds. This research contributes valuable insights into the challenges and successes of implementing engineering curricula in diverse educational settings.more » « less
