skip to main content
Explore Scholarly Publications and Datasets in the NSF-PAR

Title: Evaluation of Engineering Problem-framing Professional Development for K-12 Science Teachers
As the importance to integrate engineering into K12 curricula grows so does the need to develop teachers’ engineering teaching capabilities and knowledge. One method that has been used to aid this development is engineering professional development programs. This evaluation paper presents the successes and challenges of an engineering professional development program for teachers focused around the use of engineering problem-framing design activities in high school science classrooms. These activities were designed to incorporate the cross-cutting ideas published in the Next Generation Science Standards (NGSS) and draw on best practices for instructional design of problem-framing activities from research on design and model-eliciting activities (MEAs). The professional development (PD) was designed to include the following researched-based effective PD key elements: (1) is content focused, (2) incorporates active learning, (3) supports collaboration, (4) uses models of effective practice, (5) provides coaching and expert support, (6) offers feedback and reflection, and (7) is of sustained duration. The engineering PD, including in-classroom deployment of activities and data collection, was designed as an iterative process to be conducted over a three-year period. This will allow for improvement and refinement of our approach. The first iteration, reported in this paper, consisted of seven high school science teachers who more » have agreed to participate in the PD, implement the problem-framing activities, and collect student data over a period of one year. The PD itself consisted of the teachers comparing science and engineering, participating in problem-framing training and activities, and developing a design challenge scenario for their own courses. The participating teachers completed a survey at the end of the PD that will be used to inform enhancement of the PD and our efforts to recruit additional participants in the following year. The qualitative survey consisted of open-ended questions asking for the most valuable takeaways from the PD, their reasoning for joining the PD, reasons they would or would not recommend the PD, and, in their opinion, what would inspire their colleagues to attend the PD. The responses to the survey along with observations from the team presenting the PD were analyzed to identify lessons learned and future steps for the following iteration of the PD. From the data, three themes emerged: Development of PD, Teacher Motivation, and Teacher Experience. « less
Authors:
; ; ; ;
Award ID(s):
1812823
Publication Date:
NSF-PAR ID:
10173425
Journal Name:
2020 ASEE Virtual Annual Conference
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ( , Annual Meeting of the NARST International Conference)
    Objective Over the past decade, we developed and studied a face-to-face video-based analysis-of-practice professional development (PD) model. In a cluster randomized trial, we found that the face-to-face model enhanced elementary science teacher knowledge and practice and resulted in important improvements to student science achievement (student treatment effect, d = 0.52; Taylor et al, 2017; Roth et al, 2018). The face-to-face PD model is expensive and difficult to scale. In this paper, we present the results of a two-year design-based research study to translate the face-to-face PD into a facilitated online PD experience. The purpose is to create an effective, flexible, and cost-efficient PD model that will reach a broader audience of teachers. Perspective/Theoretical Framework The face-to-face PD model is grounded in situated cognition and cognitive apprenticeship frameworks. Teachers engage in learning science content and effective science teaching practices in the context in which they will be teaching. There are scaffolded opportunities for teachers to learn from analysis of model videos by experienced teachers, to try teaching model units, to analyze video of their own teaching efforts, and ultimately to develop their own unit, with guidance. The PD model attends to the key features of effective PD as described by Desimonemore »(2009) and others. We adhered closely to the design principles of the face-to-face model as described by Authors, 2019. Methods We followed a design-based research approach (DBR; Cobb et al., 2003; Shavelson et al., 2003) to examine the online program components and how they promoted or interfered with the development of teachers’ knowledge and reflective practice. Of central interest was the examination of mechanisms for facilitating teacher learning (Confrey, 2006). To accomplish this goal, design researchers engaged in iterative cycles of problem analysis, design, implementation, examination, and redesign (Wang & Hannafin, 2005) in phase one of the project before studying its effect. Data Three small pilot groups of teachers engaged in both synchronous and asynchronous components of the larger online course which began implementation with a 10-week summer course that leads into study groups of participants meeting through one academic year. We iteratively designed, tested, and revised 17 modules across three pilot versions. On average, pilot groups completed one module every two weeks. Pilot 1 began the work in May 2019; Pilot 2 began in August 2019, and Pilot 3 began in October 2019. Pilot teachers responded to surveys and took part in interviews related to the PD. The PD facilitators took extensive notes after each iteration. The development team met weekly to discuss revisions. We revised all modules between each pilot group and used what we learned to inform our development of later modules within each pilot. For example, we applied what we learned from testing Module 3 with Pilot 1 to the development of Module 3 for Pilots 2, and also applied what we learned from Module 3 with Pilot 1 to the development of Module 7 for Pilot 1. Results We found that community building required the same incremental trust-building activities that occur in face-to-face PD. Teachers began with low-risk activities and gradually engaged in activities that required greater vulnerability (sharing a video of themselves teaching a model unit for analysis and critique by the group). We also identified how to contextualize technical tools with instructional prompts to allow teachers to productively interact with one another about science ideas asynchronously. As part of that effort, we crafted crux questions to surface teachers’ confusions or challenges related to content or pedagogy. We called them crux questions because they revealed teachers’ uncertainty and deepened learning during the discussion. Facilitators leveraged asynchronous responses to crux questions in the synchronous sessions to push teacher thinking further than would have otherwise been possible in a 2-hour synchronous video-conference. Significance Supporting teachers with effective, flexible, and cost-efficient PD is difficult under the best of circumstances. In the era of covid-19, online PD has taken on new urgency. NARST members will gain insight into the translation of an effective face-to-face PD model to an online environment.« less
  2. ; ; ; ; ; ; ; ; ( , Annual meeting program American Educational Research Association)
    Objective Over the past decade, we developed and studied a face-to-face video-based analysis-of-practice PD model. In a cluster randomized trial, we found that the face-to-face model enhanced elementary science teacher knowledge and practice, and resulted in important improvements to student science achievement (student treatment effect, d = 0.52; Taylor et al., 2017: Roth et al., 2018). The face-to-face PD model is expensive and difficult to scale. In this poster, we present the results of a two-year design-based research study to translate the face-to-face PD into a facilitated online PD experience. The purpose is to create an effective, flexible, and cost-efficient PD model that will reach a broader audience of teachers. Perspective/Theoretical Framework The face-to-face PD model is grounded in situated cognition and cognitive apprenticeship frameworks. Teachers engage in learning science content and practices in the context in which they will be teaching. In addition, there are scaffolded opportunities for teachers to learn from model videos by experienced teachers, try model units, and ultimately develop their own unit, with guidance. The PD model also attends to the key features of effective PD as described by Desimone (2009) and others. We adhered closely to the design principles of the face-to-face model asmore »described by Roth et al., 2018. Methods We followed a design-based research approach (DBR: Cobb et al., 2003: Shavelson et al., 2003) to examine the online program components and how they promoted or interfered with the development of teachers’ knowledge and reflective practice. Of central interest was the examination of mechanisms for facilitating teacher learning (Confrey, 2006). To accomplish this goal, design researchers engaged in iterative cycles of problem analysis, design, implementation, examination, and redesign (Wang & Hannafin, 2005). Data We iteratively designed, tested, and revised 17 modules across three pilot versions. Three small groups of teachers engaged in both synchronous and asynchronous components of the larger online course. They responded to surveys and took part in interviews related to the PD. The PD facilitators took extensive notes after each iteration. The development team met weekly to discuss revisions. Results We found that community building required the same incremental trust-building activities that occur in face-to-face PD. Teachers began with low-risk activities and gradually engaged in activities that required greater vulnerability (sharing a video of themselves teaching a model unit for analysis and critique by the group). We also identified how to contextualize technical tools with instructional prompts to allow teachers to productively interact with one another about science ideas asynchronously. As part of that effort, we crafted crux questions to surface teachers’ confusions or challenges related to content or pedagogy. Facilitators leveraged asynchronous responses to crux questions in the synchronous sessions to push teacher thinking further than would have otherwise been possible in a 2-hour synchronous video-conference. Significance Supporting teachers with effective, flexible, and cost-efficient PD is difficult under the best of circumstances. In the era of COVID-19, online PD has taken on new urgency. AERA members will gain insight into the construction of an online PD for elementary science teachers/ Full digital poster available at: https://aera21-aera.ipostersessions.com/default.aspx?s=64-5F-86-2E-15-F8-C3-C0-45-C6-A0-B7-1D-90-BE-46« less
  3. ; ; ; ( , Proceedings of the 53rd ACM Technical Symposium on Computer Science Education)
    Teacher self-efficacy (SE) has been observed to be an 'important construct for Computer Science (CS) teachers' professional development because it can predict both teaching behaviors as well as student outcomes" [1]. The purpose of the present study was to investigate teacher CS SE during a two-year federally funded professional development (PD) and curriculum development project for middle school teachers incorporating game-design and the Unity development platform. The research question investigated is: How does teacher self-efficacy for teaching computer science via game design with the Unity game development platform change during a year-long PD program? Investigations of teacher SE for teaching CS have resulted in some surprising results. For example, it has been reported that - There were no differences in self-efficacy based on teachers' overall level of experience, despite previous findings that teacher self-efficacy is related to amount of experience" and "no differences in self-efficacy related to the teachers' own level of experience with CS" [2], thus further study of CS teacher SE is warranted. Participants in this study were six middle school teachers from four middle schools in the southeastern United States. They participated in a year-long PD program learning the Unity game development platform, elements of game design,more »and foundations of learner motivation. Guided reflective journaling was used to track the teachers' SE during the first year of the project. Teachers completed journal prompts at four intervals. Prompts consisted of questions like "How do you currently feel about your ability to facilitate student learning with Unity?" and "Are you confident that you can implement the materials the way the project team has planned for them to be implemented?" Prior to beginning the project participants expressed confidence in being able to facilitate student learning after participating in the planned professional development, but there was some uneasiness about learning and using Unity. From a SE perspective their responses make sense, as all of the participants are experienced teachers and should have confidence in their general ability to teach. However, since Unity is a new programming environment for all of the teachers, they did not have the prior experience necessary to have a high degree of confidence that they could successfully use it with their students.« less
  4. ; ; ; ; ; ; ; ( , American Society of Engineering education)
    Biologically inspired design has become increasingly common in graduate and undergraduate engineering programs, consistent with an expanding emphasis by professional engineering societies on cross-disciplinary critical thinking skills and adaptive and sustainable design. However, bio-inspired engineering is less common in K-12 education. In 2019, the NSF funded a K-12 project entitled Biologically Inspired Design for Engineering Education (BIRDEE), to create socially relevant, accessible, and highly contextualized high school engineering curricula focusing on bio-inspired design. Studies have shown that women and underrepresented minorities are drawn to curricula, courses, and instructional strategies that are integrated, emphasize systems thinking, and facilitate connection building across courses or disciplines. The BIRDEE project also seeks to interest high school girls in engineering by providing curricula that incorporate humanistic, bio-inspired engineering with a focus on sustainable and authentic design contexts. BIRDEE curricula integrate bio-inspired design into the engineering design process by leveraging design tools that facilitate the application of biological concepts to design challenges. This provides a conceptual framework enabling students to systematically define a design problem, resulting in better, more well-rounded problem specifications. The professional development (PD) for the participating teachers include six-week-long summer internships in university research laboratories focused on biology and bio-inspired design. The goalmore »of these internships is to improve engineering teachers’ knowledge of bio-inspired design by partnering with cutting-edge engineers and scientists to study animal features and behaviors and their applications to engineering design. However, due to COVID-19 and research lab closures in the summer of 2020, the research team had to transfer the summer PD experience to an online setting. An asynchronous, quasi-facilitated online course was developed and delivered to teachers over six weeks. In this paper, we will discuss online pedagogical approaches to experiential learning, teaching bio-inspired design concepts, and the integration of these approaches in the engineering design process. Central to the online PD design and function of each course was the use of inquiry, experiential and highly-collaborative learning strategies. Preliminary results show that teachers appreciated the aspects of the summer PD that included exploration, such as during the “Found Object” activity, and the process of building a prototype. These activities represented experiential learning opportunities where teachers were able to learn by doing. It was noted throughout the focus group discussions that such opportunities were appreciated by participating teachers. Teachers indicated that the experiential learning components of the PD allowed them to do something outside of their comfort zone, inspired them to do research that they would not have done outside of this experience, and allowed them to “be in the student's seat and get hands-on application”. By participating in these experiential learning opportunities, teachers were also able to better understand how the BIRDEE curriculum may impact students’ learning in their classrooms« less
  5. ; ; ; ; ; ; ; ( , 2020 ASEE Virtual Annual Conference Experience)
    The Bureau of Statistics identified an urgent demand for science, technology, engineering, and mathematics (STEM) professionals in the coming years. In order to meet this demand, the number of students graduating with STEM degrees in the United States needs to increase by 34% annually [1]. Engineering for US All (E4USA): A National Pilot Program for High School Engineering Course and Database is a NSF-funded first-of-its-kind initiative designed to address this national need. The E4USA project aims to make engineering more inclusive and accessible to underrepresented minorities, while increasing racial, ethnic, and gender representation in higher education and the workforce. The “for us all” mission of E4USA encompasses both students and educators. The demand for engineering educators has increased, but relying on practicing engineers to switch careers and enter teacher preparation programs has been insufficient [2, 3, 4]. This has led schools to turn to educators with limited training in engineering, which could potentially have a significant national impact on student engineering education [5, 6, 7]. Part of the E4USA pilot year mission has been to welcome educators with varying degrees of experience in industry and teaching. Paramount to E4USA was the construction of professional development (PD) experiences and a communitymore »of practice that would prepare and support teachers with varying degrees of engineering training instruction as they implemented the yearlong course. The perspectives of four out of nine educators were examined during a weeklong, intensive E4USA PD. Two of four educators were considered ‘novices’; one with a background in music and the other in history. The remaining two educators were deemed ‘veterans’ with a total of 15 years of experience as engineers and more than 20 years as engineering educators. Data sources consist of focus groups, surveys, and artifacts created during the PD (e.g., educators’ responses to reflection prompts and letters written to welcome the next cohort). Focus group data is currently being analyzed using inductive coding and the constant comparative method in order to identify emergent themes that speak to the past experience or inexperience of educators with engineering. Artifacts were used to: 1) Triangulate the findings generated from the analysis of focus group, and 2) Further understand how the veteran educators supported the novice educators. We will also use quantitative survey data to examine descriptive statistics, observed score bivariate correlations, and differences in mean scores across novices and veterans to further examine potential common and unique experiences for these educators. The results aim to highlight how the inclusion of educators with a broad spectrum of past experiences with engineering and engineering education can increase educators’ empathy towards students who may be equally hesitant about engineering. The findings from this study are expected to result in implications for how PD and a community of practice may be developed to allow for reciprocal support and mentoring. Results will inform future efforts of E4USA and aim to change the structure of high school engineering education nationwide.« less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email