skip to main content


Title: Perspectives on informal programs: How site visits can help us learn more
We are continuing a nationwide effort to develop a systemic understanding of the landscape of informal physics using an organizational theory perspective. We have collected surveys and interviews with informal physics program facilitators, but this information is only from the perspective of the faculty or physics student leaders and does not tell us about the social dynamics within each program. Thus, to complement these data, we need to observe informal physics events as they occur. In this paper, we will discuss our strategy for visits to program sites to observe social interactions between program participants as well as programmatic details in action. We report on an initial site visit to a physics open house event, where we took field-notes and conducted interviews with participating personnel members. Here, we compare the types of data we are able to collect from site visits and interviews/surveys with lead program facilitators.  more » « less
Award ID(s):
1713060
NSF-PAR ID:
10251757
Author(s) / Creator(s):
; ;
Editor(s):
Wolf, S.; Bennett, M.B.; Frank, B.W.
Date Published:
Journal Name:
Physics Education Research Conference Proceedings 2020
Page Range / eLocation ID:
503 to 508
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. There are many informal physics education programs across the country. However, the available information about these programs varies widely and can be difficult to find. Without this knowledge, it is difficult for individual informal physics efforts to be understood as part of a broader national landscape of physics learning outside of the classroom. In this paper, we describe the development of study design and implementation to map the complex landscape of informal physics in the United States. We seek to determine the best ways to collect meaningful and comprehensive data from the wide-ranging and diverse formats of informal physics programs facilitated by academic institutions. Data was obtained from initial web searches for programs, surveys and interviews of program facilitators, and site visits of program events and activities. This data was analyzed along with participants’ feedback to produce iterations of the survey and interview protocol. We report on challenges and outcomes from our attempts to collect information about programs in Michigan as a test case for the national landscape. These methods can also be used in other informal education studies to gather program information. 
    more » « less
  2. Objective Over the past decade, we developed and studied a face-to-face video-based analysis-of-practice professional development (PD) model. In a cluster randomized trial, we found that the face-to-face model enhanced elementary science teacher knowledge and practice and resulted in important improvements to student science achievement (student treatment effect, d = 0.52; Taylor et al, 2017; Roth et al, 2018). The face-to-face PD model is expensive and difficult to scale. In this paper, we present the results of a two-year design-based research study to translate the face-to-face PD into a facilitated online PD experience. The purpose is to create an effective, flexible, and cost-efficient PD model that will reach a broader audience of teachers. Perspective/Theoretical Framework The face-to-face PD model is grounded in situated cognition and cognitive apprenticeship frameworks. Teachers engage in learning science content and effective science teaching practices in the context in which they will be teaching. There are scaffolded opportunities for teachers to learn from analysis of model videos by experienced teachers, to try teaching model units, to analyze video of their own teaching efforts, and ultimately to develop their own unit, with guidance. The PD model attends to the key features of effective PD as described by Desimone (2009) and others. We adhered closely to the design principles of the face-to-face model as described by Authors, 2019. Methods We followed a design-based research approach (DBR; Cobb et al., 2003; Shavelson et al., 2003) to examine the online program components and how they promoted or interfered with the development of teachers’ knowledge and reflective practice. Of central interest was the examination of mechanisms for facilitating teacher learning (Confrey, 2006). To accomplish this goal, design researchers engaged in iterative cycles of problem analysis, design, implementation, examination, and redesign (Wang & Hannafin, 2005) in phase one of the project before studying its effect. Data Three small pilot groups of teachers engaged in both synchronous and asynchronous components of the larger online course which began implementation with a 10-week summer course that leads into study groups of participants meeting through one academic year. We iteratively designed, tested, and revised 17 modules across three pilot versions. On average, pilot groups completed one module every two weeks. Pilot 1 began the work in May 2019; Pilot 2 began in August 2019, and Pilot 3 began in October 2019. Pilot teachers responded to surveys and took part in interviews related to the PD. The PD facilitators took extensive notes after each iteration. The development team met weekly to discuss revisions. We revised all modules between each pilot group and used what we learned to inform our development of later modules within each pilot. For example, we applied what we learned from testing Module 3 with Pilot 1 to the development of Module 3 for Pilots 2, and also applied what we learned from Module 3 with Pilot 1 to the development of Module 7 for Pilot 1. Results We found that community building required the same incremental trust-building activities that occur in face-to-face PD. Teachers began with low-risk activities and gradually engaged in activities that required greater vulnerability (sharing a video of themselves teaching a model unit for analysis and critique by the group). We also identified how to contextualize technical tools with instructional prompts to allow teachers to productively interact with one another about science ideas asynchronously. As part of that effort, we crafted crux questions to surface teachers’ confusions or challenges related to content or pedagogy. We called them crux questions because they revealed teachers’ uncertainty and deepened learning during the discussion. Facilitators leveraged asynchronous responses to crux questions in the synchronous sessions to push teacher thinking further than would have otherwise been possible in a 2-hour synchronous video-conference. Significance Supporting teachers with effective, flexible, and cost-efficient PD is difficult under the best of circumstances. In the era of covid-19, online PD has taken on new urgency. NARST members will gain insight into the translation of an effective face-to-face PD model to an online environment. 
    more » « less
  3. Objective Over the past decade, we developed and studied a face-to-face video-based analysis-of-practice PD model. In a cluster randomized trial, we found that the face-to-face model enhanced elementary science teacher knowledge and practice, and resulted in important improvements to student science achievement (student treatment effect, d = 0.52; Taylor et al., 2017: Roth et al., 2018). The face-to-face PD model is expensive and difficult to scale. In this poster, we present the results of a two-year design-based research study to translate the face-to-face PD into a facilitated online PD experience. The purpose is to create an effective, flexible, and cost-efficient PD model that will reach a broader audience of teachers. Perspective/Theoretical Framework The face-to-face PD model is grounded in situated cognition and cognitive apprenticeship frameworks. Teachers engage in learning science content and practices in the context in which they will be teaching. In addition, there are scaffolded opportunities for teachers to learn from model videos by experienced teachers, try model units, and ultimately develop their own unit, with guidance. The PD model also attends to the key features of effective PD as described by Desimone (2009) and others. We adhered closely to the design principles of the face-to-face model as described by Roth et al., 2018. Methods We followed a design-based research approach (DBR: Cobb et al., 2003: Shavelson et al., 2003) to examine the online program components and how they promoted or interfered with the development of teachers’ knowledge and reflective practice. Of central interest was the examination of mechanisms for facilitating teacher learning (Confrey, 2006). To accomplish this goal, design researchers engaged in iterative cycles of problem analysis, design, implementation, examination, and redesign (Wang & Hannafin, 2005). Data We iteratively designed, tested, and revised 17 modules across three pilot versions. Three small groups of teachers engaged in both synchronous and asynchronous components of the larger online course. They responded to surveys and took part in interviews related to the PD. The PD facilitators took extensive notes after each iteration. The development team met weekly to discuss revisions. Results We found that community building required the same incremental trust-building activities that occur in face-to-face PD. Teachers began with low-risk activities and gradually engaged in activities that required greater vulnerability (sharing a video of themselves teaching a model unit for analysis and critique by the group). We also identified how to contextualize technical tools with instructional prompts to allow teachers to productively interact with one another about science ideas asynchronously. As part of that effort, we crafted crux questions to surface teachers’ confusions or challenges related to content or pedagogy. Facilitators leveraged asynchronous responses to crux questions in the synchronous sessions to push teacher thinking further than would have otherwise been possible in a 2-hour synchronous video-conference. Significance Supporting teachers with effective, flexible, and cost-efficient PD is difficult under the best of circumstances. In the era of COVID-19, online PD has taken on new urgency. AERA members will gain insight into the construction of an online PD for elementary science teachers/ Full digital poster available at: https://aera21-aera.ipostersessions.com/default.aspx?s=64-5F-86-2E-15-F8-C3-C0-45-C6-A0-B7-1D-90-BE-46 
    more » « less
  4. null (Ed.)
    In this work we examine youth learning in an informal computing program implemented through a library-university partnership. In particular, we introduce and illustrate a culturally responsive computing framework which served as a foundation for the design of the program. Subsequently, we examine youth collaboration as well as affective and cognitive learning outcomes. Data were collected from university program facilitators and 30 youth over one semester. Data were collected through observations, lesson plans, computational artifacts and interviews with two case study youth. Results indicated that youth formed a variety of learning communities during the collaborative development of computing artifacts. Frequent participants were found to work with a greater number of peers compared to less frequent participants. Results from case study participants also indicated improvements in their computational competencies. Findings from this work have implications for the design of informal learning environments that help broaden participation in computing. 
    more » « less
  5. In this work we examine youth learning in an informal computing programimplemented through a library-university partnership. In particular, we introduce and illustrate a culturally responsive computing framework which served as a foundation for the design of the program. Subsequently, we examine youth collaboration as well as affective and cognitive learning outcomes. Data were collected from university program facilitators and 30 youth over one semester. Data were collected through observations, lesson plans, computational artifacts and interviews with two case study youth. Results indicated that youth formed a variety of learning communities during the collaborative development of computing artifacts. Frequent participants were found to work with a greater number of peers compared to less frequent participants. Results from case study participants also indicated improvements in their computational competencies. Findings from this work have implications for the design of informal learning environments that help broaden participation in computing. 
    more » « less