skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Challenges in study design for characterizing the informal physics landscape
There are many informal physics education programs across the country. However, the available information about these programs varies widely and can be difficult to find. Without this knowledge, it is difficult for individual informal physics efforts to be understood as part of a broader national landscape of physics learning outside of the classroom. In this paper, we describe the development of study design and implementation to map the complex landscape of informal physics in the United States. We seek to determine the best ways to collect meaningful and comprehensive data from the wide-ranging and diverse formats of informal physics programs facilitated by academic institutions. Data was obtained from initial web searches for programs, surveys and interviews of program facilitators, and site visits of program events and activities. This data was analyzed along with participants’ feedback to produce iterations of the survey and interview protocol. We report on challenges and outcomes from our attempts to collect information about programs in Michigan as a test case for the national landscape. These methods can also be used in other informal education studies to gather program information.  more » « less
Award ID(s):
1713060
PAR ID:
10166039
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Proceedings of the 2019 Physics Education Research Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Characterizing the landscape of informal physics learning is a necessary and important endeavor that requires an in-depth study of the different types of existing programs. In this project we focus on informal programs sponsored by physics departments in academic institutes and physics national labs. We seek to understand the structural elements and cultural practices within the diverse array of informal physics spaces. Thus, we are developing a framework based on organizational theory that is contextualized for informal physics programs. We have collected data using survey and interview protocols for different informal physics activities. Here, we present an in-depth case study in which we have analyzed a “science cafe”-style event facilitated by volunteers from a physics and astronomy department. Applying organizational theory to the data set allows us to determine the fine-grained details of the program and the interconnections between the key elements of programming, personnel, resources, audience and institution. We further characterize and discuss the challenges the program faces from the facilitator’s perspective. From these findings, we will be able to look at larger data sets in the national study. 
    more » « less
  2. Wolf, S.; Bennett, M.B.; Frank, B.W. (Ed.)
    We are continuing a nationwide effort to develop a systemic understanding of the landscape of informal physics using an organizational theory perspective. We have collected surveys and interviews with informal physics program facilitators, but this information is only from the perspective of the faculty or physics student leaders and does not tell us about the social dynamics within each program. Thus, to complement these data, we need to observe informal physics events as they occur. In this paper, we will discuss our strategy for visits to program sites to observe social interactions between program participants as well as programmatic details in action. We report on an initial site visit to a physics open house event, where we took field-notes and conducted interviews with participating personnel members. Here, we compare the types of data we are able to collect from site visits and interviews/surveys with lead program facilitators. 
    more » « less
  3. There has been an increase of funding agencies’ investment in informal science education in recent years, resulting in significant growth of the field. However, little research has been done in discipline-based education research to determine the impact of informal physics programs and what makes them successful. While struc- tures exist to assess the impact of informal learning, those are not yet robust enough to rigorously assess which programs work and, more critically, why they work. In this study, we used a non-profit organization framework as a lens to evaluate the ’success’ of three informal physics programs in achieving their objectives and overall vision. To determine the practices and structures that most influence the ’success’ of these programs, we con- ducted interviews with directors and coordinators of the programs, hosted at R1 institutions and identified initial indicators that can increase chances of informal physics programs to be ’successful’. 
    more » « less
  4. The U.S. bioeconomy has been estimated to be $950 billion and growing [1]. Sustaining this growth requires a skilled workforce who can manufacture goods developed through biotechnology. Scaling the biotechnology workforce to the needed level requires the ability to measure its size. The National Center for Education Statistics (NCES) is the federal agency responsible for gathering education data in the U.S. Colleges that receive federal funding are mandated by law to report data every year to the NCES. Given the comprehensive nature of these data, we sought to determine whether it could be used to measure the number of certificates and degrees in biotechnology awarded by two-year colleges. An unexpected challenge was the requirement by the NCES data retrieval page for Classification of Instructional Program (CIP) codes and the inconsistent use of CIP codes by college biotechnology programs. We were able to circumvent these challenges by using data from the InnovATEBIO National Center for Biotechnology Education. InnovATEBIO data allowed us to identify two-year colleges with biotechnology programs and use those results to learn which CIP codes were being assigned. Knowing the CIP codes and their use in different states supplied the information we needed to obtain certificate and degree completion data from the NCES. These data provided insights into the changing numbers and demographics of biotech students during the past twenty years. Not only are these data important for understanding trends in biotechnology education, they are imperative for guiding the initiation, development, and sustainability of biotechnology education programs at two-year colleges. 
    more » « less
  5. Abstract Background Billions of dollars are spent annually on grant-funded STEM (science, technology, engineering, and mathematics) education programs. These programs help students stay on track toward STEM careers when standard educational practices do not adequately prepare them for these careers. It is important to know that reliable and accurate student participation and completion data are being collected about these programs. This multiple case study investigates how student data are collected and reported for a national STEM education program in the United States, the National Science Foundation (NSF) Advanced Technological Education (ATE) program. Our overall aim is to provide insights to funding agencies, STEM education faculty, and others who are interested in addressing issues related to the collection and reporting of student participation and completion data within their own contexts. Emphasis is placed on the barriers encountered in collecting participation and completion data, particularly with regard to unduplicated participation counts and marketable credential data. The ATE program was selected for this study because there is already a mechanism (known as the ATE Survey) in place for annually collecting systematic data across all projects within the program. Results A multiple case study, including interviews of primary investigators, allowed for in-depth analysis of the ATE Survey’s point-in-time data on project-level participation in various activities, and for identification of the following barriers to tracking student-level data: lack of time and help to gather these data, lack of a consistent system for tracking students across different institutions, and a perceived lack of guidance from the funding agency about what data to track. We also saw that different data are needed from different projects to determine a project’s true impact. Defining “success” the same way across all projects is inadequate. Conclusions Although, due to the limited sample size, these findings cannot be generalized to the larger ATE population, they provide specific insights into the various barriers that projects encounter in collecting participation and completion data. 
    more » « less