skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Measuring the long-term effects of informal science education experiences: challenges and potential solutions
Abstract Despite the fact that most science learning takes place outside of school, little is known about how engagement in informal science learning (ISL) experiences affects learners’ knowledge, skill development, interest, or identities over long periods of time. Although substantial ISL research has documented short-term outcomes such as the learning that takes place during a science center visit, research suggests that the genuine benefits of informal experiences are long-term transformations in learners as they pursue a “cascade” of experiences subsequent to the initial educational event. However, a number of major methodological challenges have limited longitudinal research projects investigating the long-term effects of ISL experiences. In this paper we identify and address four key issues surrounding the critical but challenging area of how to study and measure the long-term effects or impacts of ISL experiences: attribution, attrition, data collection, and analytic approaches. Our objective is to provide guidance to ISL researchers wishing to engage in long-term investigations of learner outcomes and to begin a dialogue about how best to address the numerous challenges involved in this work.  more » « less
Award ID(s):
1514593
PAR ID:
10285659
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Disciplinary and Interdisciplinary Science Education Research
Volume:
3
Issue:
1
ISSN:
2662-2300
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract Sense of place describes both affective and cognitive — emotional and intellectual — connections to place. Affective outcomes, tied to arts and humanities education, can facilitate these connections. But little research explores environmental science, arts and humanities (eSAH) curricula on place relationships. Additionally, most research on the sense of place focuses on repeated visits to a place over time, rather than short-term experiences like a field trip. Finally, digital technology is a growing trend across science education, but little research investigates its use in field-based contexts. Our research begins to address these gaps. This article describes an eSAH field trip for middle and high school learners. Using a conventional content analysis, we present pilot data from two high school field trips. Our findings illuminate a framework for understanding active and passive place relationships in the context of short-term interdisciplinary field learning experiences. 
    more » « less
  2. Abstract While there are many different frameworks seeking to identify what benefits young people might derive from participation in informal STEM (Science, Technology, Engineering and Mathematics) learning (ISL), this paper argues that the sector would benefit from an approach that foregrounds equity and social justice outcomes. We propose a new model for reflecting on equitable youth outcomes from ISL that identifies five key areas: (1) Grounded fun; (2) STEM capital; (3) STEM trajectories; (4) STEM identity work; and (5) Agency+ . The model is applied to empirical data (interviews, observations and youth portfolios) collected over one year in four UK-based ISL settings with 33 young people (aged 11–14), largely from communities that are traditionally under-represented in STEM. Analysis considers the extent to which participating youth experienced equitable outcomes, or not, in relation to the five areas. The paper concludes with a discussion of implications for ISL and how the model might support ongoing efforts to reimagine ISL as vehicle for social justice. 
    more » « less
  3. null (Ed.)
    Abstract Biological field stations (BFSs) are well positioned through their informal STEM (science, technology, engineering, and mathematics) education programs to improve levels of science literacy and support environmental sustainability. A survey of 223 US BFSs revealed that their outreach programs strive to promote conservation and environmental stewardship in addition to disseminating place-based knowledge and/or skills. In this article, we unpack the educational approaches that BFSs use to engage learners, the aspects of science literacy most often addressed, and the perceived learning outcomes. Most notably, the BFSs reported that their participants develop an interest in and excitement for science, increase or change their knowledge of program topics, identify more with the scientific enterprise, and engage in scientific practices. The results indicate opportunities for BFSs to conduct more rigorous assessments of participant learning and program impact. By focusing on learner engagement, science learning, and participant outcomes, BFSs and other place-based informal education venues can expand their efforts and better support conservation and science learning. 
    more » « less
  4. Abstract Consequential STEM experiences in informal settings can address issues of equity by fully engaging historically marginalized high school students in complex socio-scientific issues. However, inclusive and effective programs are in high demand, and there is little research on what specific aspects, context, and timeframes are most important when scaling these experiences. Using a mixed method approach, this study demonstrates that students make significant gains, in the short and long term, through in-person and remote informal programs ranging between 22-h and 320-h. Progress across STEM learning constructs is attributed to authentic research experiences, students’ connections to STEM professionals, direct hands-on participation in projects, and group work. Relative to formal education settings, research-based informal STEM programs can be implemented with minimal resources, can maintain effectiveness while scaling, and work towards addressing the societal challenge of improving STEM learning and outcomes for high school students from historically marginalized communities. 
    more » « less
  5. Intensive youth STEM programs serve high school students in informal learning spaces such as museums and community centers. They engage participants over weeks, months, or years, focusing on long-term STEM out- comes, especially for populations historically marginalized in STEM fields. However, many of these programs operate independently or in silos, limiting opportunities for collective learning and improvement. Isolation is driven by factors such as diverse organizational types, funding sources, program sizes, content focus, and research and evaluation capacities. Furthermore, conducting longitudinal studies to track participant outcomes is rare and expensive. To address these challenges, this paper proposes a conversation toward the establishment of a collaborative network to support research collaboration and knowledge integration, exchange, and translation. Such a network would strengthen the capacity of these programs, improve long-term outcomes for participants, and contribute to the broader STEM education and career research community, enhancing the overall impact of intensive youth STEM programs. 
    more » « less