skip to main content


Title: Using Retrospective Surveys to Assess the Impact of Participating in an Afterschool Maker Learning Program on Youth
As the number of afterschool technology-rich maker learning programs for youth increases, it is important to investigate effective assessment tools that can be used to assess program impact at scale. We studied results from a series of surveys using two deployment modes with 94 youth who participated in programs at an afterschool maker learning center. We found that retrospective surveys that ask youth to reflect on shifts in their attitudes after completing a program are more effective than the same surveys deployed twice, pre- and post- a program. These results confirm input from youth interviews in which they expressed dislike of repeating the same surveys before and after a program and difficulty with answering self-assessment questions without a point of reference.  more » « less
Award ID(s):
1723610
NSF-PAR ID:
10202306
Author(s) / Creator(s):
Date Published:
Journal Name:
ASEE Annual Conference proceedings
ISSN:
1524-4644
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Purpose This paper aims to introduce and explores the use of electrodermal activity (EDA) data as a tool for obtaining data about youth engagement during maker learning activities. Design/methodology/approach EDA and survey data were collected from a yearlong afterschool maker program for teens that met weekly and was hosted at a children’s museum. Data from four youth who were simultaneously present for eight weeks were examined to ascertain what experiences and activities were more or less engaging for them, based on psychophysiological measures. Findings Most of the focal youth appeared to show higher levels of engagement by survey measures throughout the program. However, when examined by smaller time intervals, certain activities appeared to be more engaging. Planning of maker activities was one space where engagement was higher. Completing sewing projects with minimal social interaction appeared to be less engaging. Specific activities involving common maker technologies yielded mixed levels of engagement. Originality/value Some research is emerging that uses EDA data as a basis for generating inferences about various states while participating in maker learning activities. This paper provides a novel analysis building on some techniques established in the still emergent body of prior research in this area. 
    more » « less
  2. null (Ed.)
    This Research Full Paper contributes to research on creating maker-based learning experiences for youth in diverse informal learning settings. A key research question in this space is how to efficiently and effectively setup maker learning spaces and train educators to deliver high-quality maker curriculum in diverse sites. To study this question, we developed and deployed a multi-phase maker educator training program that included makerspace setup, educator training, and youth program deployment. We deployed three models of the program at three participating sites over roughly nine months. We analyzed data from educator pre- and post- interviews and found that the programs generated considerable interest in the youth and resulted in positive shifts in career aspirations and social and technical skills. Participants emphasized the importance of creating hybrid online and offline resources and training materials. Our participants also identified logistical challenges related to recruiting educators and youth attendance. Finally, participants described possibilities for content localization and the inclusion of participatory approaches to keep youth and educators engaged. 
    more » « less
  3. Schultz, Greg ; Barnes, Jonathan ; Shore, Linda (Ed.)
    Growing Mathletes is an NSF-funded program that is developing a curricular model to successfully integrate growth mindset principles, baseball, and math and science concepts for youth in grades 3 to 8 in out of school learning settings. Using a Design-Based Implementation Research framework for implementing, testing, and revising a curriculum and professional learning model, we are working on best practices to support youth learning and confidence as well as facilitator training and support in both afterschool and summer programs. We present youth outcomes as evidence of successes in how the program has integrated growth mindset with other content as a way to support youth’s productive mindset in their own learning along with content gains. 
    more » « less
  4. Abstract

    Current research underscores that there are only a few evidence-based programs that teach STEM (science, technology, engineering, and mathematics) as part of their curriculum, especially for autistic students. Even fewer programs focus on engineering and design learning. Hence, we developed an informal afterschool maker program to develop autistic and non-autistic students’ interests in engineering to understand their experiences learning STEM concepts and values while applying the engineering mindset to develop projects. This qualitative study aimed to explore and understand students’ experiences participating in STEM activities in the maker club. We interviewed twenty-six students (seventeen autistic and nine non-autistic), nine teachers, and thirteen parents representing diverse cultural and socio-economic backgrounds across three public middle schools in a large urban metropolitan city between 2018 and 2019. Our thematic analysis yielded four themes:(1) active participation in STEM; (2) curiosity about STEM topics, concepts, and practices, (3) capacity-building to engage in STEM learning; and 4) understanding of the importance of STEM education in daily life.The results of this study enabled us to understand that students were deeply engaged with the content and curriculum of our program, expanded their knowledge base about scientific concepts, used engineering-specific scientific terminologies, and engaged with the engineering design process to conceptualize, test, improvise, and problem-solve. Furthermore, this afterschool engineering education program created a safe, nurturing, and stimulating environment for students to build engineering readiness skills.

     
    more » « less
  5. null (Ed.)
    High-quality afterschool programs (ASPs) are opportunities to diversify the ways that Latinx youth from economically underprivileged communities experience STEM learning. Utilizing qualitative methods, based on the experiences and perspectives of low-income Latinx middle school participants of a math enrichment ASP in Southern California, we identified four culturally responsive practices: (1) the promotion of an inclusive, safe, and respectful program climate, (2) engaging in personal conversations, (3) facilitating opportunities for mutual and math learning across diverse cultures and perspectives, and (4) the promotion of math and a range of social-emotional skills across contexts. These practices helped youth feel more connected to the program, their peers, and program staff (college mentors); provided a platform for youth voice and contribution to the processes of teaching and learning; facilitated opportunities for skill development and practice across the different contexts of youth’s lives; interrelated with Latinx cultural values; and helped to promote youth’s engagement and math learning. Importantly, youth’s relationships with their mentors was a significant aspect of their experiences and perceptions of these practices. We argue that culturally responsive practices are necessary to achieve high-quality programs and provide specific implications for how ASPs can implement them in the design and implementation of their programs. 
    more » « less