An official website of the United States government
This paper presents a novel approach for predicting the outcomes of elementary students’ participation in computer science (CS) instruction by using exit tickets, a type of practical measure, where students provide rapid feedback on their instructional experiences. Such feedback can help teachers to inform ongoing teaching and instructional practices. We fit a Structural Equation Model to examine whether students' perceptions of enjoyment, ease, and connections between mathematics and CS in an integrated lesson predicted their affective outcomes in self-efficacy, interest, and CS identity, collected in a pre- post- survey. We found that practical measures can validly measure student experiences.
more »
« less
This content will become publicly available on March 4, 2026
Exploring the potential of exit tickets as formative assessments of student affect
This study investigates the use of exit tickets as formative assessments in maths-integrated computer science (CS) lessons for grade 5 students. Exit tickets are brief surveys administered immediately after instructional activities. Using structural equation modelling (SEM), we analysed data from 1,067 students to examine the reliability and validity of exit tickets in predicting summative pre/post survey results. The study found that the exit ticket responses consistently assessed student affect at two administration points, meeting strict measurement invariance criteria (χ2(21) = 1.34, p = 1.00). Confirmatory factor analysis revealed that exit tickets predicted student self-efficacy and interest in CS, which are key educational outcomes. These findings suggest that exit tickets can be valuable tools for enhancing instructional practices and supporting student learning and engagement in CS education. The study concludes with recommendations for effectively implementing exit tickets in educational settings.
more »
« less
- Award ID(s):
- 2031382
- PAR ID:
- 10617337
- Publisher / Repository:
- Taylor and Francis
- Date Published:
- Journal Name:
- Assessment in Education: Principles, Policy & Practice
- Volume:
- 32
- Issue:
- 2
- ISSN:
- 0969-594X
- Page Range / eLocation ID:
- 173 to 191
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Practitioners delivering computer science (CS) education during the COVID-19 pandemic have faced numerous challenges, including the move to online learning. Understanding the impact on students, particularly students from historically marginalized groups within the United States, requires deeper exploration. Our research question for this study was: \textit{In what ways has the high school computer science educational ecosystem for students been impacted by COVID-19, particularly when comparing schools that have student populations with a majority of historically underrepresented students to those that do not?} To answer this question, we used the CAPE theoretical framework to measure schools’ Capacity to offer CS, student Access to CS education, student Participation in CS, and Experiences of students taking CS \cite{fletcherwarner2021cape}. We developed a quantitative instrument based on the results of a qualitative inquiry, then used the instrument to collect data from CS high school practitioners located in the United States (n=185) and performed a comparative analysis of the results. We found that the numbers of students participating in AP CS A courses, CS related as well as non-CS related extracurricular activities, and multiple extracurricular activities increased. However, schools primarily serving historically underrepresented students had significantly fewer students taking additional CS courses and fewer students participating in CS related extracurricular activities. Student learning in CS courses decreased significantly; however, engagement did not suffer. Other noncognitive factors, like students’ understanding of the relevance of technology and confidence using technology, improved overall; however, student interested in taking additional CS courses was significantly lower in schools primarily serving historically underrepresented students. Last, the numbers of students taking the AP CS A and AP CS Principles exams declined overall.more » « less
-
Practitioners delivering computer science (CS) education during the COVID-19 pandemic have faced numerous challenges, including the move to online learning. Understanding the impact on students, particularly students from historically marginalized groups within the United States, requires deeper exploration. Our research question for this study was: In what ways has the high school computer science educational ecosystem for students been impacted by COVID-19, particularly when comparing schools that have student populations with a majority of historically underrepresented students to those that do not? To answer this question, we used the CAPE theoretical framework to measure schools’ Capacity to offer CS, student Access to CS education, student Participation in CS, and Experiences of students taking CS. We developed a quantitative instrument based on the results of a qualitative inquiry, then used the instrument to collect data from CS high school practitioners located in the United States (n=185) and performed a comparative analysis of the results. We found that the numbers of students participating in AP CS A courses, CS related as well as non-CS related extracurricular activities, and multiple extracurricular activities increased. However, schools primarily serving historically underrepresented students had significantly fewer students taking additional CS courses and fewer students participating in CS related extracurricular activities. Student learning in CS courses decreased significantly; however, engagement did not suffer. Other noncognitive factors, like students’ understanding of the relevance of technology and confidence using technology, improved overall; however, student interested in taking additional CS courses was significantly lower in schools primarily serving historically underrepresented students. Last, the numbers of students taking the AP CS A and AP CS Principles exams declined overall.more » « less
-
Effects of High Impact Educational Practices on Engineering and Computer Science Student Participation, Persistence, and Success at Land Grant Universities: Award# RIEF-1927218 – Year 2 Abstract Funded by the National Science Foundation (NSF), this project aims to investigate and identify associations (if any) that exist between student participation in High Impact Educational Practices (HIP) and their educational outcomes in undergraduate engineering and computer science (E/CS) programs. To understand the effects of HIP participation among E/CS students from groups historically underrepresented and underserved in E/CS, this study takes place within the rural, public university context at two western land grant institutions (one of which is an Hispanic-serving institution). Conceptualizing diversity broadly, this study considers gender, race and ethnicity, and first-generation, transfer, and nontraditional student status to be facets of identity that contribute to the diversity of academic programs and the technical workforce. This sequential, explanatory, mixed-methods study is guided by the following research questions: 1. To what extent do E/CS students participate in HIP? 2. What relationships (if any) exist between E/CS student participation in HIP and their educational outcomes (i.e., persistence in major, academic performance, and graduation)? 3. How do contextual factors (e.g., institutional, programmatic, personal, social, financial, etc.) affect E/CS student awareness of, interest in, and participation in HIP? During Project Year 1, a survey driven quantitative study was conducted. A survey informed by results of the National Survey of Student Engagement (NSSE) from each institution was developed and deployed. Survey respondents (N = 531) were students enrolled in undergraduate E/CS programs at either institution. Frequency distribution analyses were conducted to assess the respondents’ level of participation in extracurricular HIPs (i.e., global learning and study aboard, internships, learning communities, service and community-based learning, and undergraduate research) that have been shown in the literature to positively impact undergraduate student success. Further statistical analysis was conducted to understand the effects of HIP participation, coursework enjoyability, and confidence at completing a degree on the academic success of underrepresented and nontraditional E/CS students. Exploratory factor analysis was used to derive an "academic success" variable from five items that sought to measure how students persevere to attain academic goals. Results showed that a linear relationship in the target population exists and that the resultant multiple regression model is a good fit for the data. During the Project Year 2, survey results were used to develop focus group interview protocols and guide the purposive selection of focus group participants. Focus group interviews were conducted with a total of 27 undergraduates (12 males, 15 females, 16 engineering students, 11 computer science students) across both institutions via video conferencing (i.e., ZOOM) during the spring and fall 2021 semesters. Currently, verified focus group transcripts are being systematically analyzed and coded by a team of four trained coders to identify themes and answer the research questions. This paper will provide an overview of the preliminary themes so far identified. Future project activities during Project Year 3 will focus on refining themes identified during the focus group transcript analysis. Survey and focus group data will then be combined to develop deeper understandings of why and how E/CS students participate in the HIP at their university, taking into account the institutional and programmatic contexts at each institution. Ultimately, the project will develop and disseminate recommendations for improving diverse E/CS student awareness of, interest in, and participation in HIP, at similar land grant institutions nationally.more » « less
-
Currently, substantial efforts are underway to improve the engagement and retention of engineering and computer science (E/CS) students in their academic programs. Student participation in specific activities known as High Impact Educational Practices (HIP) has been shown to improve student outcomes across a variety of degree fields. Thus, we suggest that understanding how and why E/CS students, especially those from historically underrepresented groups, participate in HIP is vital for supporting efforts aimed at improving E/CS student engagement and retention. The aim of the current study is to examine the participation of E/CS undergraduates enrolled at two western land-grant institutions (both institutions are predominantly white; one is an emerging Hispanic-serving institution) across five HIEP (i.e., global learning and study aboard internships, learning communities, service and community-based learning, and undergraduate research) that are offered outside of required E/CS curricula and are widely documented in the research literature. As part of a larger study, researchers developed an online questionnaire to explore student HIP participation and then surveyed E/CS students (n = 576) across both land-grant institutions. Subsequently, researchers will use survey results to inform the development of focus groups interview protocols. Focus group interviews will be conducted with purposefully selected E/CS students who participated in the survey. Combined survey and focus group data will then be analyzed to more deeply understand why and how E/CS students participate in the HIP at their university. This research paper reports on the frequency distribution analysis of the survey data generated with E/CS undergraduates enrolled at one of the two land grant institutions. The combined sample included E/CS undergraduates from the following demographic groups: female (34 %), Asian (10 %), Black or African American (2%), Hispanic or Latinx (6%), Native American or Alaskan Native (1%), Native Hawaiian or Other Pacific Islander (1%), White (81 %), and multiracial (4 %). Results show that most (38%) E/CS students reported participating in internships, while study abroad programs garnered the smallest level of E/CS student participation (5%) across all five HIP. Internships were found most likely to engage diverse students: Female (42%), Hispanic or Latinx (24%), Multiracial (44%), Asian (31%), First-generation (29%), and nontraditional students—other than those categorized as highly nontraditional—all reported participating in internships more than any other HIP. Notable differences in participation across E/CS and demographic groups were found for other HIPs. Results further revealed that 43% of respondents did not participate in any extracurricular HIP and only 19% participated in two or more HIP. Insights derived from the survey and used to inform ongoing quantitative and qualitative analyses are discussed. Keywords: community-based learning, high impact educational practices, HIP, internships learning communities, service learning, study aboard, undergraduate researchmore » « less
