This study investigates the use of exit tickets as formative assessments in maths-integrated computer science (CS) lessons for grade 5 students. Exit tickets are brief surveys administered immediately after instructional activities. Using structural equation modelling (SEM), we analysed data from 1,067 students to examine the reliability and validity of exit tickets in predicting summative pre/post survey results. The study found that the exit ticket responses consistently assessed student affect at two administration points, meeting strict measurement invariance criteria (χ2(21) = 1.34, p = 1.00). Confirmatory factor analysis revealed that exit tickets predicted student self-efficacy and interest in CS, which are key educational outcomes. These findings suggest that exit tickets can be valuable tools for enhancing instructional practices and supporting student learning and engagement in CS education. The study concludes with recommendations for effectively implementing exit tickets in educational settings.
more »
« less
Sensing Affect to Empower Students: Learner Perspectives on Affect-Sensitive Technology in Large Educational Contexts
Large-scale educational settings have been common domains for affect detection and recognition research. Most research emphasizes improvements in the accuracy of affect measurement to enhance instructors’ efficiency in managing large numbers of students. However, these technologies are not designed from students’ perspectives, nor designed for students’ own usage. To identify the unique design considerations for affect sensors that consider student capacities and challenges, and explore the potential of affect sensors to support students’ self-learning, we conducted semi-structured interviews and surveys with both online students and on-campus students enrolled in large in-person classes. Drawing on these studies we: (a) propose using affect data to support students’ self-regulated learning behaviors through a “scaling for empowerment” design perspective, (b) identify design guidelines to mitigate students’ concerns regarding the use of affect data at scale, (c) provide design recommendations for the physical design of affect sensors for large educational settings.
more »
« less
- Award ID(s):
- 1842693
- PAR ID:
- 10310022
- Date Published:
- Journal Name:
- Learning@Scale
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This Work-in-Progress Research paper focuses on digital game-based learning (DGBL), which refers to the use of a virtual environment to support students’ learning. In this exploratory study, we examine how students engage with GeoExplorer, a digital game-based learning environment that simulates Cone-Penetration Testing (CPT), an on-site test used in geotechnical engineering to investigate soil properties that students typically don’t have access to. In GeoExplorer’s CPT activity, students participate in a virtual internship in which they examine several sites with varied types of soil. This paper investigates DGBL environments by leveraging Self-Determination Theory (SDT) to ask the following research questions: (1) How do "freedom" and autonomy within GeoExplorer encourage students’ new emergent learning strategies? and (2) How do emergent learning strategies in GeoExplorer support students’ confidence as they self-guide their learning? Ten open-ended semi-structured interviews were performed with civil engineering students from three U.S.-based institutions. The data are analyzed using narrative analysis and a grounded theory approach. Our preliminary findings indicate that, while GeoExplorer is intended as a complement to in-person learning, it serves both as a complement and supplement to the online learning that helps to engage students during the pandemic. Students share that a felt sense of "freedom" within GeoExplorer encourages them to engage in different emergent learning strategies, such as repetition and trial and error. Students also describe that these emergent learning strategies promote knowledge retention and understanding, and further support their confidence in performing CPT. Our preliminary findings provide opportunities for students to practice autonomy and develop competency – two out of three basic psychological needs in SDT – in their educational processes.more » « less
-
To better support engineering students and to create an inclusive and welcoming educational context, it is necessary to reimagine instructional methods and approaches. In contrast to deficit educational models that focus on perceptions of what students lack, asset-based practices focus on how students’ lived experiences can be used to enrich and strengthen their educational experiences. There is a need to support faculty in adopting existing techniques or developing new techniques in undergraduate courses, as most existing literature related to asset-based practices is focused on K-12 settings. Engineering design courses provide an ideal context for asset-based practices because the design process requires a diverse set of knowledge, experiences, and skills. Guided by self-determination theory, an understanding of implicit bias and stereotype threat, and the large existing body of research on asset-based pedagogy, we seek to support engineering student outcomes by empowering faculty with tools and strategies to incorporate asset-based practices in their courses. We are engaged in a three-year project focused on assessing the impact of asset-based practices in engineering design courses a large, public, land-grant, Hispanic-serving institution in the southwestern United States, funded by the NSF IUSE:EDU program. Here, we will summarize the design and results from our professional development for faculty, including theoretical frameworks and evidence guiding our work. We share content from our professional development, summarizing learning objectives, presentation content, and activities. Additionally, we present comments shared by instructors related to our professional development, including common barriers to implementing educational innovations in their courses. Our work will provide insights to practitioners interested in promoting inclusive classroom practices in engineering education and researchers who are translating research to practice, especially through professional development.more » « less
-
Educational research supports incorporating active engagement into K-12 education using authentic STEM experiences. While there are discipline-specific resources to provide students with such experiences, there are limited transdisciplinary opportunities that integrate engineering education and technological skill-building to contextualize core scientific concepts. Here, we present an adaptable module that integrates hands-on technology education and place-based learning to improve student understanding of key chemistry concepts as they relate to local environmental science. The module also supports disciplinary core ideas, practices, and cross-cutting concepts in accordance with the Next Generation Science Standards. We field-tested our module in three different high school courses: Chemistry, Oceanography and Advanced Placement Environmental Science at schools in Washington, USA. Students built spectrophotometric pH sensors using readily available electronic components and calibrated them with known pH reference standards. Students then used their sensors to measure the pH of local environmental water samples. Assessments showed significant improvement in content knowledge in all three courses relating to environmental relevance of pH, and to the design, use and environmental application of sensors. Students also reported increased self-confidence in the material, even when their content knowledge remained the same. These findings suggest that classroom sensor building and collection of environmental data increases student understanding and self-confidence by connecting chemistry concepts to local environmental settings.more » « less
-
Undergraduates enrolled in large, active learning courses must self-regulate their learning (self-regulated learning [SRL]) by appraising tasks, making plans, setting goals, and enacting and monitoring strategies. SRL researchers have relied on self-report and learner-mediated methods during academic tasks studied in laboratories and now collect digital event data when learners engage with technology-based tools in classrooms. Inferring SRL processes from digital events and testing their validity is challenging. We aligned digital and verbal SRL event data to validate digital events as traces of SRL and used them to predict achievement in lab and course settings. In Study 1, we sampled a learning task from a biology course into a laboratory setting. Enrolled students (N = 48) completed the lesson using digital resources (e.g., online textbook, course site) while thinking aloud weeks before it was taught in class. Analyses confirmed that 10 digital events reliably co-occurred ≥70% of the time with verbalized task definition and strategy use macroprocesses. Some digital events co-occurred with multiple verbalized SRL macroprocesses. Variance in occurrence of validated digital events was limited in lab sessions, and they explained statistically nonsignificant variance in learners’ performance on lesson quizzes. In Study 2, lesson-specific digital event data from learners (N = 307) enrolled in the course (but not in Study 1) predicted performance on lesson-specific exam items, final exams, and course grades. Validated digital events also predicted final exam and course grades in the next semester (N = 432). Digital events can be validated to reflect SRL processes and scaled to explain achievement in naturalistic undergraduate education settings. Educational Impact and Implications Statement Instructors often have difficulty identifying and helping struggling students in courses with hundreds of students. Digital trace data can be used to efficiently and effectively identify struggling students in these large courses, but such data are often difficult to interpret with confidence. In our study, we found that using verbal trace data to augment and validate our inferences about the meaning of digital trace data resulted in a powerful set of predictors of students’ achievement. These validated digital trace data can be used to not only identify students in need of support in large classes, but also to understand how to target interventions to the aspects of learning that are causing students the most difficulty.more » « less
An official website of the United States government

