Attention:The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, October 15th until 12:00 AM ET on Friday, October 16th due to maintenance. We apologize for the inconvenience.


Title: Optimizing preservice teacher learning with digital teaching simulations: Comparing teachers’ self-assessment and scoring from trained raters
In this study, we explored how the use of an online digital teaching simulation impacts preservice teacher (PST) learning. We describe the overall implementation of an online practice suite of digital teaching simulations into five teacher education courses. Specifically, we detail the avatar-based simulation activity in which PSTs facilitate a discussion focused on argumentation with five student avatars controlled by a trained actor in the Mursion simulated classroom environment. The present study examines PSTs’ self-assessment of their performance facilitating a discussion in this simulated classroom compared to rubric-level scores assigned by trained raters. We share findings from our analysis of survey data regarding 47 PSTs’ perceptions about their experience with the simulated classroom, specifically how successful they thought they were across five dimensions of facilitating argumentation-focused discussions. Findings suggest that the PSTs’ self-assessment tended to align with the scores assigned from trained raters. However, when the PSTs’ self-assessment did not align with the raters’ scoring, PSTs tended to perceive their discussion facilitation more positively than the raters’ scores indicated, which suggests the need for additional support to help PSTs identify and attend to specific areas for improvement. Findings provide support for the use of both self-assessment and scoring from trained raters to optimize PST learning with digital teaching simulations.  more » « less
Award ID(s):
2037983
PAR ID:
10530781
Author(s) / Creator(s):
;
Publisher / Repository:
SITE
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. With the growing use of mixed reality teaching simulations in teacher education there is a need for researchers to examine how preservice teacher (PST) learning can be supported when using these simulations. To address this gap the current study explores how 47 PSTs used an online teaching simulation to facilitate a discussion focused on argumentation with five student avatars in the MursionTM mixed reality simulated classroom environment. We assessed PSTs' performance in the simulation using rubric-level scores assigned by trained raters and then compared the scores to PSTs' survey responses completed after their discussion asking them to self-report their goals for the discussion, how successful they thought they were across five dimensions of facilitating high-quality, argumentation-focused discussions, and their overall perceptions of the mixed reality teaching simulation. Findings suggest that PSTs' understanding of the discussion task's learning goals somewhat predicted their success in facilitating the discussion and that PSTs' self-assessment of their performance was not always consistent with raters' evaluation of the PSTs' performance. In particular, self-assessment was found to be most consistent with raters' evaluations for those PSTs with higher rater-assigned scores and least consistent for those with lower rater-assigned scores. The implications of these findings are as follows: (1) researchers should be cautious in relying on PST self-report of success when engaging in mixed reality teaching simulations, particularly because low performance may be obscured, (2) teacher educators should be aware that reliance on self-report from PSTs likely obscures the need for additional support for exactly those PSTs who need it most, and (3) the field, therefore, should expand efforts to measure PSTs' performance when using mixed reality teaching simulations. 
    more » « less
  2. Preservice teachers (PSTs) need to be able to use ambitious teaching practices to help support their students’ productive engagement in scientific practices such as analyzing and interpreting data or using evidence-based reasoning to support their claims. Approximations of practice are one way in which teacher educators can support their PSTs to develop their skills in enacting ambitious teaching practices. In this study, we report on the use of a suite of three online, simulated approximations of practice where secondary PSTs practiced facilitating discussions focused on engaging students in argumentation. Using information from both PSTs’ and teacher educators’ perspectives, we examined their main takeaways from each simulation experience, how learning from one simulation was used to prepare for the next simulation, PSTs’ perception of the simulations’ authenticity, and their views about whether they would recommend using this online suite of simulations in future teacher preparation courses. Findings suggested that teacher educators and PSTs alike noted a variety of main takeaways, including understanding the importance of planning and asking good questions. Furthermore, they recommended the suite for use in future teacher education courses. Implications of the work for productively integrating online simulations into teacher education settings are discussed. 
    more » « less
  3. Providing opportunities for students to talk directly with their peers is a critical dimension to facilitating discussions in mathematics and science, including argumentation‐focused discussions in which students construct arguments and critique others' arguments. Research suggests that supporting student‐to‐student talk and facilitating argumentation discussions are complex and challenging practices for preservice teachers (PSTs). Elementary PSTs from two mathematics and two science methods courses practiced facilitating student‐to‐student talk within the context of an argumentation‐focused discussion. This study's main purpose was to explore the prompts that 29 PSTs used to encourage student‐to‐student talk in a simulated classroom. Findings show the PSTs were able to use direct prompts that encourage student‐to‐student talk but were just as likely to use prompts that may discourage students from talking to each other. Most direct prompts PSTs used to encourage student‐to‐student talk were for the purpose of argumentation construction and/or critique. PSTs were more likely to use indirect prompts, much like Talk Moves, that encourage students to consider others' ideas rather than requesting that students talk with each other. These findings have important implications for future research, as well as for teacher educators and professional learning facilitators who support teachers learning to encourage student‐to‐student talk during argumentation‐focused discussions. 
    more » « less
  4. As a result of the increased inclusion of engineering and computer science standards for K-6 schools nationwide, there is a need to better understand how teacher educators can help develop preservice teachers’ (PSTs’) teaching self-efficacy in these areas. Ed+gineering provides novel opportunities for PSTs to experience teaching and learning engineering and coding content by building COVID-companion robots. Growing evidence supports robotics as a powerful approach to STEM learning for PSTs. In this study, Ed+gineering examined three cases to explore this overarching question: In what ways did PSTs’ virtual robotics project experience develop their self-efficacy for teaching engineering and coding? Three PST cases were examined, within the context of their work with other team members (i.e., undergraduate engineering student(s), 5th graders). To understand each of three PSTs’ virtual robotics project experiences, multiple data sources were collected and analyzed which includes mid- and post-semester CATME, end of course short-answer reflections, follow up interviews (including a modified Big Five personality inventory), and Zoom session recordings. Elementary PSTs Brenda, Erica, and Sarah experienced various levels of commitment and engagement in their five Zoom sessions. These factors, along with other personal and external influences, contributed to Bandura’s four identified sources of self-efficacy. This study examines these contributing factors to create an initial working model of how PSTs develop teaching self-efficacy. In this conference session, science teacher educators will learn more about this model and pedagogical decisions that seemed to influence PST’s self-efficacy for teaching engineering and computer science. 
    more » « less
  5. The rapid development of digital technologies and online learning platforms has profoundly impacted the landscape of mathematics teaching and learning. These changes raise critical questions regarding mathematics teacher preparation, as future teachers must cultivate competencies in integrating innovative technological tools with ambitious pedagogical practices to enhance students' mathematical reasoning and communication skills. An additional layer of complexity arises when considering these competencies for teaching in an online environment. In this paper, we report on two in-depth case studies conducted in the United States with prospective secondary mathematics teachers (PSTs) who taught four online lessons during the global pandemic. The teaching occurred as part of the PSTs' participation in a course, Mathematical Reasoning and Proving for Secondary Teachers. Data sources included lesson plans, Zoom video recordings of the lessons, and PSTs' written reflections. Utilizing the Mathematical Knowledge for Teaching Proof and the Instructional Technology Tetrahedron frameworks, we explored how the PSTs' competence in reasoning and proving evolved. The analysis employed two complementary perspectives: the researcher-observer and the PSTs' reflective notice of their teaching. The results reveal complex trajectories of pedagogical growth and technology integration into mathematics teaching. Throughout the semester, both PSTs' practices transitioned from teacher-centered to more student-driven engagement and sophisticated technology integration. Structured reflection, peer discussion, and iterative lesson design were vital supports in their professional learning. This study demonstrates how PSTs can develop essential competencies for teaching reasoning and proof in online environments and emphasizes the necessity for intentional preparation in both digital pedagogy and mathematical reasoning within teacher education programs. 
    more » « less