An official website of the United States government
This case study reports on the perceptions and dialogic behaviors of 15 preservice K-12 teachers engaging in simulation-based teaching practice with AI-powered student agents. Data included transcripts of text-based classroom dialogue, interviews, observations, and conversation logs. Using mixed-methods analyses and a framework of ambitious science teaching, we identified two key findings that are important to Human-AI interaction researchers and teacher trainers. First, AI-powered student agents exhibit naturalistic discourse behavior, with ambitious talk moves leading to more rigorous student contributions and conservative talk moves leading to low rigor contributions. And second, preservice teachers’ dialogue was responsive to the AI-powered students’ contributions.
more »
« less
Student interaction discourse moves: characterizing and visualizing student discourse patterns
Abstract Student-centered instruction allows students to take ownership over their learning in the classroom. However, these settings do not always promote productive engagement. Using discourse analysis, student engagement can be analyzed based on how they are interacting with each other while completing in-class group activities. Previous analyses of student engagement in science settings have used methods that do not capture the intricacies of student group interactions such as the flow of conversation and nature of student utterances outside of argumentation or reasoning. However, these features are important to accurately assess student engagement. This study proposes a tiered analytical framework and visualization scheme for analyzing group discussion patterns that allow for a detailed analysis of student discourse moves while discussing scientific topics. This framework allows a researcher to see the flow of an entire conversation within a single schematic. The Student Interaction Discourse Moves framework can be used to extend studies using discourse analysis to determine how student groups work through problems.
more »
« less
- Award ID(s):
- 1915047
- PAR ID:
- 10392096
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- Disciplinary and Interdisciplinary Science Education Research
- Volume:
- 5
- Issue:
- 1
- ISSN:
- 2662-2300
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Pattern analysis of ambitious science talk between preservice teachers and AI-powered student agentsNew frontiers in simulation-based teacher training have been unveiled with the advancement of artificial intelligence (AI). Integrating AI into virtual student agents increases the accessibility and affordability of teacher training simulations, but little is known about how preservice teachers interact with AI-powered student agents. This study analyzed the discourse behavior of 15 preservice teachers who undertook simulation-based training with AI-powered student agents. Using a framework of ambitious science teaching, we conducted a pattern analysis of teacher and student talk moves, looking for evidence of academically productive discourse. Comparisons are made with patterns found in real classrooms with professionally trained science teachers. Results indicated that preservice teachers generated academically productive discourse with AI-powered students by using ambitious talk moves. The pattern analysis also revealed coachable moments where preservice teachers succumbed to cycles of unproductive discourse. This study highlights the utility of analyzing classroom discourse to understand human-AI communication in simulation-based teacher training.more » « less
-
null (Ed.)Argumentation enables students to engage in real world scientific practices by rationalizing claims grounded in supporting evidence. Student engagement in scientific argumentation activates the negotiation process by which students develop and defend evidence-based claims. Little is known, however, on the intricate process and potential patterns of negotiation between students during scientific argumentation. The present study seeks to fill this gap by exploring how a group of university science education students negotiated when evaluating the relationship between lines of evidence and alternative explanatory models of a phenomena (i.e., climate change). This research, theoretically grounded in social constructionism, used Halliday's model of Systemic Functional Linguistics (SFL) within a discourse analysis framework. The authors analyzed transcripts of student conversations during a model-evidence link activity to gain insights into patterns of negotiation. An interpersonal analysis centering on mood and moves revealed students' ability to engage in the negotiation component of scientific argumentation to make assertions about relations between evidence and models. Effective collaboration resulting in group consensus of the relationship (categorized as supports, strongly supports, or contradicts) was facilitated by the use of interrogatives, modulation, and a balanced contribution between group members. Conversely, negotiation which did not reach consensus featured less contribution between group members. Conversely, negotiation which did not reach consensus featured less balanced discussion among group members, contained more interruptions, more conflict moves, and double polarity clauses.more » « less
-
Kosko, K W; Caniglia, J; Courtney, S A; Zolfaghari, M; Morris, G A (Ed.)Experiential learning represents a shift in K-12 education that requires teachers to change the ways that they engage students. We created a professional development experience in which teachers learned about the entrepreneurial-based design challenges we developed (Authors, 2019) and practiced implementing teacher check-ins with students participating in our summer camp. In this paper, we conduct a case study to explore how three teachers used teacher discourse moves during their teacher check-ins. We found three types of teacher-student interactions: (a) positioning students as experts, (b) co-designing with students, and (c) pushing students towards an outcome. These findings suggest that teacher professional development for experiential learning should intentionally support teachers in learning how to employ the moves during teacher check-ins in ways that elevate student expertise and advance their thinking.more » « less
-
Rambow, Owen; Wanner, Leo; Apidianaki, Marianna; Al-Khalifa, Hend; Di_Eugenio, Barbara; Schockaert, Steven (Ed.)Human tutoring interventions play a crucial role in supporting student learning, improving academic performance, and promoting personal growth. This paper focuses on analyzing mathematics tutoring discourse using talk moves—a framework of dialogue acts grounded in Accountable Talk theory. However, scaling the collection, annotation, and analysis of extensive tutoring dialogues to develop machine learning models is a challenging and resource-intensive task. To address this, we present SAGA22, a compact dataset, and explore various modeling strategies, including dialogue context, speaker information, pretraining datasets, and further fine-tuning. By leveraging existing datasets and models designed for classroom teaching, our results demonstrate that supplementary pretraining on classroom data enhances model performance in tutoring settings, particularly when incorporating longer context and speaker information. Additionally, we conduct extensive ablation studies to underscore the challenges in talk move modeling.more » « less
