skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Comparing the Science Talk of AI and Human Students
This poster reports on an exploratory comparison of middle school science classroom discourse from AI-powered virtual student agents and human students. Transcripts from both simulated science classes with preservice teachers and AI students and recordings of real science classes were coded using a framework of student science talk moves. Results suggest that the AI and human discourse is mostly similar, although the AI tended to ask questions much more frequently than human students did.  more » « less
Award ID(s):
2110777
PAR ID:
10653261
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
International Society of the Learning Sciences
Date Published:
Page Range / eLocation ID:
2073 to 2074
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; (, ACM)
    New frontiers in simulation-based teacher training have been unveiled with the advancement of artificial intelligence (AI). Integrating AI into virtual student agents increases the accessibility and affordability of teacher training simulations, but little is known about how preservice teachers interact with AI-powered student agents. This study analyzed the discourse behavior of 15 preservice teachers who undertook simulation-based training with AI-powered student agents. Using a framework of ambitious science teaching, we conducted a pattern analysis of teacher and student talk moves, looking for evidence of academically productive discourse. Comparisons are made with patterns found in real classrooms with professionally trained science teachers. Results indicated that preservice teachers generated academically productive discourse with AI-powered students by using ambitious talk moves. The pattern analysis also revealed coachable moments where preservice teachers succumbed to cycles of unproductive discourse. This study highlights the utility of analyzing classroom discourse to understand human-AI communication in simulation-based teacher training. 
    more » « less
  2. ; ; ; ; ; ; (, Journal of Technology and Teacher Education)
    This case study reports on the perceptions and dialogic behaviors of 15 preservice K-12 teachers engaging in simulation-based teaching practice with AI-powered student agents. Data included transcripts of text-based classroom dialogue, interviews, observations, and conversation logs. Using mixed-methods analyses and a framework of ambitious science teaching, we identified two key findings that are important to Human-AI interaction researchers and teacher trainers. First, AI-powered student agents exhibit naturalistic discourse behavior, with ambitious talk moves leading to more rigorous student contributions and conservative talk moves leading to low rigor contributions. And second, preservice teachers’ dialogue was responsive to the AI-powered students’ contributions. 
    more » « less
  3. ; ; ; ; (, ACM)
    Rich classroom discussion, or discourse, has long been a recommended pedagogical practice in K-12 math and science education. Research shows that discourse is beneficial for all learners, but especially for English learners and minoritized students in STEM. Discourse helps develop students' agency, academic language, and conceptual understanding. Some K-12 computer science (CS) curricula incorporate student discourse, but we believe it is under-used. In this paper, we review how discourse helps students learn, discuss the use of discourse in CS and math education, share ideas for promoting discourse in CS classrooms, and call on curriculum developers, teacher professional learning providers, and researchers to support the increased use of discourse in K-12 CS education. 
    more » « less
  4. ; ; ; ; ; (, Review of Educational Research)
    The literature on science discourse in K–12 classrooms in the United States has proliferated over the past couple of decades, crossing geographical, disciplinary, theoretical, and methodological boundaries. There is general consensus that science talk is at the core of students’ learning; however, a synthesis of key findings from the expansive literature base is needed. This systematic literature review is guided by a complex systems framework to organize and synthesize empirical studies of science talk in urban classrooms across individual (student or teacher), collective (interpersonal), and contextual (sociocultural, historical) planes. Findings are discussed in relation to contemporary approaches that integrate theories and methodologies to account for the complex phenomena of science discourse, including interacting elements across levels as well as stable and changing patterns that influence students’ access to, and nature of, science talk in urban classrooms. Unresolved questions related to high-leverage, equitable, and sustainable discourse practices; future lines of inquiry that can benefit by drawing from diverse theoretical traditions and mixed methodological approaches; and practical implications for classroom-based strategies to support science discourse are also discussed. 
    more » « less
  5. ; (, ASEE Conferences)
    In the dynamic field of educational technology, there is an increasing emphasis on incorporating artificial intelligence (AI) into educational settings. Through interviews with mentors and students, this study compares the effectiveness and reliability of AI-generated qualitative codes with human-generated codes in addressing student challenges during Innovation Competitions and Programs (ICPs), such as hackathons, ide competitions, and pitch competitions. While ICPs encourage creativity and innovation, participants often encounter significant challenges. The methodology involves analyzing qualitative responses to student challenges from students involved in the ICPs. Preliminary findings suggest that AI-generated codes offer improved efficiency and objectivity, while human evaluators provide crucial nuanced insights into student challenges. The results showed a high level of agreement between human and AI-generated overall themes that highlight student challenges during ICPs. However, a low agreement was found in mapping AI-generated codes to transcript files. Based on the identified codes and themes, several recommendations were made to make ICP more inclusive learning events for all students. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email