skip to main content


Title: Explaining Thermodynamics: Impact of an Adaptive Dialog Based on a Natural Language Processing Idea Detection Model
We explored how Natural Language Processing (NLP) adaptive dialogs that are designed following Knowledge Integration (KI) pedagogy elicit rich student ideas about thermodynamics and contribute to productive revision. We analyzed how 619 6-8th graders interacted with two rounds of adaptive dialog on an end-of-year inventory. The adaptive dialog significantly improved students’ KI levels. Their revised explanations are more integrated across all grades, genders, and prior thermodynamics experiences. The dialog elicited many additional ideas, including normative ideas and vague reasoning. In the first round, students refined their explanation to focus on their normative ideas. In the second round they began to elaborate their reasoning and add new normative ideas. Students added more mechanistic ideas about conductivity, equilibrium, and the distinction between how an object feels and its temperature after the dialog. Thus, adaptive dialogs are a promising tool for scaffolding science sense-making.  more » « less
Award ID(s):
2101669
NSF-PAR ID:
10510557
Author(s) / Creator(s):
; ; ; ; ; ;
Editor(s):
Blikstein, P; Van_Aalst, J; Kizito, R; Brennan, K
Publisher / Repository:
International Society of the Learning Sciences
Date Published:
Page Range / eLocation ID:
1306 to 1309
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Blikstein, P ; Van_Aalst, J ; Kizito, R ; Brennan, K (Ed.)
    This study takes advantage of advances in Natural Language Processing (NLP) to build an idea detection model that can identify ideas grounded in students’ linguistic experiences. We designed adaptive, interactive dialogs for four explanation items using the NLP idea detection model and investigated whether they similarly support students from distinct language backgrounds. The curriculum, assessments, and scoring rubrics were informed by the Knowledge Integration (KI) pedagogy. We analyzed responses of 1,036 students of different language backgrounds taught by 10 teachers in five schools in the western United States. The adaptive dialog engages students from both monolingual English and multilingual backgrounds in incorporating additional relevant ideas into their explanations, resulting in a significant improvement in student responses from initial to revised explanations. The guidance supports students in both language groups to progress in integrating their scientific ideas. 
    more » « less
  2. This study explores how the interplay between data analysis and model design shifts 6th-grade students' understanding of diffusion from simple to sophisticated mechanistic reasoning and from non-canonical to canonical ideas about diffusion. Using mixed-methods qualitative analysis, we determine students' mechanistic reasoning and ideas about diffusion at five different points in a curricular sequence using a new tool for computational modeling called MoDa. With this data, we present a framework for the relationship between students' developing mechanistic reasoning and their canonical understanding, suggesting that they develop independently. Further, we illustrate how the computational modeling environment, MoDa, used in this study pushed students' mechanistic reasoning toward sophistication. Moreover, in allowing them to explore non-canonical mechanisms, MoDa supported their convergence on canonical scientific ideas about diffusion. 
    more » « less
  3. Uncertainty is an important concept in physics laboratory instruction. However, little work has examined how students reason about uncertainty beyond the introductory (intro) level. In this work we aimed to compare intro and beyond-intro students’ ideas about uncertainty. We administered a survey to students at 10 different universities with questions probing procedural reasoning about measurement, student-identified sources of uncertainty, and predictive reasoning about data distributions. We found that intro and beyond-intro students answered similarly on questions where intro students already exhibited expert-level reasoning, such as in comparing two data sets with the same mean but different spreads, identifying limitations in an experimental setup, and predicting how a data distribution would change if more data were collected. For other questions, beyond-intro students generally exhibited more expertlike reasoning than intro students, such as when determining whether two sets of data agree, identifying principles of measurement that contribute to spread, and predicting how a data distribution would change if better data were collected. Neither differences in institutions, student majors, lab courses taken, nor research experience were able to fully explain the variability between intro and beyond-intro student responses. These results call for further research to better understand how students’ ideas about uncertainty develop beyond the intro level. 
    more » « less
  4. null (Ed.)
    Students in science education struggle with creating and iteratively revising models based on evidence. We report on an implementation of a “gallery walk” activity where 5th grade students used the Model and Evidence Mapping Environment (MEME) software tool to develop and then critique each other’s models of an algal bloom. MEME was designed to support students in creating visual models organized around the components and mechanisms of the target phenomena, linking evidence to those models, and then providing and responding to comments on the specific features of the model. Findings illustrate how this was a productive environment for students to make their ideas about modeling criteria visible, and how their ideas cut across normative dimensions of modeling expertise. 
    more » « less
  5. Loertscher, Jennifer (Ed.)
    Introductory courses are often designed to cover a range of topics with the intent to offer students exposure to the given discipline as preparation to further their study in the same or related disciplines. Unfortunately, students in these courses are often presented with an overwhelming amount of information that may not support their formation of a usable coherent network of knowledge. In this study we conducted a mixed-method sequential exploratory study with students co-enrolled in General Chemistry II and Introductory Biology I to better understand what students perceived to be the “take-home” messages of these courses (i.e., core ideas) and the connections between these courses. We found that students identified a range of ideas from both courses; further analysis of students’ explanations and reasoning revealed that, when students talked about their chemistry ideas, they were more likely to talk about them as having predictive and explanatory power in comparison with reasons provided for their biology big ideas. Furthermore, students identified a number of overlapping ideas between their chemistry and biology courses, such as interactions, reactions, and structures, which have the potential to be used as a starting place to support students building a more coherent network of knowledge. 
    more » « less