Title: Self-Explanation of worked examples integrated in an intelligent tutoring system enhances problem solving and efficiency in algebra
One pedagogical technique that promotes conceptual understanding in mathematics learners is self-explanation integrated with worked examples (e.g.,Rittle-Johnson et al., 2017). In this work, we implemented self-explanations with worked examples (correct and erroneous) in a software-based Intelligent Tutoring System (ITS) for learning algebra. We developed an approach to eliciting self-explanations in which the ITS guided students to select explanations that were conceptually rich in nature. Students who used the ITS with self-explanations scored higher on a posttest that included items tapping both conceptual and procedural knowledge than did students who used a version of the ITS that included only traditional problem-solving practice. This study replicates previous findings that self-explanation and worked examples in an ITS can foster algebra learning (Booth et al., 2013). Further, this study extends prior work to show that guiding students towards conceptual explanations is beneficial.  more » « less
Award ID(s):
1760922
PAR ID:
10472800
Author(s) / Creator(s):
; ; ; ;
Corporate Creator(s):
Editor(s):
Culbertson, J.; Perfors, A.; Rabagliati, H.; Ramenzoni, V.
Publisher / Repository:
Proceedings of the 44th Annual Conference of the Cognitive Science Society
Date Published:
Journal Name:
Proceedings of the 44th Annual Conference of the Cognitive Science Society
Edition / Version:
44
Page Range / eLocation ID:
3466-72
Subject(s) / Keyword(s):
learning self-explanation worked examples Intelligent Tutoring System middle-school algebra
Format(s):
Medium: X
Location:
Toronto
Sponsoring Org:
National Science Foundation
More Like this
  1. Culbertson, J.; Perfors, A.; Rabagliati, H.; Ramenzoni, V. (Ed.)
    One pedagogical technique that promotes conceptual understanding in mathematics learners is self-explanation integrated with worked examples (e.g., Rittle-Johnson et al., 2017). In this work, we implemented self-explanations with worked examples (correct and erroneous) in a software-based Intelligent Tutoring System (ITS) for learning algebra. We developed an approach to eliciting self-explanations in which the ITS guided students to select explanations that were conceptually rich in nature. Students who used the ITS with self-explanations scored higher on a posttest that included items tapping both conceptual and procedural knowledge than did students who used a version of the ITS that included only traditional problem-solving practice. This study replicates previous findings that self-explanation and worked examples in an ITS can foster algebra learning (Booth et al., 2013). Further, this study extends prior work to show that guiding students towards conceptual explanations is beneficial. 
    more » « less
  2. Worked examples are step-by-step solutions to problems in a specific domain, offered to students to acquire domain-specific problem-solving skills. The power of worked examples could be magnified by combining them with self-explanations, which ask students to explain rather than passively study each problem-solving step. The main challenge of this approach is assessing the correctness of the student's explanations. In the current approach, student explanations are judged by their semantic similarity to an explanation provided by an instructor or domain expert. However, recent studies of example explanations in the domain of programming demonstrated that many students express themselves very differently from domain experts. In this situation, a traditional semantic similarity approach might introduce bias against students who correctly explain worked examples but are considerably different from expert explanations. In this paper, we use a recently published dataset to compare several explanation-assessment approaches based on semantic similarity with alternative approaches based on direct Large Language Model (LLM) prompting. Our results show that the use of LLMs enables worked example systems that follow an active learning approach to reduce bias in evaluating example explanations. 
    more » « less
  3. This paper presents a comparison of two instructional strategies meant to help learners better comprehend code and learn programming concepts: reading code examples annotated with expert explanation (worked-out examples) versus scaffolded self-explanation of code examples using an automated system (Intelligent Tutoring System). A randomized controlled trial study was conducted with 90 university students who were assigned to either the control group (reading worked-out examples, a passive strategy) or the experimental group where participants were asked to self-explain and received help, if needed, in the form of questions from the tutoring system( scaffolded self-explanation, an interactive strategy). We found that students with low prior knowledge in the experimental condition had significantly higher learning gains than students with high prior knowledge. However, in the control condition, this distinction in learning outcomes based on prior knowledge was not observed. We also analyzed the effect of self-efficacy on learning gains and the nature of self-explanation. Low self-efficacy students learn almost twice as much in the interactive condition versus the passive condition although the difference was not significant probably because of low sample size. We also found that high self-efficacy students tend to provide more relational explanations whereas low self-efficacy students provide more multi-structural or line-by-line explanations. 
    more » « less
  4. Many studies have shown that visual representations can enhance student understanding of STEM concepts. However, prior research suggests that visual representations alone are not necessarily effective across a broad range of students. To address this problem, we created a novel, scaffolded form of diagrammatic self-explanation in which students explain their problem-solving steps in the form of diagrams. We used contrasting cases to support students’ sense-making between algebraic equations and diagrams in the self-explanation activity. We conducted a classroom experiment with 41 students in grades 5 and 6 to test the effectiveness of this strategy when embedded in an Intelligent Tutoring System for algebra. We found that scaffolded diagrammatic self-explanation enhanced conceptual knowledge for students who did not have prior knowledge of formal equation-solving strategies. The study is the first experimental study showing that visual representations can enhance conceptual knowledge in early algebra. 
    more » « less
  5. Gresalfi, M.; Horn, I. S. (Ed.)
    Many studies have shown that visual representations can enhance student understanding of STEM concepts. However, prior research suggests that visual representations alone are not necessarily effective across a broad range of students. To address this problem, we created a novel, scaffolded form of diagrammatic self-explanation in which students explain their problem-solving steps in the form of diagrams. We used contrasting cases to support students’ sense-making between algebraic equations and diagrams in the self-explanation activity. We conducted a classroom experiment with 41 students in grades 5 and 6 to test the effectiveness of this strategy when embedded in an Intelligent Tutoring System for algebra. We found that scaffolded diagrammatic self-explanation enhanced conceptual knowledge for students who did not have prior knowledge of formal equation-solving strategies. The study is the first experimental study showing that visual representations can enhance conceptual knowledge in early algebra. 
    more » « less