skip to main content


Title: Personalized Robot Tutoring using the Assistive Tutor POMDP (AT-POMDP)
Selecting appropriate tutoring help actions that account for both a student’s content mastery and engagement level is essential for effective human tutors, indicating the critical need for these skills in autonomous tutors. In this work, we formulate the robot-student tutoring help action selection problem as the Assistive Tutor partially observable Markov decision process (AT-POMDP). We designed the AT-POMDP and derived its parameters based on data from a prior robot-student tutoring study. The policy that results from solving the ATPOMDP allows a robot tutor to decide upon the optimal tutoring help action to give a student, while maintaining a belief of the student’s mastery of the material and engagement with the task. This approach is validated through a between-subjects field study, which involved 4th grade students (n = 28) interacting with a social robot solving long division problems over five sessions. Students who received help from a robot using the AT-POMDP policy demonstrated significantly greater learning gains than students who received help from a robot with a fixed help action selection policy. Our results demonstrate that this robust computational framework can be used effectively to deliver diverse and personalized tutoring support over time for students.  more » « less
Award ID(s):
1813651
NSF-PAR ID:
10105988
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
AAAI
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In an earlier work, the authors compared the writing style of Mechanical Engineering Technology (MET) students in an “untutored” state to the writing style of “tutored” students, where the tutoring was provided by “generic” writing center tutors. The results of this study showed that aside from changes in the diction of the students’ work, there was little measurable improvement in the quality of student writing as measured by both the AAC&U VALUE Rubric and by the authors’ voice-development-style-diction method. The current work builds on the results of the previous work by providing training on a just-in-time basis for the writing center tutors. As with previous years, the students participating in the study were MET students in a last-semester capstone industrial design course. This course is organized around a series of open-ended industry-sponsored projects for which the students are expected to develop a solution to a mechanical engineering problem. The students work on the projects in teams of three or four students and complete the work over a two-semester sequence offered annually on a fall-spring basis. The assignment in the study was identical to that of previous years: an “analysis” report in which students are expected to apply content from previous courses to one aspect of the industry-sponsored design project. The present study will compare the results from three iterations of the study: the work of “untutored” students, i.e. those who did not received any writing center assistance whatsoever, those who tutored by “generic” writing center tutors, and lastly, the works of those tutored by tutors specifically trained in support of the specific intervention. In the two cases where tutor interaction occurred, it was required as a component of the course to ensure participation by the entire student cohort. In general, the interactions with the specially-trained tutors produced works with a more mature writing style on the part of the student as compared to those works produced by students who had interacted with the untrained tutors or no tutors at all. The work will also discuss survey data collected on the “generic” and specially-trained tutoring sessions and discuss the differences in the results. Preliminary results show that the specially-trained tutors reported pronounced levels of engagement in the tutoring session, as measured by student note-taking, student questions, student receptiveness to suggestions, and student desire to understand the reasoning behind the tutors’ suggestions. Specially-trained tutors also reported significantly higher levels of student interest suggestions about grammar, style, content, format, and citations. Overall, it is concluded that specific training for the tutors was most associated with increased levels of interaction between tutor and student. As the students in the final group (“trained tutors”) were told prior to the tutoring session that the tutors were “specially trained,” it remains to be determined if the increased interaction was due to better tutor preparation or a higher estimation of the value of the tutoring session on the part of the students receiving the tutoring. This is proposed as an extension to the current work. 
    more » « less
  2. In an earlier work, the authors compared the writing style of Mechanical Engineering Technology (MET) students in an “untutored” state to the writing style of “tutored” students, where the tutoring was provided by “generic” writing center tutors. The results of this study showed that aside from changes in the diction of the students’ work, there was little measurable improvement in the quality of student writing as measured by both the AAC&U VALUE Rubric and by the authors’ voice-development-style-diction method. The current work builds on the results of the previous work by providing training on a just-in-time basis for the writing center tutors. As with previous years, the students participating in the study were MET students in a last-semester capstone industrial design course. This course is organized around a series of open-ended industry-sponsored projects for which the students are expected to develop a solution to a mechanical engineering problem. The students work on the projects in teams of three or four students and complete the work over a two-semester sequence offered annually on a fall-spring basis. The assignment in the study was identical to that of previous years: an “analysis” report in which students are expected to apply content from previous courses to one aspect of the industry-sponsored design project. The present study will compare the results from three iterations of the study: the work of “untutored” students, i.e. those who did not received any writing center assistance whatsoever, those who tutored by “generic” writing center tutors, and lastly, the works of those tutored by tutors specifically trained in support of the specific intervention. In the two cases where tutor interaction occurred, it was required as a component of the course to ensure participation by the entire student cohort. In general, the interactions with the specially-trained tutors produced works with a more mature writing style on the part of the student as compared to those works produced by students who had interacted with the untrained tutors or no tutors at all. The work will also discuss survey data collected on the “generic” and specially-trained tutoring sessions and discuss the differences in the results. Preliminary results show that the specially-trained tutors reported pronounced levels of engagement in the tutoring session, as measured by student note-taking, student questions, student receptiveness to suggestions, and student desire to understand the reasoning behind the tutors’ suggestions. Specially-trained tutors also reported significantly higher levels of student interest suggestions about grammar, style, content, format, and citations. Overall, it is concluded that specific training for the tutors was most associated with increased levels of interaction between tutor and student. As the students in the final group (“trained tutors”) were told prior to the tutoring session that the tutors were “specially trained,” it remains to be determined if the increased interaction was due to better tutor preparation or a higher estimation of the value of the tutoring session on the part of the students receiving the tutoring. This is proposed as an extension to the current work. 
    more » « less
  3. Abstract

    Learning to derive subgoals reduces the gap between experts and students and makes students prepared for future problem solving. Researchers have explored subgoal-labeled instructional materials in traditional problem solving and within tutoring systems to help novices learn to subgoal. However, only a little research is found on problem-solving strategies in relationship with subgoal learning. Also, these strategies are under-explored within computer-based tutors and learning environments. The backward problem-solving strategy is closely related to the process of subgoaling, where problem solving iteratively refines the goal into a new subgoal to reduce difficulty. In this paper, we explore a training strategy for backward strategy learning within an intelligent logic tutor that teaches logic-proof construction. The training session involved backward worked examples (BWE) and problem solving (BPS) to help students learn backward strategy towards improving their subgoaling and problem-solving skills. To evaluate the training strategy, we analyzed students’ 1) experience with and engagement in learning backward strategy, 2) performance and 3) proof construction approaches in new problems that they solved independently without tutor help after each level of training and in posttest. Our results showed that, when new problems were given to solve without any tutor help, students who were trained with both BWE and BPS outperformed students who received none of the treatment or only BWE during training. Additionally, students trained with both BWE and BPS derived subgoals during proof construction with significantly higher efficiency than the other two groups.

     
    more » « less
  4. null (Ed.)
    Determining when and whether to provide personalized support is a well-known challenge called the assistance dilemma. A core problem in solving the assistance dilemma is the need to discover when students are unproductive so that the tutor can intervene. Such a task is particularly challenging for open-ended domains, even those that are well-structured with defined principles and goals. We present a set of datadriven methods to classify, predict, and prevent unproductive problem-solving steps in the well-structured open-ended domain of logic. This approach leverages and extends the Hint Factory, a set of methods that leverages prior student solution attempts to build data-driven intelligent tutors. We present a HelpNeed classification that uses prior student data to determine when students are likely to be unproductive and need help learning optimal problem-solving strategies. We present a controlled study to determine the impact of an Adaptive pedagogical policy that provides proactive hints at the start of each step based on the outcomes of our HelpNeed predictor: productive vs. unproductive. Our results show that the students in the Adaptive condition exhibited better training behaviors, with lower help avoidance, and higher help appropriateness (a higher chance of receiving help when it was likely to be needed), as measured using the HelpNeed classifier, when compared to the Control. Furthermore, the results show that the students who received Adaptive hints based on HelpNeed predictions during training significantly outperform their Control peers on the posttest, with the former producing shorter, more optimal solutions in less time. We conclude with suggestions on how these HelpNeed methods could be applied in other well-structured open-ended domains. 
    more » « less
  5. Understanding how students with varying capabilities think about problem solving can greatly help in improving personalized education which can have significantly better learning outcomes. Here, we present the details of a system we call NeTra that we developed for discovering strategies that students follow in the context of Math learning. Specifically, we developed this system from large-scale data from MATHia that contains millions of student-tutor interactions. The goal of this system is to provide a visual interface for educators to understand the likely strategy the student will follow for problems that students are yet to attempt. This predictive interface can help educators/tutors to develop interventions that are personalized for students. Underlying the system is a powerful AI model based on Neuro-Symbolic learning that has shown promising results in predicting both strategies and the mastery over concepts used in the strategy. 
    more » « less