skip to main content
Explore Scholarly Publications and Datasets in the NSF-PAR

Title: Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI
Across a wide variety of domains, artificial agents that can adapt and personalize to users have potential to improve and transform how social services are provided. Because of the need for personalized interaction data to drive this process, long-term (or longitudinal) interactions between users and agents, which unfold over a series of distinct interaction sessions, have attracted substantial research interest. In recognition of the expanded scope and structure of a long-term interaction, researchers are also adjusting the personalization models and algorithms used, orienting toward “continual learning” methods, which do not assume a stationary modeling target and explicitly account for the temporal context of training data. In parallel, researchers have also studied the effect of “multitask personalization,” an approach in which an agent interacts with users over multiple different tasks contexts throughout the course of a long-term interaction and learns personalized models of a user that are transferrable across these tasks. In this paper, we unite these two paradigms under the framework of “Lifelong Personalization,” analyzing the effect of multitask personalization applied to dynamic, non-stationary targets. We extend the multi-task personalization approach to the more complex and realistic scenario of modeling dynamic learners over time, focusing in particular on interactive scenarios more » in which the modeling agent plays an active role in teaching the student whose knowledge the agent is simultaneously attempting to model. Inspired by the way in which agents use active learning to select new training data based on domain context, we augment a Gaussian Process-based multitask personalization model with a mechanism to actively and continually manage its own training data, allowing a modeling agent to remove or reduce the weight of observed data from its training set, based on interactive context cues. We evaluate this method in a series of simulation experiments comparing different approaches to continual and multitask learning on simulated student data. We expect this method to substantially improve learning in Gaussian Process models in dynamic domains, establishing Gaussian Processes as another flexible modeling tool for Long-term Human-Robot Interaction (HRI) Studies. « less
Authors:
; ; ;
Award ID(s):
1734443 1717362
Publication Date:
NSF-PAR ID:
10300774
Journal Name:
Frontiers in Robotics and AI
Volume:
8
ISSN:
2296-9144
Sponsoring Org:
National Science Foundation
More Like this
  1. ( , Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS '21))
    To help facilitate play and learning, game-based educational activities often feature a computational agent as a co-player. Personalizing this agent's behavior to the student player is an active area of research, and prior work has demonstrated the benefits of personalized educational interaction across a variety of domains. A critical research challenge for personalized educational agents is real-time student modeling. Most student models are designed for and trained on only a single task, which limits the variety, flexibility, and efficiency of student player model learning. In this paper we present a research project applying transfer learning methods to student player models over different educational tasks, studying the effects of an algorithmic "multi-task personalization" approach on the accuracy and data efficiency of student model learning. We describe a unified robotic game system for studying multi-task personalization over two different educational games, each emphasizing early language and literacy skills such as rhyming and spelling. We present a flexible Gaussian Process-based approach for rapidly learning student models from interactive play in each game, and a method for transferring each game's learned student model to the other via a novel instance-weighting protocol based on task similarity. We present results from a simulation-based investigation of themore »impact of multi-task personalization, establishing the core viability and benefits of transferrable student models and outlining new questions for future in-person research.« less
  2. ( , Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems)
    To help facilitate play and learning, game-based educational activities often feature a computational agent as a co-player. Personalizing this agent's behavior to the student player is an active area of research, and prior work has demonstrated the benefits of personalized educational interaction across a variety of domains. A critical research challenge for personalized educational agents is real-time student modeling. Most student models are designed for and trained on only a single task, which limits the variety, flexibility, and efficiency of student player model learning. In this paper we present a research project applying transfer learning methods to student player models over different educational tasks, studying the effects of an algorithmic "multi-task personalization" approach on the accuracy and data efficiency of student model learning. We describe a unified robotic game system for studying multi-task personalization over two different educational games, each emphasizing early language and literacy skills such as rhyming and spelling. We present a flexible Gaussian Process-based approach for rapidly learning student models from interactive play in each game, and a method for transferring each game's learned student model to the other via a novel instance-weighting protocol based on task similarity. We present results from a simulation-based investigation of themore »impact of multi-task personalization, establishing the core viability and benefits of transferrable student models and outlining new questions for future in-person research.« less
  3. ; ( , International Conference on Affective Computing and Intelligent Interaction and workshops)
    In recent years, researchers have developed technology to analyze human facial expressions and other affective data at very high time resolution. This technology is enabling researchers to develop and study interactive robots that are increasingly sensitive to their human interaction partners’ affective states. However, typical interaction planning models and algorithms operate on timescales that are frequently orders of magnitude larger than the timescales at which real-time affect data is sensed. To bridge this gap between the scales of sensor data collection and interaction modeling, affective data must be aggregated and interpreted over longer timescales. In this paper we clarify and formalize the computational task of affect interpretation in the context of an interactive educational game played by a human and a robot, during which facial expression data is sensed, interpreted, and used to predict the interaction partner’s gameplay behavior. We compare different techniques for affect interpretation, used to generate sets of affective labels for an interactive modeling and inference task, and evaluate how the labels generated by each interpretation technique impact model training and inference. We show that incorporating a simple method of personalization into the affect interpretation process — dynamically calculating and applying a personalized threshold for determining affectmore »feature labels over time — leads to a significant improvement in the quality of inference, comparable to performance gains from other data pre-processing steps such as smoothing data via median filter. We discuss the implications of these findings for future development of affect-aware interactive robots and propose guidelines for the use of affect interpretation methods in interactive scenarios.« less
  4. ( , autonomous agents and multi agent systems 2018)
    Autonomous educational social robots can be used to help promote literacy skills in young children. Such robots, which emulate the emotive, perceptual, and empathic abilities of human teachers, are capable of replicating some of the benefits of one-on-one tutoring from human teachers, in part by leveraging individual student’s behavior and task performance data to infer sophisticated models of their knowledge. These student models are then used to provide personalized educational experiences by, for example, determining the optimal sequencing of curricular material. In this paper, we introduce an integrated system for autonomously analyzing and assessing children’s speech and pronunciation in the context of an interactive word game between a social robot and a child. We present a novel game environment and its computational formulation, an integrated pipeline for capturing and analyzing children’s speech in real-time, and an autonomous robot that models children’s word pronunciation via Gaussian Process Regression (GPR), augmented with an Active Learning protocol that informs the robot’s behavior. We show that the system is capable of autonomously assessing children’s pronunciation ability, with ground truth determined by a post-experiment evaluation by human raters. We also compare phoneme- and word-level GPR models and discuss trade-offs of each approach in modeling children’smore »pronunciation. Finally, we describe and analyze a pipeline for automatic analysis of children’s speech and pronunciation, including an evaluation of Speech Ace as a tool for future development of autonomous, speech-based language tutors.« less
  5. ; ( , American Society for Engineering Education Annual Conference and Exhibition)
    Cyclical models are often used to describe how students learn and develop. These models usually focus on the cognitive domain and describe how knowledge and skills are learned within a course or classroom. By providing insights into how students learn and thus how an instructor can support learning, these models and the schemas drawn from them also influence beliefs about learning and thus how educational programs are designed and developed. In this paper the authors present an alternative cyclical model of learning that is drawn from a philosophy of enactivism rather than rational dualism. In comparison with the dualism inherent in viewpoints derived from Descartes where learners construct internal mental representation from inputs received from the external world, in enactivism development occurs through continual dynamic interactions between an agent and their environment. Enactivism thus emphasizes the role environments play in learning and development. The model developed in this paper hypothesizes that the environment in which learning typically occurs can be represented by three elements: the learner’s identity and culture which informs personally significant goals and values; the affordances a degree program offers in areas of knowledge, identity, and context which informs the capabilities of the environment; and the implicit andmore »explicit goals of education as they are negotiated and understood by learners and teachers. These three elements are strongly coupled and together define the ever-changing learning environment. The paper explores how changing technologies and cultures affect each of these three elements in regards to students’ ability to become technologically literate. While rational or dualist views of education see such environmental changes as peripheral to developing accurate representations of truth, enactivism posits that environment significantly affects the process of education. Because each student or faculty member is a participant in a learning organization changes within the organization—whether externally or internally driven—change the learning process. If education is deemed successful when students can transfer learning to new contexts, dualist models assume transfer is weakly coupled to educational environments while the enactivist viewpoint posits that environments strongly affect transfer. The enactivist model can inform efforts to encourage technological literacy. Like many areas in STEM, education technological literacy has sought to identify and support learning outcomes that specify effective teaching or content interventions which enable learners to become more technologically literate. From the enactivist perspective, however, technological literacy is achieved by placing individuals into an environment in which they must navigate technology-induced challenges, with success defined as learning processes that allow learners to manage tensions inherent in their environment. Because most students already live in such environments teaching definable or enumerable outcomes makes less sense than helping student to be metacognitive and reflective how they manage and relate with technology.« less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email