Personalized education technologies capable of delivering adaptive interventions could play an important role in addressing the needs of diverse young learners at a critical time of school readiness. We present an innovative personalized social robot learning companion system that utilizes children’s verbal and nonverbal affective cues to modulate their engagement and maximize their long-term learning gains. We propose an affective reinforcement learning approach to train a personalized policy for each student during an educational activity where a child and a robot tell stories to each other. Using the personalized policy, the robot selects stories that are optimized for each child’s engagement and linguistic skill progression. We recruited 67 bilingual and English language learners between the ages of 4–6 years old to participate in a between-subjects study to evaluate our system. Over a three-month deployment in schools, a unique storytelling policy was trained to deliver a personalized story curriculum for each child in the Personalized group. We compared their engagement and learning outcomes to a Non-personalized group with a fixed curriculum robot, and a baseline group that had no robot intervention. In the Personalization condition, our results show that the affective policy successfully personalized to each child to boost their engagement and outcomes with respect to learning and retaining more target words as well as using more target syntax structures as compared to children in the other groups.
more »
« less
Promoting Social Engagement With a Multi-Role Dancing Robot for In-Home Autism Care
This work describes the design of real-time dance-based interaction with a humanoid robot, where the robot seeks to promote physical activity in children by taking on multiple roles as a dance partner. It acts as a leader by initiating dances but can also act as a follower by mimicking a child’s dance movements. Dances in the leader role are produced by a sequence-to-sequence (S2S) Long Short-Term Memory (LSTM) network trained on children’s music videos taken from YouTube. On the other hand, a music orchestration platform is implemented to generate background music in the follower mode as the robot mimics the child’s poses. In doing so, we also incorporated the largely unexplored paradigm of learning-by-teaching by including multiple robot roles that allow the child to both learn from and teach to the robot. Our work is among the first to implement a largely autonomous, real-time full-body dance interaction with a bipedal humanoid robot that also explores the impact of the robot roles on child engagement. Importantly, we also incorporated in our design formal constructs taken from autism therapy, such as the least-to-most prompting hierarchy, reinforcements for positive behaviors, and a time delay to make behavioral observations. We implemented a multimodal child engagement model that encompasses both affective engagement (displayed through eye gaze focus and facial expressions) as well as task engagement (determined by the level of physical activity) to determine child engagement states. We then conducted a virtual exploratory user study to evaluate the impact of mixed robot roles on user engagement and found no statistically significant difference in the children’s engagement in single-role and multiple-role interactions. While the children were observed to respond positively to both robot behaviors, they preferred the music-driven leader role over the movement-driven follower role, a result that can partly be attributed to the virtual nature of the study. Our findings support the utility of such a platform in practicing physical activity but indicate that further research is necessary to fully explore the impact of each robot role.
more »
« less
- Award ID(s):
- 1846658
- PAR ID:
- 10397731
- Date Published:
- Journal Name:
- Frontiers in Robotics and AI
- Volume:
- 9
- ISSN:
- 2296-9144
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Research on social, emotional, and academic development of children often notes the critical role of parents. Yet, how parents perceive and engage with children’s reactions to difficulty and perceived failure, to then shape their perspective and engagement with learning remains under investigated. The current study explored children and parents’ perceptions of and reactions to frustration and failure within an out-of-school, home-based engineering program. Specifically, we asked 1) How was failure perceived by participating families? and 2) What was the subsequent action/reaction to that failure? Data were derived from post-program interviews with children and parents who participated in a home-based, elementary engineering program involving take-home kits and self-identified engineering projects. Findings derived from descriptive qualitative methods and thematic analysis illustrated development of parent thinking around failure and frustration, both within themselves and their reactions to seeing such emotions in their children. Analysis further revealed how such emotions emerge within their children and impact their experiences. These findings shed light on ways child-parent engagement and the tactics employed by parents may influence a child’s perseverance and willingness to work through difficulty. This research represents an entry point for investigating how parents perceive and react to failures and challenges, and how these reactions shape their communication around failure with their children. Such parental reactions and communication may shape children’s mindset development, perspectives, and engagement. Implications for family engagement and influence on children’s learning through academic emotions in STEM and engineering are discussed.more » « less
-
Impact of Interaction Context on the Student Affect-Learning Relationship in Child-Robot InteractionPrior work in affect-aware educational robots has often relied on a common belief that the relationship between student affect and learning is independent of agent behaviors (child’s/robot’s) or unidirectional (positive/negative but not both) throughout the entire student-robot interaction.We argue that the student affect-learning relationship should be interpreted in two contexts: (1) social learning paradigm and (2) sub-events within child-robot interaction. In our paper, we examine two different social learning paradigms where children interact with a robot that acts either as a tutor or a tutee. Sub-events within child-robot interaction are defined as task-related events occurring in specific phases of an interaction (e.g., when the child/robot gets a wrong answer). We examine subevents at a macro level (entire interaction) and a micro level (within specific sub-events). In this paper, we provide an in-depth correlation analysis of children’s facial affect and vocabulary learning. We found that children’s affective displays became more predictive of their vocabulary learning when children interacted with a tutee robot who did not scaffold their learning. Additionally, children’s affect displayed during micro-level events was more predictive of their learning than during macro-level events. Last, we found that the affect-learning relationship is not unidirectional, but rather is modulated by context, i.e., several affective states facilitated student learning when displayed in some sub-events but inhibited learning when displayed in others. These findings indicate that both social learning paradigm and sub-events within interaction modulate student affect-learning relationship.more » « less
-
null (Ed.)Caregivers are one of the most significant influences in their children’s engineering engagement at a young age; however, the roles caregivers can play in supporting their children is less understood. Employing an intrinsic case study on a five-month engineering program conducted in an out-of-school context, we illustrate the multiple and different roles that three caregivers enacted, and the contextual factors of the program that influenced and shaped their role enactment. We observed 12 dynamic, complex, and evolving roles that caregivers endorsed to support their child throughout the engineering design process. These roles were situated within preexisting rules and expectations as caregivers while also developing an understanding of the rules and expectations of an engineer through their social interactions with volunteer engineers and makers. This work contributes to our understanding of how to create environments to enable caregivers to best support their children’s STEM learning process.more » « less
-
Although child participation is required for successful Type 1 Diabetes (T1D) management, it is challenging because the child’s young age and immaturity make it difficult to perform self-care. Thus, parental caregivers are expected to be heavily involved in their child’s everyday illness management. Our study aims to investigate how children and parents collaborate to manage T1D and examine how the children become more independent in their self-management through the support of their parents. Through semi-structured interviews with children with T1D and their parents (N=41), our study showed that children’s knowledge of illness management and motivation for self-care were crucial for their transition towards independence. Based on these two factors, we identified four types of children’s collaboration (i.e., dependent, resistant, eager, and independent) and parents’ strategies for supporting their children’s independence. We suggest design implications for technologies to support collaborative care by improving children’s transition to independent illness management.more » « less