skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Designing Emotionally Expressive Social Commentary to Facilitate Child-Robot Interaction
Emotion expression in human-robot interaction has been widely explored, however little is known about how such expressions should be coupled with feelings and opinions expressed by a social robot. We explored how 12 children experienced emotionally expressive social commentaries from a reading companion robot across five interaction styles that differed in their non-verbal emotional expressiveness and opinionated conversational styles (neutral, divergent, or convergent opinions). We found that, while the robot’s opinions and non-verbal emotion expressions affected children’s experiences with the robot, the speech content of the commentaries was the more prominent factor in their experience. Additionally, children differed in their perceptions of social commentary: while some expressed a sense of connection-making with the robot’s self-disclosure commentaries, others felt distracted by them or felt like the robot was off-topic. We recommend designers pay particular attention to the robot’s speech content and consider children’s individual differences in designing emotional and opinionated speech.  more » « less
Award ID(s):
1906854
PAR ID:
10293591
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
IDC '21: Interaction Design and Children
Page Range / eLocation ID:
314 to 325
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The majority of research on infants’ and children’s understanding of emotional expressions has focused on their abilities to use emotional expressions to infer how other people feel. However, an emerging body of work suggests that emotional expressions support rich, powerful inferences not just about emotional states but also about other unobserved states, such as hidden events in the physical world and mental states of other people (e.g., beliefs and desires). Here we argue that infants and children harness others’ emotional expressions as a source of information for learning about the physical and social world broadly. This “emotion as information” framework integrates affective, developmental, and computational cognitive sciences, extending the scope of signals that count as “information” in early learning. 
    more » « less
  2. Social robots are emerging as learning companions for children, and research shows that they facilitate the development of interest and learning even through brief interactions. However, little is known about how such technologies might support these goals in authentic environments over long-term periods of use and interaction. We designed a learning companion robot capable of supporting children reading popular-science books by expressing social and informational commentaries. We deployed the robot in homes of 14 families with children aged 10–12 for four weeks during the summer. Our analysis revealed critical factors that affected children’s long-term engagement and adoption of the robot, including external factors such as vacations, family visits, and extracurricular activities; family/parental involvement; and children’s individual interests. We present four in-depth cases that illustrate these factors and demonstrate their impact on children’s reading experiences and discuss the implications of our findings for robot design. 
    more » « less
  3. null (Ed.)
    Children’s early numerical knowledge establishes a foundation for later development of mathematics achievement and playing linear number board games is effective in improving basic numeri- cal abilities. Besides the visuo-spatial cues provided by traditional number board games, learning companion robots can integrate multi-sensory information and offer social cues that can support children’s learning experiences. We explored how young children experience sensory feedback (audio and visual) and social expressions from a robot when playing a linear number board game, “RoboMath.” We present the interaction design of the game and our investigation of children’s (n = 19, aged 4) and parents’ experiences under three conditions: (1) visual-only, (2) audio-visual, and (3) audio- visual-social robot interaction. We report our qualitative analysis, including the themes observed from interviews with families on their perceptions of the game and the interaction with the robot, their child’s experiences, and their design recommendations. 
    more » « less
  4. Emotional expressions are abundant in children’s lives. What role do they play in children’s causal inference and exploration? This study investigates whether preschool‐aged children use others’ emotional expressions to infer the presence of unknown causal functions and guide their exploration accordingly. Children (age: 3.0–4.9;N = 112, the United States) learned about one salient causal function of a novel toy and then saw an adult play with it. Children explored the toy more when the adult expressed surprise than when she expressed happiness (Experiment 1), but only when the adult already knew about the toy’s salient function (Experiment 2). These results suggest that children consider others’ knowledge and selectively interpret others’ surprise asvicarious predictionerrorto guide their own exploration. 
    more » « less
  5. Human emotions are expressed through multiple modalities, including verbal and non-verbal information. Moreover, the affective states of human users can be the indicator for the level of engagement and successful interaction, suitable for the robot to use as a rewarding factor to optimize robotic behaviors through interaction. This study demonstrates a multimodal human-robot interaction (HRI) framework with reinforcement learning to enhance the robotic interaction policy and personalize emotional interaction for a human user. The goal is to apply this framework in social scenarios that can let the robots generate a more natural and engaging HRI framework. 
    more » « less