skip to main content


Title: Voice Design to Support Young Children’s Agency in Child-Agent Interaction
Agency is essential to play. As we design conversational agents for early childhood, how might we increase the child-centeredness of our approaches? Giving children agency and control in choosing their agent representations might contribute to the overall playfulness of our designs. In this study with 33 children ages 4–5 years old, we engaged children in a creative storytelling interaction with conversational agents in stuffed animal embodiments. Young children conversed with the stuffed animal agents to tell stories about their creative play, engaging in question and answer conversation from 2 minutes to 24 minutes. We then interviewed the children about their perceptions of the agent’s voice, and their ideas for agent voices, dialogues, and interactions. From babies to robot daddies, we discover three themes from children’s suggestions: Family Voices, Robot Voices, and Character Voices. Additionally, children desire agents who (1) scaffold creative play in addition to storytelling, (2) foster personal, social, and emotional connections, and (3) support children’s agency and control. Across these themes, we recommend design strategies to support the overall playful child-centeredness of conversational agent design.  more » « less
Award ID(s):
2019805
NSF-PAR ID:
10494294
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
ACM
Date Published:
Journal Name:
Association for Computing Machinery
Page Range / eLocation ID:
1 to 10
Format(s):
Medium: X
Location:
Bilbao (online) Spain
Sponsoring Org:
National Science Foundation
More Like this
  1. When young children create, they are exploring their emerging skills. And when young children reflect, they are transforming their learning experiences. Yet early childhood play environments often lack toys and tools to scaffold reflection. In this work, we design a stuffed animal robot to converse with young children and prompt creative reflection through open-ended storytelling. We also contribute six design goals for child-robot interaction design. In a hybrid Wizard of Oz study, 33 children ages 4-5 years old across 10 U.S. states engaged in creative play then conversed with a stuffed animal robot to tell a story about their creation. By analyzing children’s story transcripts, we discover four approaches that young children use when responding to the robot’s reflective prompting: Imaginative, Narrative Recall, Process-Oriented, and Descriptive Labeling. Across these approaches, we find that open-ended child-robot interaction can integrate personally meaningful reflective storytelling into diverse creative play practices. 
    more » « less
  2. Social robots are increasingly introduced into children’s lives as educational and social companions, yet little is known about how these products might best be introduced to their environments. The emergence of the “unboxing” phenomenon in media suggests that introduction is key to technology adoption where initial impressions are made. To better understand this phenomenon toward designing a positive unboxing experience in the context of social robots for children, we conducted three field studies with families of children aged 8 to 13: (1) an exploratory free-play activity (n = 12); (2) a co-design session (n = 11) that informed the development of a prototype box and a curated unboxing experience; and (3) a user study (n = 9) that evaluated children’s experiences. Our findings suggest the unboxing experience of social robots can be improved through the design of a creative aesthetic experience that engages the child socially to guide initial interactions and foster a positive child-robot relationship. 
    more » « less
  3. > Context • In 1972, Papert emphasized that “[t]he important difference between the work of a child in an elementary mathematics class and […]a mathematician” is “not in the subject matter […]but in the fact that the mathematician is creatively engaged […]” Along with creative, Papert kept saying children should be engaged in projects rather than problems. A project is not just a large problem, but involves sustained, active engagement, like children’s play. For Papert, in 1972, computer programming suggested a flexible construction medium, ideal for a research-lab/playground tuned to mathematics for children. In 1964, without computers, Sawyer also articulated research-playgrounds for children, rooted in conventional content, in which children would learn to act and think like mathematicians. > Problem • This target article addresses the issue of designing a formal curriculum that helps children develop the mathematical habits of mind of creative tinkering, puzzling through, and perseverance. I connect the two mathematicians/educators – Papert and Sawyer – tackling three questions: How do genuine puzzles differ from school problems? What is useful about children creating puzzles? How might puzzles, problem-posing and programming-centric playgrounds enhance mathematical learning? > Method • This analysis is based on forty years of curriculum analysis, comparison and construction, and on research with children. > Results • In physical playgrounds most children choose challenge. Papert’s ideas tapped that try-something-new and puzzle-it-out-for-yourself spirit, the drive for challenge. Children can learn a lot in such an environment, but what (and how much) they learn is left to chance. Formal educational systems set standards and structures to ensure some common learning and some equity across students. For a curriculum to tap curiosity and the drive for challenge, it needs both the playful looseness that invites exploration and the structure that organizes content. > Implications • My aim is to provide support for mathematics teachers and curriculum designers to design or teach in accord with their constructivist thinking. > Constructivist content • This article enriches Papert’s constructionism with curricular ideas from Sawyer and from the work that I and my colleagues have done 
    more » « less
  4. Storytelling is a critical step in the cognitive development of children. Particularly, this requires children to mentally project into the story context and to identify with the thoughts of the characters in their stories. We propose to support free imagination in creative storytelling through an enactment- based approach that allows children to embody an avatar and perform as the story character. We designed our story creation interface with two modes of avatar: the story-relevant avatar and the self-avatar, to investigate the effects of avatar design on the quality of children’s creative products. In our study with 20 child participants, the results indicate that self-avatars can create a stronger sense of identification and embodied presence, while story-relevant avatars can provide a scaffold for mental projection. 
    more » « less
  5. Background Increased adoption of off-the-shelf conversational agents (CAs) brings opportunities to integrate therapeutic interventions. Motivational Interviewing (MI) can then be integrated with CAs for cost-effective access to it. MI can be especially beneficial for parents who often have low motivation because of limited time and resources to eat healthy together with their children. Objective We developed a Motivational Interviewing Conversational Agent (MICA) to improve healthy eating in parents who serve as a proxy for health behavior change in their children. Proxy relationships involve a person serving as a catalyst for behavior change in another person. Parents, serving as proxies, can bring about behavior change in their children. Methods We conducted user test sessions of the MICA prototype to understand the perceived acceptability and usefulness of the MICA prototype by parents. A total of 24 parents of young children participated in 2 user test sessions with MICA, approximately 2 weeks apart. After parents’ interaction with the MICA prototype in each user test session, we used qualitative interviews to understand parents’ perceptions and suggestions for improvements in MICA. Results Findings showed participants’ perceived usefulness of MICAs for helping them self-reflect and motivating them to adopt healthier eating habits together with their children. Participants further suggested various ways in which MICA can help them safely manage their children’s eating behaviors and provide customized support for their proxy needs and goals. Conclusions We have discussed how the user experience of CAs can be improved to uniquely offer support to parents who serve as proxies in changing the behavior of their children. We have concluded with implications for a larger context of designing MI-based CAs for supporting proxy relationships for health behavior change. 
    more » « less