skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: “Elinor’s Talking to Me!”:Integrating Conversational AI into Children’s Narrative Science Programming
Video programs are important, accessible educational resources for young children, especially those from an under-resourced backgrounds. These programs’ potential can be amplified if children are allowed to socially interact with media characters during their video watching. This paper presents the design and empirical investigation of interactive science-focused videos in which the main character, powered by a conversational agent, engaged in contingent conversation with children by asking children questions and providing responsive feedback. We found that children actively interacted with the media character in the conversational videos and their parents spontaneously provided support in the process. We also found that the children who watched the conversational video performed better in the immediate, episode-specific science assessment compared to their peers who watched the broadcast, non-interactive version of the same episode. Several design implications are discussed for using conversational technologies to better support child active learning and parent involvement in video watching.  more » « less
Award ID(s):
2115382
PAR ID:
10346104
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
Page Range / eLocation ID:
1 to 16
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. My dissertation project leverages an intelligent conversational agent embodied in an on-screen character to add social contingency into children’s science video watching experiences. This conversational agent has been developed in an iterative process and embedded in a new PBS KIDS science show, "Elinor Wonders Why." My research aims to understand the design, feasibility, and promise of virtual conversation with media characters in young children’s informal science learning through video watching. 
    more » « less
  2. COVID‐19 greatly increased the online delivery of higher education. But one limitation of online learning is that students often struggle to stay engaged while watching online lectures. We examined whether including an instructor's face in lecture videos (instructor visibility) enhances student engagement or learning. In two preregistered experiments, we found that instructor visibility in lecture videos did not affect either engagement or learning overall. However, participants reported higher engagement when they watched a video that aligned with their preference for instructor visibility. For example, participants who favored videos with the instructor visible reported greater engagement with such videos compared to those without the instructor, and vice versa. Additionally, we examined the effects of playback speed on engagement and learning. Our results suggest that speeded playing did not impact engagement but resulted in better learning efficiency. Lastly, using GPT, we explored participants' open‐ended responses to understand their preference for video lectures. 
    more » « less
  3. Abstract A rapidly growing number of TV weathercasters are reporting on the local implications of climate change, although little is known about the effectiveness of such communication. To test the impact of localized climate reporting, we conducted an internet-based randomized controlled experiment in which local TV news viewers (n = 1,200) from two American cities (Chicago and Miami) watched either three localized climate reports or three standard weather reports featuring a prominent TV weathercaster from their city; each of the videos was between 1 and 2 min in duration. Participants’ understanding of climate change as real, human-caused, and locally relevant was assessed with a battery of questions after watching the set of three videos. Compared to participants who watched weather reports, participants who watched climate reports became significantly more likely to 1) understand that climate change is happening, is human-caused, and is causing harm in their community; 2) feel that climate change is personally relevant and express greater concern about it; and 3) feel that they understand how climate change works and express greater interest in learning more about it. In short, our findings demonstrate that watching even a brief amount of localized climate reporting (less than 6 min) delivered by TV weathercasters helps viewers develop a more accurate understanding of global climate change as a locally and personally relevant problem, and offer strong support for this promising approach to promoting enhanced public understanding of climate change through public media. 
    more » « less
  4. Agency is essential to play. As we design conversational agents for early childhood, how might we increase the child-centeredness of our approaches? Giving children agency and control in choosing their agent representations might contribute to the overall playfulness of our designs. In this study with 33 children ages 4–5 years old, we engaged children in a creative storytelling interaction with conversational agents in stuffed animal embodiments. Young children conversed with the stuffed animal agents to tell stories about their creative play, engaging in question and answer conversation from 2 minutes to 24 minutes. We then interviewed the children about their perceptions of the agent’s voice, and their ideas for agent voices, dialogues, and interactions. From babies to robot daddies, we discover three themes from children’s suggestions: Family Voices, Robot Voices, and Character Voices. Additionally, children desire agents who (1) scaffold creative play in addition to storytelling, (2) foster personal, social, and emotional connections, and (3) support children’s agency and control. Across these themes, we recommend design strategies to support the overall playful child-centeredness of conversational agent design. 
    more » « less
  5. Evans, Tanya; Marmur, Ofer; Hunter, Jodie; Leach, Generosa; Jhagroo, Jyoti (Ed.)
    Dialogic instructional videos feature authentic conversations of students as they engage in complex mathematical problems. Because these videos show students engaging in rich mathematical interactions students might use them as models for how they should engage in such interactions. In this study, we investigated how watching a dialogic video that showed two students creating pictures to illustrate mathematical relationships shaped what two pairs of students thought was necessary to include in their own pictures. We found that while the video the students watched did indeed shape what they thought was necessary to include in their pictures, the degree to which they felt they needed to mirror the pictures in the video varied considerably. 
    more » « less