skip to main content


Title: Automatic Measurement of Teachers' Talk: Indicators of Location and Quality in Science Activities
A key goal of Next Generation Science Standards is to promote interest and exploration of natural phenomena. In preschool settings, teachers prompt exploration by asking questions, encouraging informal exploration and experimentation. To date, live or offline video observation has been the sole way to capture the quality of teacher question asking in the pre-k classroom (e.g., Sanders et al., 2016). To date, Automatic Speech Recognition (ASR) has not been used to measure the content/quality of teacher talk. Here, we used ASR to quantify preschool teachers’ use of keywords that promote student exploration and inquiry.  more » « less
Award ID(s):
2016725
NSF-PAR ID:
10180041
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
CRIEI-2020: Conf. on Research Innovations in Early Intervention
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Monitoring child development in terms of speech/language skills has a long-term impact on their overall growth. As student diversity continues to expand in US classrooms, there is a growing need to benchmark social-communication engagement, both from a teacher-student perspective, as well as student-student content. Given various challenges with direct observation, deploying speech technology will assist in extracting meaningful information for teachers. These will help teachers to identify and respond to students in need, immediately impacting their early learning and interest. This study takes a deep dive into exploring various hybrid ASR solutions for low-resource spontaneous preschool (3-5yrs) children (with & without developmental delays) speech, being involved in various activities, and interacting with teachers and peers in naturalistic classrooms. Various out-of-domain corpora over a wide and limited age range, both scripted and spontaneous were considered. Acoustic models based on factorized TDNNs infused with Attention, and both N-gram and RNN language models were considered. Results indicate that young children have significantly different/ developing articulation skills as compared to older children. Out-of-domain transcripts of interactions between young children and adults however enhance language model performance. Overall transcription of such data, including various non-linguistic markers, poses additional challenges. 
    more » « less
  2. To support preschool children’s learning about data in an applied way that allows children to leverage their existing mathematical knowledge (i.e. counting, sorting, classifying, comparing) and apply it to answering authentic, developmentally appropriate research questions with data. To accomplish this ultimate goal, a design-based research approach [1] was used to develop and test a classroom-based preschool intervention that includes hands-on, play-based investigations with a digital app that supports and scaffolds the investigation process for teachers and children. This formative study was part of a codesign process with teachers to elicit feedback on the extent to which the series of investigations focused on data collection and analysis (DCA) and the teacher-facing app were (a) developmentally appropriate, (b) aligned with current preschool curricula and routines, (c) feasible to implement, and (d) included design elements and technology affordances teachers felt were useful and anticipated to promote learning. Researchers conducted in-depth interviews (n=10) and an online survey (n=19) with preschool teachers. Findings suggest that teaching preschoolers how to collect and analyze data in a hands-on, play-based, and developmentally appropriate way is feasible and desirable for preschool teachers. Specifically, teachers reported that the initial conceptualization of the investigations were developmentally appropriate, aligned with existing curricular activities and goals, was adaptable for the age and developmental readiness of young children, and that the affordances of the technology are likely to allow preschool children to engage meaningfully in data collection, visualization, and analysis. Findings also suggest that this approach to supporting preschool teachers and children to learn about and conduct DCA merits further study to ensure productive curricular implementation that positively influences preschoolers’ learning. These findings were used to revise the investigations and app, which showed positive outcomes when used in classrooms [2], which add to the scant literature on DCA learning for pre-schoolers and provides insights into the best ways to integrate technology into the classroom. 
    more » « less
  3. Speech and language development in children are crucial for ensuring effective skills in their long-term learning ability. A child’s vocabulary size at the time of entry into kindergarten is an early indicator of their learning ability to read and potential long-term success in school. The preschool classroom is thus a promising venue for assessing growth in young children by measuring their interactions with teachers as well as classmates. However, to date limited studies have explored such naturalistic audio communications. Automatic Speech Recognition (ASR) technologies provide an opportunity for ’Early Childhood’ researchers to obtain knowledge through automatic analysis of naturalistic classroom recordings in measuring such interactions. For this purpose, 208 hours of audio recordings across 48 daylong sessions are collected in a childcare learning center in the United States using Language Environment Analysis (LENA) devices worn by the preschool children. Approximately 29 hours of adult speech and 26 hours of child speech is segmented using manual transcriptions provided by CRSS transcription team. Traditional as well as End-to-End ASR models are trained on adult/child speech data subset. Factorized Time Delay Neural Network provides a best Word-Error-Rate (WER) of 35.05% on the adult subset of the test set. End-to-End transformer models achieve 63.5% WER on the child subset of the test data. Next, bar plots demonstrating the frequency of WH-question words in Science vs. Reading activity areas of the preschool are presented for sessions in the test set. It is suggested that learning spaces could be configured to encourage greater adult-child conversational engagement given such speech/audio assessment strategies. 
    more » « less
  4. null (Ed.)
    Speech and language development in children is crucial for ensuring optimal outcomes in their long term development and life-long educational journey. A child’s vocabulary size at the time of kindergarten entry is an early indicator of learning to read and potential long-term success in school. The preschool classroom is thus a promising venue for monitoring growth in young children by measuring their interactions with teachers and classmates. Automatic Speech Recognition (ASR) technologies provide the ability for ‘Early Childhood’ researchers for automatically analyzing naturalistic recordings in these settings. For this purpose, data are collected in a high-quality childcare center in the United States using Language Environment Analysis (LENA) devices worn by the preschool children. A preliminary task for ASR of daylong audio recordings would involve diarization, i.e., segmenting speech into smaller parts for identifying ‘who spoke when.’ This study investigates a Deep Learning-based diarization system for classroom interactions of 3-5-year-old children. However, the focus is on ’speaker group’ diarization, which includes classifying speech segments as being from adults or children from across multiple classrooms. SincNet based diarization systems achieve utterance level Diarization Error Rate of 19.1%. Utterance level speaker group confusion matrices also show promising, balanced results. These diarization systems have potential applications in developing metrics for adult-to-child or child-to-child rapid conversational turns in a naturalistic noisy early childhood setting. Such technical advancements will also help teachers better and more efficiently quantify and understand their interactions with children, make changes as needed, and monitor the impact of those changes. 
    more » « less
  5. The Next Generation Science Standards [1] recognized evidence-based argumentation as one of the essential skills for students to develop throughout their science and engineering education. Argumentation focuses students on the need for quality evidence, which helps to develop their deep understanding of content [2]. Argumentation has been studied extensively, both in mathematics and science education but also to some extent in engineering education (see for example [3], [4], [5], [6]). After a thorough search of the literature, we found few studies that have considered how teachers support collective argumentation during engineering learning activities. The purpose of this program of research was to support teachers in viewing argumentation as an important way to promote critical thinking and to provide teachers with tools to implement argumentation in their lessons integrating coding into science, technology, engineering, and mathematics (which we refer to as integrative STEM). We applied a framework developed for secondary mathematics [7] to understand how teachers support collective argumentation in integrative STEM lessons. This framework used Toulmin’s [8] conceptualization of argumentation, which includes three core components of arguments: a claim (or hypothesis) that is based on data (or evidence) accompanied by a warrant (or reasoning) that relates the data to the claim [9], [8]. To adapt the framework, video data were coded using previously established methods for analyzing argumentation [7]. In this paper, we consider how the framework can be applied to an elementary school teacher’s classroom interactions and present examples of how the teacher implements various questioning strategies to facilitate more productive argumentation and deeper student engagement. We aim to understand the nature of the teacher’s support for argumentation—contributions and actions from the teacher that prompt or respond to parts of arguments. In particular, we look at examples of how the teacher supports students to move beyond unstructured tinkering (e.g., trial-and-error) to think logically about coding and develop reasoning for the choices that they make in programming. We also look at the components of arguments that students provide, with and without teacher support. Through the use of the framework, we are able to articulate important aspects of collective argumentation that would otherwise be in the background. The framework gives both eyes to see and language to describe how teachers support collective argumentation in integrative STEM classrooms. 
    more » « less