Purpose:Augmentative and alternative communication (AAC) technology innovation is urgently needed to improve outcomes for children on the autism spectrum who are minimally verbal. One potential technology innovation is applying artificial intelligence (AI) to automate strategies such as augmented input to increase language learning opportunities while mitigating communication partner time and learning barriers. Innovation in AAC research and design methodology is also needed to empirically explore this and other applications of AI to AAC. The purpose of this report was to describe (a) the development of an AAC prototype using a design methodology new to AAC research and (b) a preliminary investigation of the efficacy of this potential new AAC capability. Method:The prototype was developed using a Wizard-of-Oz prototyping approach that allows for initial exploration of a new technology capability without the time and effort required for full-scale development. The preliminary investigation with three children on the autism spectrum who were minimally verbal used an adapted alternating treatment design to compare the effects of a Wizard-of-Oz prototype that provided automated augmented input (i.e., pairing color photos with speech) to a standard topic display (i.e., a grid display with line drawings) on visual attention, linguistic participation, and (for one participant) word learning during a circle activity. Results:Preliminary investigation results were variable, but overall participants increased visual attention and linguistic participation when using the prototype. Conclusions:Wizard-of-Oz prototyping could be a valuable approach to spur much needed innovation in AAC. Further research into efficacy, reliability, validity, and attitudes is required to more comprehensively evaluate the use of AI to automate augmented input in AAC.
more »
« less
Preliminary Investigation of Context-Aware Augmentative and Alternative Communication with Automated Just-in-Time Cloze Phrase Response Options for Social Participation from Children on the Autism Spectrum
Introduction: Social participation for emerging symbolic communicators on the autism spectrum is often restricted. This is due in part to the time and effort required for both children and partners to use traditional augmentative and alternative communication (AAC) technologies during fast-paced social routines. Innovations in artificial intelligence provide the potential for context-aware AAC technology that can provide just-in-time communication options based on linguistic input from partners to minimize the time and effort needed to use AAC technologies for social participation. Methods: This preliminary study used an alternating treatment design to compare the effects of a context-aware AAC prototype with automated cloze phrase response options to traditional AAC for supporting three young children who were emerging symbolic communicators on the autism spectrum in participating within a social routine. Results: Visual analysis and effect size estimates suggest the context-aware AAC condition resulted in increases in linguistic participation, vocal approximations, and visual attention for all three children. Conclusion: While this study was only an initial exploration and results are preliminary, context-aware AAC technologies have the potential to enhance participation and communication outcomes for young emerging symbolic communicators on the autism spectrum and more research is needed.
more »
« less
- Award ID(s):
- 2236352
- PAR ID:
- 10574893
- Publisher / Repository:
- Karger
- Date Published:
- Journal Name:
- Folia Phoniatrica et Logopaedica
- ISSN:
- 1021-7762
- Page Range / eLocation ID:
- 1 to 15
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Autistic children face significant challenges in vocal communication and social interaction, often leading to social isolation. There is evidence that Augmentative and Alternative Communication (AAC) offers support to mitigate these challenges, enabling them to communicate with non-vocal means through forms of AAC, such as speech-generation devices (SGDs). However, the adoption and use of SGDs are hindered by several factors, including the large amount of practice required to learn to use SGDs and the limited options for highly engaging social learning contexts. Our study introduces the novel approach of using SGDs as game controller for digital and interactive games. With three design goals guiding our work, we conducted a Wizard-of-Oz formative case study with five participants aged 3-5 years, who were learning to use their SGD. We simulated a digital coloring game, integrating the speech-generated output of the participant's SGD to function as the game's controller. From this case study, we observed that all participants engaged with the game using their SGD for at least one turn, and two participants also engaged in emerging joint attention responses with the game and game's facilitator. This paper discusses these findings and contributes directions for future research, with suggestions for the design of future SGD-controlled games and exploration of social connection and collaboration between autistic children who use AAC and their caregivers, siblings, and peers.more » « less
-
Abstract Classroom engagement plays a crucial role in preschoolers' development, yet the correlates of engagement, especially among children with autism spectrum disorder (ASD) and developmental delays (DD), remains unknown. This study examines levels of engagement with classroom social partners and tasks among children in three groups ASD, DD, and typical development (TD). Here, we asked whether children's vocal interactions (vocalizations to and from peers and teachers) were associated with their classroom engagement with social partners (peers and teachers) and with tasks, and whether the association between classroom engagement and vocal interactions differed between children in the ASD group and their peers in the DD and TD groups. Automated measures of vocalizations and location quantified children's vocal interactions with peers and teachers over the course of the school year. Automated location and vocalization data were used to capture both (1) children's vocal output to specific peers and teachers, and (2) the vocal input they received from those peers and teachers. Participants were 72 3–5‐year‐olds (Mage = 48.6 months, SD = 7.0, 43% girls) and their teachers. Children in the ASD group displayed lower engagement with peers, teachers, and tasks than children in the TD group; they also showed lower engagement with peers than children in the DD group. Overall, children's own vocalizations were positively associated with engagement with social partners. Thus, although children in the ASD group tend to have lower engagement scores than children in the TD group, active participation in vocal interactions appears to support their classroom engagement with teachers and peers.more » « less
-
Autism is a neurodevelopmental disability that impacts one’s social communication and interaction. When left unsupported, this can increase the amount of loneliness felt by autistic people. Communication technology, such as AAC, can be helpful in supporting social communication, especially when co-designed with autistic people. We conducted a series of design workshops to co-design a new AAC system specifically supporting social communication. In this paper, we focus on the accessibility issues that were identified when running our workshops and provide recommendations on how to improve the process. We found that it is critical to build support for information processing time into the workshops, include a variety of AAC stakeholders, and create a shared vocabulary between the workshop participants to make design workshops more accessible to autistic adults.more » « less
-
Background Residual speech sound disorder (RSSD) is a high-prevalence condition that negatively impacts social and academic participation. Telepractice service delivery has the potential to expand access to technology-enhanced intervention methods that can help remediate RSSD, but it is not known whether remote service delivery is associated with a reduction in the efficacy of these methods. This project will systematically measure the outcomes of visual-acoustic biofeedback intervention when delivered in-person or online. Methods/design This project, Visual-acoustic Intervention with Service delivery In-person and via Telepractice (VISIT), aims to treat 76 children in a parallel randomized controlled clinical trial in which children with RSSD will receive visual-acoustic biofeedback treatment either in person or via telepractice. Eligible children will be speakers of American English aged 9–17 years who exhibit RSSD affecting /ɹ/ but otherwise show cognitive-linguistic and hearing abilities within the typical range. All participants will receive twenty sessions of visual-acoustic biofeedback; they will be randomized, with stratification by pre-treatment speech production ability and site, to complete their treatment sessions either in the laboratory setting or at home via telepractice. For the primary outcome measure, blinded listeners will evaluate changes in the perceived accuracy of /ɹ/ production after the end of treatment. Discussion By comparing outcomes in children randomized to receive a standard course of biofeedback treatment either via telepractice or in-person, this study will provide evidence-based guidance for clinicians seeking flexible service delivery options for a challenging and prevalent condition.more » « less
An official website of the United States government

