An official website of the United States government
Abstract Millions of individuals who have limited or no functional speech use augmentative and alternative communication (AAC) technology to participate in daily life and exercise the human right to communication. While advances in AAC technology lag significantly behind those in other technology sectors, mainstream technology innovations such as artificial intelligence (AI) present potential for the future of AAC. However, a new future of AAC will only be as effective as it is responsive to the needs and dreams of the people who rely upon it every day. AAC innovation must reflect an iterative, collaborative process with AAC users. To do this, we worked collaboratively with AAC users to complete participatory qualitative research about AAC innovation through AI. We interviewed 13 AAC users regarding (1) their current AAC engagement; (2) the barriers they experience in using AAC; (3) their dreams regarding future AAC development; and (4) reflections on potential AAC innovations. To analyze these data, a rapid research evaluation and appraisal was used. Within this article, the themes that emerged during interviews and their implications for future AAC development will be discussed. Strengths, barriers, and considerations for participatory design will also be described.
more »
« less
This content will become publicly available on June 24, 2026
Refining Participatory Design for AAC Users
Augmentative and alternative communication (AAC) is a field of research and practice that works with people who have a communication disability. One form AAC can take is a high-tech tool, such as a software-based communication system. Like all user interfaces, these systems must be designed and it is critical to include AAC users in the design process for their systems. A participatory design approach can include AAC users in the design process, but modifications may be necessary to make these methods more accessible. We present a two-part design process we are investigating for improving the participatory design for high-tech AAC systems. We discuss our plans to refine the accessibility of this process based on participant feedback.
more »
« less
- Award ID(s):
- 1750193
- PAR ID:
- 10628766
- Publisher / Repository:
- ACM
- Date Published:
- Format(s):
- Medium: X
- Location:
- Workshop paper presented at "Access InContext: Futuring Accessible Prototyping Tools and Methods", CHI'25, April 26, 2025, Yokohama, Japan.
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
It is a right for people who use AAC to communicate with other people and engage with their communities. This scoping review explores how AAC is currently being used by people with communication disabilities in social and community contexts and the impact the design of AAC systems can have on this communication. A total of 13 studies were included that proposed new AAC system designs, conducted interviews with people who use AAC and their chosen communication partners, or performed an AAC intervention. Six themes emerged from these studies that indicate people who use AAC desire interaction with others, can benefit from greater agency in the communication process, can leverage the script-like nature of certain interactions to improve their communication competency, make use of online and asynchronous methods of communication, use multiple modes of communication and AAC content representation, and can benefit from instruction in social communication and community engagement. Suggestions for future research on how to incorporate each theme into the design of new AAC systems are also provided.more » « less
-
Autism is a neurodevelopmental disability that impacts one’s social communication and interaction. When left unsupported, this can increase the amount of loneliness felt by autistic people. Communication technology, such as AAC, can be helpful in supporting social communication, especially when co-designed with autistic people. We conducted a series of design workshops to co-design a new AAC system specifically supporting social communication. In this paper, we focus on the accessibility issues that were identified when running our workshops and provide recommendations on how to improve the process. We found that it is critical to build support for information processing time into the workshops, include a variety of AAC stakeholders, and create a shared vocabulary between the workshop participants to make design workshops more accessible to autistic adults.more » « less
-
Making good letter or word predictions can help accelerate the communication of users of high-tech AAC devices. This is particularly important for real-time person-to-person conversations. We investigate whether per forming speech recognition on the speaking-side of a conversation can improve language model based predictions. We compare the accuracy of three plausible microphone deployment options and the accuracy of two commercial speech recognition engines (Google and IBM Watson). We found that despite recognition word error rates of 7-16%, our ensemble of N-gram and recurrent neural network language models made predictions nearly as good as when they used the reference transcripts.more » « less
-
Augmentative and alternative communication (AAC) devices enable speech-based communication, but generating speech is not the only resource needed to have a successful conversation. Being able to signal one wishes to take a turn by raising a hand or providing some other cue is critical in securing a turn to speak. Experienced conversation partners know how to recognize the nonverbal communication an augmented communicator (AC) displays, but these same nonverbal gestures can be hard to interpret by people who meet an AC for the first time. Prior work has identified motion through robots and expressive objects as a modality that can support communication. In this work, we work closely with an AAC user to understand how motion through a physical expressive object can support their communication. We present our process and resulting lessons on the designed object and the co-design process.more » « less
