Collaborative writing tools have been used widely in professional and academic organizations for many years. Yet, there has not been much work to improve screen reader access in mainstream collaborative writing tools. This severely affects the way people with vision impairments collaborate in ability-diverse teams. As a step toward addressing this issue, the present article aims at improving screen reader representation of collaborative features such as comments and track changes (i.e., suggested edits). Building on our formative interviews with 20 academics and professionals with vision impairments, we developed auditory representations that indicate comments and edits using non-speech audio (e.g., earcons, tone overlay), multiple text-to-speech voices, and contextual presentation techniques. We then performed a systematic evaluation study with 48 screen reader users that indicated that non-speech audio, changing voices, and contextual presentation can potentially improve writers’ collaboration awareness. We discuss implications of these results for the design of accessible collaborative systems.
more »
« less
Supporting Accessible Data Visualization Through Audio Data Narratives
Online data visualizations play an important role in informing public opinion but are often inaccessible to screen reader users. To address the need for accessible data representations on the web that provide direct, multimodal, and up-to-date access to the data, we investigate audio data narratives –which combine textual descriptions and sonification (the mapping of data to non-speech sounds). We conduct two co-design workshops with screen reader users to define design principles that guide the structure, content, and duration of a data narrative. Based on these principles and relevant auditory processing characteristics, we propose a dynamic programming approach to automatically generate an audio data narrative from a given dataset. We evaluate our approach with 16 screen reader users. Findings show with audio narratives, users gain significantly more insights from the data. Users describe data narratives help them better extract and comprehend the information in both the sonification and description.
more »
« less
- Award ID(s):
- 2016789
- PAR ID:
- 10379155
- Date Published:
- Journal Name:
- CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
- Page Range / eLocation ID:
- 1 to 19
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Introductory computer programming presents a number of challenges for blind and visually impaired screen reader users. In addition to the challenges of navigating complex code documents using a screen reader, novice programmers who are blind are often unable to experience fun coding projects such as programming games or animations. To address these accessibility barriers, we developed Bonk, an accessible programming environment that enables the creation of interactive audio games using a subset of the JavaScript programming language. Bonk enables novice programmers to create, share, play, and remix accessible audio games. In this paper, we introduce the Bonk programming toolkit and describe its use in a week-long programming workshop with blind and visually impaired high school students. Students in the workshop were able to create and share original audio games using Bonk, and expressed enthusiasm about furthering their programming knowledge.more » « less
-
We increasingly rely on up-to-date, data-driven graphs to understand our environments and make informed decisions. However, many of the methods blind and visually impaired users (BVI) rely on to access data-driven information do not convey important shape-characteristics of graphs, are not refreshable, or are prohibitively expensive. To address these limitations, we introduce two refreshable, 1-DOF audio-haptic interfaces based on haptic cues fundamental to object shape perception. Slide-tone uses finger position with sonification, and Tilt-tone uses fingerpad contact inclination with sonification to provide shape feedback to users. Through formative design workshops (n = 3) and controlled evaluations (n = 8), we found that BVI participants appreciated the additional shape information, versatility, and reinforced understanding these interfaces provide; and that task accuracy was comparable to using interactive tactile graphics or sonification alone. Our research offers insight into the benefits, limitations, and considerations for adopting these haptic cues into a data visualization context.more » « less
-
Narratives are fundamental to our perception of the world and are pervasive in all activities that involve the representation of events in time. Yet, modern online information systems do not incorporate narratives in their representation of events occurring over time. This article aims to bridge this gap, combining the theory of narrative representations with the data from modern online systems. We make three key contributions: a theory-driven computational representation of narratives, a novel extraction algorithm to obtain these representations from data, and an evaluation of our approach. In particular, given the effectiveness of visual metaphors, we employ a route map metaphor to design a narrative map representation. The narrative map representation illustrates the events and stories in the narrative as a series of landmarks and routes on the map. Each element of our representation is backed by a corresponding element from formal narrative theory, thus providing a solid theoretical background to our method. Our approach extracts the underlying graph structure of the narrative map using a novel optimization technique focused on maximizing coherence while respecting structural and coverage constraints. We showcase the effectiveness of our approach by performing a user evaluation to assess the quality of the representation, metaphor, and visualization. Evaluation results indicate that the Narrative Map representation is a powerful method to communicate complex narratives to individuals. Our findings have implications for intelligence analysts, computational journalists, and misinformation researchers.more » « less
-
Background: Undergraduate engineering education is a critical moment for student experiences and broadening participation, yet many minoritized students experience it as unwelcoming, unsupportive, or exclusionary. Engineering faculty have a central role and responsibility to play in the creation of inclusive classrooms, yet there is a gap in empathic communication for faculty to better understand their students. Education researchers can play a critical role in addressing this communication and empathy gap, but disseminating research findings in long form papers is not accessible for most engineering faculty. Purpose: This paper highlights the audio narratives created through the Audio for Inclusion project, an NSF-funded project intended to help faculty become more aware of students’ hidden and marginalized identities and impacts of those identities on their engineering education experiences. Method: We conducted qualitative semi-structured interviews with 22 nationally recruited undergraduate engineering students and turned these into 10 distinct audio narratives. Our narrative analysis focused on constructing a cohesive, concise, and anonymized narrative that would present key content from student interviews in a format that would preserve some of the immediacy and emotionality of student interviews while improving accessibility and coherence for faculty. Findings: In this paper, we present the scripts and link to audio narratives for two student participants: 1) Sophie, a mixed race (Asian and white) white-passing woman, and 2) Enola, an Indigenous woman. In addition to presenting the written and audio narrative, we comment on the specific lessons we see as valuable for engineering faculty that emerge from each of the audio narratives. Conclusion: This project highlights lessons learned for faculty in the areas of student support, accommodations, inclusive practice, and student perceptions of classroom practice. We present this project as methodological innovation for qualitative research, and as future work, we intend to keep investigating impact on faculty via faculty focus groups, surveys, and workshops. We also highlight this research as a metaphor for the empathic understanding that each faculty member can gain by listening to students, individually and collectively, and distilling lessons for their practice.more » « less