An official website of the United States government
Look at a graph of oceanographic data. How would you convey the information only using sound? This is the challenge addressed by the US National Science Foundation-funded “Accessible Oceans” project, which seeks to increase access to ocean data in informal learning environments like museums, science centers, and aquariums. Quantitative information in these settings is almost always conveyed with visual displays. For audience members who are blind or have low vision, or those with data illiteracy or innumeracy, these displays remain inaccessible. In this article, we discuss our interdisciplinary project using an inclusive human-centered design process to develop auditory displays that support learning and understanding of ocean science in informal learning environments. We share information about our project and takeaways for inclusive auditory display design, hoping to inspire others to examine the accessibility of their own work.
more »
« less
Iterative Design of Auditory Displays Involving Data Sonifications and Authentic Ocean Data
The “Accessible Oceans” pilot project aims to inclusively design auditory displays that support perception and understanding of ocean data in informal learning environments (ILEs). The project’s multi-disciplinary team includes expertise from all related fields — ocean scientists, dataset experts, a sound designer with specialization in data sonification, and a learning sciences researcher. In addition, the PI is blind and provides a crucial perspective in our research. We describe the sound design of informative sonifications and respective auditory displays based on iterative design with user input at each stage, including from blind and low-vision (BLV) students, their teachers, and subject-matter experts. We discuss the importance of framing data sonifications through an auditory presentation of contextual information. We also report on our latest auditory display evaluation using Auditory Interface UX Scale (BUZZ) surveys at three ILE test sites. These responses further affirm our auditory display design developments. We include access to the auditory displays media and lessons learned over the course of this multi-year NSF-funded Advancing Informal Stem Learning (AISL) grant https://accessibleoceans.whoi.edu/
more »
« less
- Award ID(s):
- 2115751
- PAR ID:
- 10563651
- Publisher / Repository:
- International Community for Auditory Display
- Date Published:
- ISBN:
- 979-8-9914562-0-3
- Page Range / eLocation ID:
- 11 to 17
- Format(s):
- Medium: X
- Location:
- Rensselaer Polytechnic Institute
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Auditory description display is verbalized text typically used to describe live, recorded, or graphical displays to support access for people who are blind or visually impaired. Significant prior research has resulted in guidelines for auditory description for non-interactive or minimally interactive contexts. A lack of auditory description for complex interactive environments remains a tremendous barrier to access for people with visual impairments. In this work, we present a systematic design framework for designing auditory description within complex interactive environments. We illustrate how modular descriptions aligned with this framework can result in an interactive storytelling experience constructed through user interactions. This framework has been used in a set of published and widely used interactive science simulations, and in its generalized form could be applied to a variety of contexts.more » « less
-
Abstract Occipital cortices of different sighted people contain analogous maps of visual information (e.g. foveal vs. peripheral). In congenital blindness, “visual” cortices respond to nonvisual stimuli. Do visual cortices of different blind people represent common informational maps? We leverage naturalistic stimuli and inter-subject pattern similarity analysis to address this question. Blindfolded sighted (n = 22) and congenitally blind (n = 22) participants listened to 6 sound clips (5–7 min each): 3 auditory excerpts from movies; a naturalistic spoken narrative; and matched degraded auditory stimuli (Backwards Speech, scrambled sentences), during functional magnetic resonance imaging scanning. We compared the spatial activity patterns evoked by each unique 10-s segment of the different auditory excerpts across blind and sighted people. Segments of meaningful naturalistic stimuli produced distinctive activity patterns in frontotemporal networks that were shared across blind and across sighted individuals. In the blind group only, segment-specific, cross-subject patterns emerged in visual cortex, but only for meaningful naturalistic stimuli and not Backwards Speech. Spatial patterns of activity within visual cortices are sensitive to time-varying information in meaningful naturalistic auditory stimuli in a broadly similar manner across blind individuals.more » « less
-
null (Ed.)Science simulations are widely used in classrooms to support inquiry-based learning of complex science concepts. These tools typically rely on interactive visual displays to convey relationships. Auditory displays, including verbal description and sonification (non-speech audio), combined with alternative input capabilities, may provide an enhanced experience for learners, particularly learners with visual impairment. We completed semi-structured interviews and usability testing with eight adult learners with visual impairment for two audio-enhanced simulations. We analyzed trends and edge cases in participants' interaction patterns, interpretations, and preferences. Findings include common interaction patterns across simulation use, increased efficiency with second use, and the complementary role that description and sonification play in supporting learning opportunities. We discuss how these control and display layers work to encourage exploration and engagement with science simulations. We conclude with general and specific design takeaways to support the implementation of auditory displays for accessible simulations.more » « less
-
Abstract Sonification, or the practice of generating sound from data, is a promising alternative or complement to data visualization for exploring research questions in the life sciences. Expressing or communicating data in the form of sound rather than graphs, tables, or renderings can provide a secondary information source for multitasking or remote monitoring purposes or make data accessible when visualizations cannot be used. While popular in astronomy, neuroscience, and geophysics as a technique for data exploration and communication, its potential in the biological and biotechnological sciences has not been fully explored. In this review, we introduce sonification as a concept, some examples of how sonification has been used to address areas of interest in biology, and the history of the technique. We then highlight a selection of biology‐related publications that involve sonifications of DNA datasets and protein datasets, sonifications for data collection and interpretation, and sonifications aimed to improve science communication and accessibility. Through this review, we aim to show how sonification has been used both as a discovery tool and a communication tool and to inspire more life‐science researchers to incorporate sonification into their own studies.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.21785/icad2024.002
