Search for: All records

Expressive computer science (CS) learning environments teach coding through the creation of an artifact, such as audio or video output. EarSketch is an expressive CS learning environment designed to teach computing through music production, mixing and arranging sounds using code. In this paper, we explore the accessibility challenges of using EarSketch for learners who are Blind and Visually Impaired (BVI). We present key findings from co-design studies with teachers and students at an institution specializing in BVI education, focused on gathering both groups’ unique perspectives about EarSketch’s ability to support teachers’ curricula, students’ workflows using the system with accessibility software, and challenges faced by users who are BVI. 

This study conducts a novel approach to redesign EarSketch, an expressive computer science (CS) learning environment that inte- grates music composition into computing education, with a specific focus on inclusivity for blind and visually impaired (BVI) learners. This approach centers on the participation of teachers, students, and the community as co-designers, leveraging their insights and ex- periences to enhance the program’s accessibility and effectiveness. By actively involving the stakeholders in the development process, the study aims to address the unique educational challenges and needs of learners who are visually impaired more effectively. The participatory design approach is expected to not only maintain the intrinsic appeal of EarSketch but also to expand its accessibility, ensuring that it becomes a more inclusive tool in computer sci- ence education. The ultimate goal is to establish a more adaptable and inclusive educational paradigm within STEAM, particularly in computing education and music, that is responsive to the diverse needs of all students, including those with visual impairments. The contributions of this paper are design recommendations based on our data that can be applied to the design of EarSketch and other expressive CS environments for BVI learners. 

EarSketch is an online learning environment that uses the Web Audio API to teach computer science and computational thinking through music technology, production, and remixing. It is designed to broaden participation in computer science and music education for beginning learners by providing a free, web-based application coupled with curricula for informal and formal learning contexts and a library of audio content spanning multiple popular genres. This paper describes an analysis of EarSketch’s accommodations for students who are blind or visually impaired (BVI) and initial improvements to the system to improve accessibility. This paper also presents the findings of a user study designed to determine the biggest accessibility issues for EarSketch users who are BVI, and a discussion of how accessibility improvements can help broaden participation in computing and music education and, more broadly, how all web audio application developers can integrate accessibility considerations into their work.