Search for: All records

This study conducts a novel approach to redesign EarSketch, an expressive computer science (CS) learning environment that inte- grates music composition into computing education, with a specific focus on inclusivity for blind and visually impaired (BVI) learners. This approach centers on the participation of teachers, students, and the community as co-designers, leveraging their insights and ex- periences to enhance the program’s accessibility and effectiveness. By actively involving the stakeholders in the development process, the study aims to address the unique educational challenges and needs of learners who are visually impaired more effectively. The participatory design approach is expected to not only maintain the intrinsic appeal of EarSketch but also to expand its accessibility, ensuring that it becomes a more inclusive tool in computer sci- ence education. The ultimate goal is to establish a more adaptable and inclusive educational paradigm within STEAM, particularly in computing education and music, that is responsive to the diverse needs of all students, including those with visual impairments. The contributions of this paper are design recommendations based on our data that can be applied to the design of EarSketch and other expressive CS environments for BVI learners. 

EarSketch is an online learning environment that uses the Web Audio API to teach computer science and computational thinking through music technology, production, and remixing. It is designed to broaden participation in computer science and music education for beginning learners by providing a free, web-based application coupled with curricula for informal and formal learning contexts and a library of audio content spanning multiple popular genres. This paper describes an analysis of EarSketch’s accommodations for students who are blind or visually impaired (BVI) and initial improvements to the system to improve accessibility. This paper also presents the findings of a user study designed to determine the biggest accessibility issues for EarSketch users who are BVI, and a discussion of how accessibility improvements can help broaden participation in computing and music education and, more broadly, how all web audio application developers can integrate accessibility considerations into their work. 

In this demonstration, we present a holographic projected version of LuminAI, which is an interactive art installation that allows participants to collaborate with an AI dance partner by improvising movements together. By utilizing a mix of a top-down and bottom-up approach, we seek to understand embodied co-creativity in an improvisational dance setting to better develop the design of the modular AI agent to creatively collaborate with a dancer. The purpose of this demonstration is to describe the five-module agent design and investigate how we can design an immersive experience that is design-efficient, portable, light, and duo-user participation. Through this installation in an imitated black box space, audience members and dancers engage in an immersive co-creative dance experience, inspiring discussion on the limitless applications of dance and technology in the realms of learning, training, and creativity.