An official website of the United States government
This study conducts a novel approach to redesign EarSketch, an expressive computer science (CS) learning environment that inte- grates music composition into computing education, with a specific focus on inclusivity for blind and visually impaired (BVI) learners. This approach centers on the participation of teachers, students, and the community as co-designers, leveraging their insights and ex- periences to enhance the program’s accessibility and effectiveness. By actively involving the stakeholders in the development process, the study aims to address the unique educational challenges and needs of learners who are visually impaired more effectively. The participatory design approach is expected to not only maintain the intrinsic appeal of EarSketch but also to expand its accessibility, ensuring that it becomes a more inclusive tool in computer sci- ence education. The ultimate goal is to establish a more adaptable and inclusive educational paradigm within STEAM, particularly in computing education and music, that is responsive to the diverse needs of all students, including those with visual impairments. The contributions of this paper are design recommendations based on our data that can be applied to the design of EarSketch and other expressive CS environments for BVI learners.
more »
« less
This content will become publicly available on October 22, 2026
Using Co-Design to Investigate Affordances of an Expressive CS Learning Environment for Students who are BVI
Expressive computer science (CS) learning environments teach coding through the creation of an artifact, such as audio or video output. EarSketch is an expressive CS learning environment designed to teach computing through music production, mixing and arranging sounds using code. In this paper, we explore the accessibility challenges of using EarSketch for learners who are Blind and Visually Impaired (BVI). We present key findings from co-design studies with teachers and students at an institution specializing in BVI education, focused on gathering both groups’ unique perspectives about EarSketch’s ability to support teachers’ curricula, students’ workflows using the system with accessibility software, and challenges faced by users who are BVI.
more »
« less
- Award ID(s):
- 2300631
- PAR ID:
- 10681097
- Publisher / Repository:
- ACM
- Date Published:
- ISBN:
- 9798400706769
- Page Range / eLocation ID:
- 1 to 7
- Format(s):
- Medium: X
- Location:
- Denver Colorado USA
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
EarSketch is an online learning environment that uses the Web Audio API to teach computer science and computational thinking through music technology, production, and remixing. It is designed to broaden participation in computer science and music education for beginning learners by providing a free, web-based application coupled with curricula for informal and formal learning contexts and a library of audio content spanning multiple popular genres. This paper describes an analysis of EarSketch’s accommodations for students who are blind or visually impaired (BVI) and initial improvements to the system to improve accessibility. This paper also presents the findings of a user study designed to determine the biggest accessibility issues for EarSketch users who are BVI, and a discussion of how accessibility improvements can help broaden participation in computing and music education and, more broadly, how all web audio application developers can integrate accessibility considerations into their work.more » « less
-
Generative AI is increasingly used in learning environments, but most systems focus on generating responses rather than supporting interaction. This limitation is especially important for blind and visually impaired (BVI) learners, who rely on non-visual ways to navigate and understand programming tasks. We present findings from a co-design study with BVI high school students exploring expectations for AI assistants in expressive computer science learning. Participants described how AI could support accessible interaction, guide learning, and empower learner agency. We derive two design principles for inclusive AI assistants: (1) situated multimodal interaction and (2) scaffolded iterative interaction. These principles shift the focus from adapting outputs (e.g., audio) to designing interactions that support how learners navigate and engage in the CS learning context. Our work highlights the importance of interaction design in accessible AI and the value of involving BVI learners in the design of AI-powered educational technologies.more » « less
-
null (Ed.)To meet the rising demand for computer science (CS) courses, K-12 educators need to be prepared to teach introductory concepts and skills in courses such as Computer Science Principles (CSP), which takes a breadth-first approach to CS and includes topics beyond programming such as data, impacts of computing, and networks. Educators are now also being asked to teach more advanced concepts in courses such as the College Board's Advanced Placement Computer Science A (CSA) course, which focuses on advanced programming using Java and includes topics such as objects, inheritance, arrays, and recursion. Traditional CSA curricula have not used content or pedagogy designed to engage a broad range of learners and support their success. Unlike CSP, which is attracting more underrepresented students to computing as it was designed, CSA continues to enroll mostly male, white, and Asian students [College Board 2019, Ericson 2020, Sax 2020]. In order to expand CS education opportunities, it is crucial that students have an engaging experience in CSA similar to CSP. Well-designed differentiated professional development (PD) that focuses on content and pedagogy is necessary to meet individual teacher needs, to successfully build teacher skills and confidence to teach CSA, and to improve engagement with students [Darling-Hammond 2017]. It is critical that as more CS opportunities and courses are developed, teachers remain engaged with their own learning in order to build their content knowledge and refine their teaching practice [CSTA 2020]. CSAwesome, developed and piloted in 2019, offers a College Board endorsed AP CSA curriculum and PD focused on supporting the transition of teachers and students from CSP to CSA. This poster presents preliminary findings aimed at exploring the supports and challenges new-to-CSA high school level educators face when transitioning from teaching an introductory, breadth-first course such as CSP to teaching the more challenging, programming-focused CSA course. Five teachers who completed the online CSAwesome summer 2020 PD completed interviews in spring 2021. The project employed an inductive coding scheme to analyze interview transcriptions and qualitative notes from teachers about their experiences learning, teaching, and implementing CSP and CSA curricula. Initial findings suggest that teachers’ experience in the CSAwesome PD may improve their confidence in teaching CSA, ability to effectively use inclusive teaching practices, ability to empathize with their students, problem-solving skills, and motivation to persist when faced with challenges and difficulties. Teachers noted how the CSAwesome PD provided them with a student perspective and increased feelings of empathy. Participants spoke about the implications of the COVID-19 pandemic on their own learning, student learning, and teaching style. Teachers enter the PD with many different backgrounds, CS experience levels, and strengths, however, new-to-CSA teachers require further PD on content and pedagogy to transition between CSP and CSA. Initial results suggest that the CSAwesome PD may have an impact on long-term teacher development as new-to-CSA teachers who participated indicated a positive impact on their teaching practices, ideologies, and pedagogies.more » « less
-
This paper explores the integration of computer science (CS) and computational thinking (CT) into middle and high school math classes by teachers who received pre-service CS training. Focusing on three participants within a larger study, the paper describes what they find relevant from their programs, how they apply CS/CT concepts and practices into their math instruction, and what role their value of CS/CT plays in their pedagogical approaches. Data were collected through two interviews and analyzed to present case studies. Findings describe how teachers’ integration of CS/CT varies from algorithmic thinking to prioritizing the process over the solution. Findings show the teachers’ motivation to bring CS to their students, whether by incorporating CS/CT practices in their math classroom or advocating for stand-alone classes. Recommendations for pre-service CS/CT-focused teacher preparation programs include greater emphasis on integration, culturally responsive teaching practices, and learning how to teach in addition to what to teach.more » « less
