This study conducts a novel approach to redesign EarSketch, an expressive computer science (CS) learning environment that inte- grates music composition into computing education, with a specific focus on inclusivity for blind and visually impaired (BVI) learners. This approach centers on the participation of teachers, students, and the community as co-designers, leveraging their insights and ex- periences to enhance the program’s accessibility and effectiveness. By actively involving the stakeholders in the development process, the study aims to address the unique educational challenges and needs of learners who are visually impaired more effectively. The participatory design approach is expected to not only maintain the intrinsic appeal of EarSketch but also to expand its accessibility, ensuring that it becomes a more inclusive tool in computer sci- ence education. The ultimate goal is to establish a more adaptable and inclusive educational paradigm within STEAM, particularly in computing education and music, that is responsive to the diverse needs of all students, including those with visual impairments. The contributions of this paper are design recommendations based on our data that can be applied to the design of EarSketch and other expressive CS environments for BVI learners.
more »
« less
Design and evaluation of a multimodal physics simulation
We present a multimodal physics simulation, including visual and auditory (description, sound effects, and sonification) modalities to support the diverse needs of learners. We describe design challenges and solutions, and findings from final simulation evaluations with learners with and without visual impairments. We also share insights from completing research with members of diverse learner groups (N = 52). This work presents approaches for designing and evaluating accessible interactive simulations for learners with diverse needs.
more »
« less
- PAR ID:
- 10137382
- Date Published:
- Journal Name:
- Journal on technology and persons with disabilities
- Volume:
- 7
- ISSN:
- 2330-4219
- Page Range / eLocation ID:
- 88-102
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Science simulations are widely used in classrooms to support inquiry-based learning of complex science concepts. These tools typically rely on interactive visual displays to convey relationships. Auditory displays, including verbal description and sonification (non-speech audio), combined with alternative input capabilities, may provide an enhanced experience for learners, particularly learners with visual impairment. We completed semi-structured interviews and usability testing with eight adult learners with visual impairment for two audio-enhanced simulations. We analyzed trends and edge cases in participants' interaction patterns, interpretations, and preferences. Findings include common interaction patterns across simulation use, increased efficiency with second use, and the complementary role that description and sonification play in supporting learning opportunities. We discuss how these control and display layers work to encourage exploration and engagement with science simulations. We conclude with general and specific design takeaways to support the implementation of auditory displays for accessible simulations.more » « less
-
Touch is often omitted or viewed as unnecessary in digital learning. Lack of touch feedback limits the accessibility and multimodal capacity of digital educational content. Touchscreens with vibratory, haptic feedback are prevalent, yet this kind of feedback is often under-utilized. This work provides initial investigations into the design, development, and use of vibratory feedback within multimodal, interactive, educational simulations on touchscreen devices by learners with and without visual impairments. The objective of this work is to design and evaluate different haptic paradigms that could support interaction and learning in educational simulations. We investigated the implementation of four haptic paradigms in two physics simulations. Interviews were conducted with eight learners (five sighted learners; three learners with visual impairments) on one simulation and initial results are shared. We discuss the learner outcomes of each paradigm and how they impact design and development moving forward.more » « less
-
Abstract Museums are local‐to‐global organizations operating in a digitized, distributed, and diverse 21st century world. Museums leaders face significant challenges in achieving broader relevance, meaningful engagement, and equitable outreach. This article examines the transformative potential of digitized collections to increase public engagement and enhance authentic educational efforts of museums, with specific emphasis on visual media as a key resource to achieve these outcomes. Using digitized collections to broaden learning opportunities and support a wide range of users will require museum leaders to engage in strategic digitization efforts—supplementing research images, making conscious decisions about meeting educational needs when setting digitization policies, and investing in meaningful outreach with digitized collections. Educational opportunities are contextualized with brief case studies of authentic investigations for middle school learners using digitized objects from a natural history museum. Three lessons learned during development and evaluation are described and implications for museum leaders are discussed.more » « less
-
As school districts implement initiatives that bring computer science (CS) to academically diverse K-12 schools, they face heightened demands for supporting teachers in meeting the needs of a broad range of learners. However, limited knowledge exists about pedagogical approaches to teaching CS, especially to students with disabilities. This paper reports findings from a qualitative study of two CS instructional coaching models meant to support teachers in meeting the needs of diverse learners, including those with disabilities. One model involved a school-embedded coach and the other model involved a district-wide coach that traveled among multiple schools. Findings revealed that within both coaching models, co-planning and co-teaching played an integral role in supporting teachers in meeting the needs of students with disabilities. Instructional pedagogies that coaches promoted included scaffolded project planning, student collaboration, and immediate feedback to students. Within both coaching models, there was a focus on trust building and increasing teachers’ instructional skills. Differences between coaching models included a stronger level of familiarity between the coach and teachers in the school-embedded coaching. There were also different approaches to accountability and co-planning logistics.more » « less
An official website of the United States government

