skip to main content


Title: Design and evaluation of a multimodal physics simulation
We present a multimodal physics simulation, including visual and auditory (description, sound effects, and sonification) modalities to support the diverse needs of learners. We describe design challenges and solutions, and findings from final simulation evaluations with learners with and without visual impairments. We also share insights from completing research with members of diverse learner groups (N = 52). This work presents approaches for designing and evaluating accessible interactive simulations for learners with diverse needs.  more » « less
Award ID(s):
1503439 1621363 1814220
NSF-PAR ID:
10137382
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Journal on technology and persons with disabilities
Volume:
7
ISSN:
2330-4219
Page Range / eLocation ID:
88-102
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Museums are local‐to‐global organizations operating in a digitized, distributed, and diverse 21st century world. Museums leaders face significant challenges in achieving broader relevance, meaningful engagement, and equitable outreach. This article examines the transformative potential of digitized collections to increase public engagement and enhance authentic educational efforts of museums, with specific emphasis on visual media as a key resource to achieve these outcomes. Using digitized collections to broaden learning opportunities and support a wide range of users will require museum leaders to engage in strategic digitization efforts—supplementing research images, making conscious decisions about meeting educational needs when setting digitization policies, and investing in meaningful outreach with digitized collections. Educational opportunities are contextualized with brief case studies of authentic investigations for middle school learners using digitized objects from a natural history museum. Three lessons learned during development and evaluation are described and implications for museum leaders are discussed.

     
    more » « less
  2. Plants are a vital component of human life on Earth; they provide us with food and essential nutrients as well as the oxygen we breathe. However, the science education community struggles to find ways to make plant processes less abstract and more understandable for learners. In this article we demonstrate how we make plant processes more understandable for learners by observing the behaviors of a specific plant structure, a stoma, which is a microscopic opening that plays a role in the movement of matter into and out of a plant. Recent research across plant-related science fields centers on plant stomata because they protect plants from various environmental strains, including attacks from pathogens. Translating this research into science classroom instruction has not occurred extensively. A key impediment is that few common methods to make stomata visible or demonstrate their dynamic nature to learners are available. The activities we share here make stomata visible utilizing a specific plant, Tradescantia zebrina, and common laboratory equipment. In the first activity, we share how to demonstrate stomata closing and opening by manipulating a combination of these environmental factors. In the second activity, we describe how to create a visual simulation of stomata response to attacks from microorganisms. 
    more » « less
  3. As school districts implement initiatives that bring computer science (CS) to academically diverse K-12 schools, they face heightened demands for supporting teachers in meeting the needs of a broad range of learners. However, limited knowledge exists about pedagogical approaches to teaching CS, especially to students with disabilities. This paper reports findings from a qualitative study of two CS instructional coaching models meant to support teachers in meeting the needs of diverse learners, including those with disabilities. One model involved a school-embedded coach and the other model involved a district-wide coach that traveled among multiple schools. Findings revealed that within both coaching models, co-planning and co-teaching played an integral role in supporting teachers in meeting the needs of students with disabilities. Instructional pedagogies that coaches promoted included scaffolded project planning, student collaboration, and immediate feedback to students. Within both coaching models, there was a focus on trust building and increasing teachers’ instructional skills. Differences between coaching models included a stronger level of familiarity between the coach and teachers in the school-embedded coaching. There were also different approaches to accountability and co-planning logistics. 
    more » « less
  4. Agrawal, Garima (Ed.)
    Cybersecurity education is exceptionally challenging as it involves learning the complex attacks; tools and developing critical problem-solving skills to defend the systems. For a student or novice researcher in the cybersecurity domain, there is a need to design an adaptive learning strategy that can break complex tasks and concepts into simple representations. An AI-enabled automated cybersecurity education system can improve cognitive engagement and active learning. Knowledge graphs (KG) provide a visual representation in a graph that can reason and interpret from the underlying data, making them suitable for use in education and interactive learning. However, there are no publicly available datasets for the cybersecurity education domain to build such systems. The data is present as unstructured educational course material, Wiki pages, capture the flag (CTF) writeups, etc. Creating knowledge graphs from unstructured text is challenging without an ontology or annotated dataset. However, data annotation for cybersecurity needs domain experts. To address these gaps, we made three contributions in this paper. First, we propose an ontology for the cybersecurity education domain for students and novice learners. Second, we develop AISecKG, a triple dataset with cybersecurity-related entities and relations as defined by the ontology. This dataset can be used to construct knowledge graphs to teach cybersecurity and promote cognitive learning. It can also be used to build downstream applications like recommendation systems or self-learning question-answering systems for students. The dataset would also help identify malicious named entities and their probable impact. Third, using this dataset, we show a downstream application to extract custom-named entities from texts and educational material on cybersecurity. 
    more » « less
  5. null (Ed.)
    Science simulations are widely used in classrooms to support inquiry-based learning of complex science concepts. These tools typically rely on interactive visual displays to convey relationships. Auditory displays, including verbal description and sonification (non-speech audio), combined with alternative input capabilities, may provide an enhanced experience for learners, particularly learners with visual impairment. We completed semi-structured interviews and usability testing with eight adult learners with visual impairment for two audio-enhanced simulations. We analyzed trends and edge cases in participants' interaction patterns, interpretations, and preferences. Findings include common interaction patterns across simulation use, increased efficiency with second use, and the complementary role that description and sonification play in supporting learning opportunities. We discuss how these control and display layers work to encourage exploration and engagement with science simulations. We conclude with general and specific design takeaways to support the implementation of auditory displays for accessible simulations. 
    more » « less