An official website of the United States government
Learning from multiple representations (MRs) is not an easy task for most people, despite how easy it is for experts. Different combinations of representations (e.g., text + photograph, graph + formula, map + diagram) pose different challenges for learners, but across the literature researchers find these to be challenging learning tasks. Each representation typically includes some unique information, as well as some information shared with the other representation(s). Finding one piece of information is only somewhat challenging, but linking information across representations and especially making inferences are very challenging and important parts of using multiple representations for learning. Coordination of multiple representations skills are rarely taught in classrooms, despite the fact that learners are frequently tested on them. Learning from MRs depends on the specific learning tasks posed, learner characteristics, the specifics of which representation(s) are used, and the design of each representation. These various factors act separately and in combination (which can be compensatory, additive, or interactive). Learning tasks can be differentially effective depending on learner characteristics, especially prior knowledge, self-regulation, and age/grade. Learning tasks should be designed keeping this differential effectiveness in mind, and researchers should test for such interactions.
more »
« less
Accessible Text Tools for People with Cognitive Impairments and Non-Native Readers: Challenges and Opportunities
Many people have problems with reading, which limits their ability to participate in society. This paper explores tools that make text more accessible. For this, we interviewed experts, who proposed tools for different stakeholders and scenarios. Important stakeholders of such tools are people with cognitive impairments and non-native readers. Frequently mentioned scenarios are public administration, the medical domain, and everyday life. The tools proposed by experts support stakeholders by improving how text is compressed, expanded, reviewed, and experienced. In a survey of stakeholders, we confirm that the scenarios are relevant and that the proposed tools appear helpful to them. We provide the Accessible Text Framework to help researchers understand how the different tools can be combined and discuss how individual tools can be implemented. The investigation shows that accessible text tools are an important HCI+AI challenge that a large number of people can benefit from.
more »
« less
- Award ID(s):
- 2107391
- PAR ID:
- 10542320
- Publisher / Repository:
- ACM
- Date Published:
- ISBN:
- 9798400707711
- Page Range / eLocation ID:
- 250 to 266
- Format(s):
- Medium: X
- Location:
- Rapperswil Switzerland
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Drones have become fixtures in commerce, safety efforts, and in homes as a leisure activity. Researchers have started to explore how drones can support people with disabilities in piloting and serve as assistive devices. Our work focuses on people with vision impairment and investigates what motivates them to fly drones. We administered a survey to visually impaired adults that gauged general interest in drone piloting and previous experience with drones. From the 59 survey responses, we interviewed 13 participants to elaborate on how they envision using drones and how different feedback and modes of piloting can make the flying experience more accessible. We found that our participants had overarching interests in aviation, trying new technology, environment exploration, and finding collaborative activities to do with their sighted family members, which extended to an interest in piloting drones. This research helps lay groundwork for design scenarios and accessible features for future drones.more » « less
-
Recent progress in data-driven vision and language-based tasks demands developing training datasets enriched with multiple modalities representing human intelligence. The link between text and image data is one of the crucial modalities for developing AI models. The development process of such datasets in the video domain requires much effort from researchers and annotators (experts and non-experts). Researchers re-design annotation tools to extract knowledge from annotators to answer new research questions. The whole process repeats for each new question which is timeconsuming. However, since the last decade, there has been little change in how the researchers and annotators interact with the annotation process. We revisit the annotation workflow and propose a concept of an adaptable and scalable annotation tool. The concept emphasizes its users’ interactivity to make annotation process design seamless and efficient. Researchers can conveniently add newer modalities to or augment the extant datasets using the tool. The annotators can efficiently link free-form text to image objects. For conducting human-subject experiments on any scale, the tool supports the data collection for attaining group ground truth. We have conducted a case study using a prototype tool between two groups with the participation of 74 non-expert people. We find that the interactive linking of free-form text to image objects feels intuitive and evokes a thought process resulting in a high-quality annotation. The new design shows ≈ 35% improvement in the data annotation quality. On UX evaluation, we receive above-average positive feedback from 25 people regarding convenience, UI assistance, usability, and satisfaction.more » « less
-
Abstract Climate change presents huge challenges to the already-complex decisions faced by U.S. agricultural producers, as seasonal weather patterns increasingly deviate from historical tendencies. Under USDA funding, a transdisciplinary team of researchers, extension experts, educators, and stakeholders is developing a climate decision support Dashboard for Agricultural Water use and Nutrient management (DAWN) to provide Corn Belt farmers with better predictive information. DAWN’s goal is to provide credible, usable information to support decisions by creating infrastructure to make subseasonal-to-seasonal forecasts accessible. DAWN uses an integrated approach to 1) engage stakeholders to coproduce a decision support and information delivery system; 2) build a coupled modeling system to represent and transfer holistic systems knowledge into effective tools; 3) produce reliable forecasts to help stakeholders optimize crop productivity and environmental quality; and 4) integrate research and extension into experiential, transdisciplinary education. This article presents DAWN’s framework for integrating climate–agriculture research, extension, and education to bridge science and service. We also present key challenges to the creation and delivery of decision support, specifically in infrastructure development, coproduction and trust building with stakeholders, product design, effective communication, and moving tools toward use.more » « less
-
Over the past decade, several urban visual analytics systems and tools have been proposed to tackle a host of challenges faced by cities, in areas as diverse as transportation, weather, and real estate. Many of these tools have been designed through collaborations with urban experts, aiming to distill intricate urban analysis workflows into interactive visualizations and interfaces. However, the design, implementation, and practical use of these tools still rely on siloed approaches, resulting in bespoke systems that are difficult to reproduce and extend. At the design level, these tools undervalue rich data workflows from urban experts, typically treating them only as data providers and evaluators. At the implementation level, they lack interoperability with other technical frameworks. At the practical use level, they tend to be narrowly focused on specific fields, inadvertently creating barriers to cross-domain collaboration. To address these gaps, we present Curio, a framework for collaborative urban visual analytics. Curio uses a dataflow model with multiple abstraction levels (code, grammar, GUI elements) to facilitate collaboration across the design and implementation of visual analytics components. The framework allows experts to intertwine data preprocessing, management, and visualization stages while tracking the provenance of code and visualizations. In collaboration with urban experts, we evaluate Curio through a diverse set of usage scenarios targeting urban accessibility, urban microclimate, and sunlight access. These scenarios use different types of data and domain methodologies to illustrate Curio’s flexibility in tackling pressing societal challenges. Curio is available at urbantk.org/curio.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3603555.3603569
