skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Dynamic Visualization System for Gaze and Dialogue Data
We report and review a visualization system capable of displaying gaze and speech data elicited from pairs of subjects interacting in a discussion. We elicit such conversation data in our first experiment, where two participants are given the task of reaching a consensus about questions involving images. We validate the system in a second experiment where the purpose is to see if a person could determine which question had elicited a certain visualization. The visualization system allows users to explore reasoning behavior and participation during multimodal dialogue interactions.  more » « less
Award ID(s):
1851591
PAR ID:
10149408
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - HUCAPP
Volume:
2
Page Range / eLocation ID:
138 to 145
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We present a design-based exploration of the potential to reinterpret glyph-based visualization of scalar fields on 3D surfaces, a traditional scientific visualization technique, as a data physicalization technique. Even with the best virtual reality displays, users often struggle to correctly interpret spatial relationships in 3D datasets; thus, we are motivated to understand the extent to which traditional scientific visualization methods can translate to physical media where users may simultaneously leverage their visual systems and tactile senses to, in theory, better understand and connect with the data of interest. This pictorial traces the process of our design for a specific user study experiment: (1) inspiration, (2) exploring the data physicalization design space, (3) prototyping with 3D printing, (4) applying the techniques to different synthetic datasets. We call our most recent and compelling visual/tactile design boxcars on potatoes, and the next step in the research is to run a user-based evaluation to elucidate how this design compares to several of the others pictured here. 
    more » « less
  2. Visualization is an essential tool for analysis of data and communication of findings in the sciences, and the Earth System Sciences (ESS) are no exception. However, within ESS, specialized visualization requirements and data models, particularly for those data arising from numerical models, often make general purpose visualization packages difficult, if not impossible, to use effectively. This paper presents VAPOR: a domain-specific visualization package that targets the specialized needs of ESS modelers, particularly those working in research settings where highly-interactive exploratory visualization is beneficial. We specifically describe VAPOR’s ability to handle ESS simulation data from a wide variety of numerical models, as well as a multi-resolution representation that enables interactive visualization on very large data while using only commodity computing resources. We also describe VAPOR’s visualization capabilities, paying particular attention to features for geo-referenced data and advanced rendering algorithms suitable for time-varying, 3D data. Finally, we illustrate VAPOR’s utility in the study of a numerically- simulated tornado. Our results demonstrate both ease-of-use and the rich capabilities of VAPOR in such a use case. 
    more » « less
  3. Post-translational modifications (PTMs) diversify peptide structure and allow for greater flexibility within signaling networks. The cardiac neuromuscular system of the American lobster, Homarus americanus, is made up of a central pattern generator, the cardiac ganglion (CG), and peripheral cardiac muscle. Together, these components produce flexible output in response to peptidergic modulation. Here, we examined the role of PTMs in determining the effects of a cardioactive neuropeptide, myosuppressin (pQDLDHVFLRFamide), on the whole heart, the neuromuscular junction/muscle, the isolated CG, and the neurons of the CG. Mature myosuppressin and noncyclized myosuppressin (QDLDHVFLRFamide) elicited similar and significant changes in whole heart contraction amplitude and frequency, stimulated muscle contraction amplitude and the bursting pattern of the intact and ligatured neurons of the ganglion. In the whole heart, nonamidated myosuppressin (pQDLDHVFLRFG) elicited only a small decrease in frequency and amplitude. In the absence of motor neuron input, nonamidated myosuppressin did not cause any significant changes in the amplitude of stimulated contractions. In the intact CG, nonamidated myosuppressin elicited a small but significant decrease in burst duration. Further analysis revealed a correlation between the extent of modulation elicited by nonamidated myosuppressin in the whole heart and the isolated, intact CG. When the neurons of the CG were physically decoupled, nonamidated myosuppressin elicited highly variable responses. Taken together, these data suggest that amidation, but not cyclization, is critical in enabling this peptide to exert its effects on the cardiac neuromuscular system. NEW & NOTEWORTHY Myosuppressin (pQDLDHVFLRFamide), a well-characterized crustacean neuropeptide, and its noncyclized (QDLDHVFLRFamide) and nonamidated (pQDLDHVFLRFG) isoforms alter the output of the cardiac neuromuscular system of the American lobster, Homarus americanus. Mature myosuppressin and noncyclized myosuppressin elicited similar and significant changes across all levels of the isolated system, whereas responses to nonamidated myosuppressin were significantly different from other isoforms and were highly variable. These data support the diversity of peptide action as a function of peptide structure. 
    more » « less
  4. Graphical perception studies typically measure visualization encoding effectiveness using the error of an “average observer”, leading to canonical rankings of encodings for numerical attributes: e.g., position > area > angle > volume. Yet different people may vary in their ability to read different visualization types, leading to variance in this ranking across individuals not captured by population-level metrics using “average observer” models. One way we can bridge this gap is by recasting classic visual perception tasks as tools for assessing individual performance, in addition to overall visualization performance. In this article we replicate and extend Cleveland and McGill's graphical comparison experiment using Bayesian multilevel regression, using these models to explore individual differences in visualization skill from multiple perspectives. The results from experiments and modeling indicate that some people show patterns of accuracy that credibly deviate from the canonical rankings of visualization effectiveness. We discuss implications of these findings, such as a need for new ways to communicate visualization effectiveness to designers, how patterns in individuals’ responses may show systematic biases and strategies in visualization judgment, and how recasting classic visual perception tasks as tools for assessing individual performance may offer new ways to quantify aspects of visualization literacy. Experiment data, source code, and analysis scripts are available at the following repository: https://osf.io/8ub7t/?view_only=9be4798797404a4397be3c6fc2a68cc0 . 
    more » « less
  5. For applications where multiple stakeholders provide recommendations, a fair consensus ranking must not only ensure that the preferences of rankers are well represented, but must also mitigate disadvantages among socio-demographic groups in the final result. However, there is little empirical guidance on the value or challenges of visualizing and integrating fairness metrics and algorithms into human-in-the-loop systems to aid decision-makers. In this work, we design a study to analyze the effectiveness of integrating such fairness metrics-based visualization and algorithms. We explore this through a task-based crowdsourced experiment comparing an interactive visualization system for constructing consensus rankings, ConsensusFuse, with a similar system that includes visual encodings of fairness metrics and fair-rank generation algorithms, FairFuse. We analyze the measure of fairness, agreement of rankers’ decisions, and user interactions in constructing the fair consensus ranking across these two systems. In our study with 200 participants, results suggest that providing these fairness-oriented support features nudges users to align their decision with the fairness metrics while minimizing the tedious process of manually having to amend the consensus ranking. We discuss the implications of these results for the design of next-generation fairness oriented-systems and along with emerging directions for future research. 
    more » « less