More Like this

1. Communicative Visualizations as a Learning Problem

   https://doi.org/10.1109/TVCG.2020.3030375  

   Adar, Eytan; Lee, Elsie (January 2020, IEEE Transactions on Visualization and Computer Graphics)

   null (Ed.)

   Significant research has provided robust task and evaluation languages for the analysis of exploratory visualizations. Unfortunately, these taxonomies fail when applied to communicative visualizations. Instead, designers often resort to evaluating communicative visualizations from the cognitive efficiency perspective: "can the recipient accurately decode my message/insight?" However, designers are unlikely to be satisfied if the message went 'in one ear and out the other.' The consequence of this inconsistency is that it is difficult to design or select between competing options in a principled way. The problem we address is the fundamental mismatch between how designers want to describe their intent, and the language they have. We argue that visualization designers can address this limitation through a learning lens: that the recipient is a student and the designer a teacher. By using learning objectives, designers can better define, assess, and compare communicative visualizations. We illustrate how the learning-based approach provides a framework for understanding a wide array of communicative goals. To understand how the framework can be applied (and its limitations), we surveyed and interviewed members of the Data Visualization Society using their own visualizations as a probe. Through this study we identified the broad range of objectives in communicative visualizations and the prevalence of certain objective types. 

   more » « less
2. Simulated Language Learning from Communicative Goals and Linguistic Input

   Zhu, Hao; Bisk, Yonatan; Neubig, Graham (January 2022, Proceedings of the Annual Meeting of the Cognitive Science Society)

   Children do not learn language from passively analyzing correlations between language and observations, but from interaction with caregivers or peers. The non-nativist approach claims that the main driver of language learning should be to achieve communicative goals. Imitation, on the other hand, is another natural desire that many argue influences language learning. However, there are still gaps in the research on what roles communicative goals and imitating linguistic input play in language acquisition, due to the difficulty of performing comprehensive experiments with human learners. In this paper, we propose a computational framework using simulated experiments that allows us to compare the roles of the two drivers. Specifically, we simulate a two-way communication game between a speaker, corresponding to a language learner, and a listener, corresponding to a caregiver or teacher. The speaker's communicative goals are modeled as rewards for successful completion of a referential game, and imitation is performed by mimicking feedback from the listener. The listener adaptively chooses to give feedback and makes choices based on the speaker's utterances. With empirical results on naturalistic visual and language data, we find that communicative goals play an important role in driving language learning, whereas imitation accelerates the learning process. We also find that (1) models trained with communicative goals tend to use minimal vocabulary and utterances and overextend them to concepts outside the original word meanings; (2) the strategy with which the listener provides feedback also influences the learning results and speed. Code and data for replicating the experiments are available (https://bit.ly/interactgym) to spur future research on models for computational studies of language learning. 

   more » « less
3. Roboviz: A Game-Centered Project for Information Visualization Education

   https://doi.org/10.1109/TVCG.2022.3209402  

   Adar, Eytan; Lee-Robbins, Elsie (January 2023, IEEE Transactions on Visualization and Computer Graphics)

   Due to their pedagogical advantages, large final projects in information visualization courses have become standard practice. Students take on a client–real or simulated–a dataset, and a vague set of goals to create a complete visualization or visual analytics product. Unfortunately, many projects suffer from ambiguous goals, over or under-constrained client expectations, and data constraints that have students spending their time on non-visualization problems (e.g., data cleaning). These are important skills, but are often secondary course objectives, and unforeseen problems can majorly hinder students. We created an alternative for our information visualization course: Roboviz, a real-time game for students to play by building a visualization-focused interface. By designing the game mechanics around four different data types, the project allows students to create a wide array of interactive visualizations. Student teams play against their classmates with the objective to collect the most (good) robots. The flexibility of the strategies encourages variability, a range of approaches, and solving wicked design constraints. We describe the construction of this game and report on student projects over two years. We further show how the game mechanics can be extended or adapted to other game-based projects. 

   more » « less
4. Anderson and Krathwohl's Two-Dimensional Taxonomy Applied to Supporting and Predicting Learning During Search

   https://doi.org/10.1145/3343413.3377947  

   Urgo, Kelsey (March 2020, Proceedings of the 2020 Conference on Human Information Interaction and Retrieval)

   There is a growing body of research in the Search as Learning community that recognizes the need for users to learn during search, but modern search systems have yet to adapt to support this need. Our research proposes three research goals toward addressing the support of user learning during search. Research goal 1 (RG1) introduces a more precise and reliable metric of assessing user learning. Anderson & Krathwohl’s 2-dimensional taxonomy is used as a framework to develop learning objectives and assessment questions to measure user learning during search. Additionally, Anderson & Krathwohl’s taxonomy is used as a coding scheme to outline the pathways users traverse along the way to a particular learning objective. Research goal 2 (RG2) investigates the prediction of learning objectives using behavioral measures. Finally, research goal 3 (RG3) proposes a search system that presents information relevant to the user based on their current learning sub-goal and scaffolds information based on the pathways they are likely to traverse given a particular learning objective. 

   more » « less
5. Vistrust: a Multidimensional Framework and Empirical Study of Trust in Data Visualizations

   https://doi.org/10.1109/TVCG.2023.3326579  

   Elhamdadi, Hamza; Stefkovics, Adam; Beyer, Johanna; Moerth, Eric; Pfister, Hanspeter; Bearfield, Cindy Xiong; Nobre, Carolina (January 2024, IEEE Transactions on Visualization and Computer Graphics)

   Trust is an essential aspect of data visualization, as it plays a crucial role in the interpretation and decision-making processes of users. While research in social sciences outlines the multi-dimensional factors that can play a role in trust formation, most data visualization trust researchers employ a single-item scale to measure trust. We address this gap by proposing a comprehensive, multidimensional conceptualization and operationalization of trust in visualization. We do this by applying general theories of trust from social sciences, as well as synthesizing and extending earlier work and factors identified by studies in the visualization field. We apply a two-dimensional approach to trust in visualization, to distinguish between cognitive and affective elements, as well as between visualization and data-specific trust antecedents. We use our framework to design and run a large crowd-sourced study to quantify the role of visual complexity in establishing trust in science visualizations. Our study provides empirical evidence for several aspects of our proposed theoretical framework, most notably the impact of cognition, affective responses, and individual differences when establishing trust in visualizations. 

   more » « less