skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Evaluating the Effect of Timeline Shape on Visualization Task Performance
Timelines are commonly represented on a horizontal line, which is not necessarily the most effective way to visualize temporal event sequences. However, few experiments have evaluated how timeline shape influences task performance. We present the design and results of a controlled experiment run on Amazon Mechanical Turk (n=192) in which we evaluate how timeline shape affects task completion time, correctness, and user preference. We tested 12 combinations of 4 shapes --- horizontal line, vertical line, circle, and spiral — and 3 data types — recurrent, non-recurrent, and mixed event sequences. We found good evidence that timeline shape meaningfully affects user task completion time but not correctness and that users have a strong shape preference. Building on our results, we present design guidelines for creating effective timeline visualizations based on user task and data types. A free copy of this paper, the evaluation stimuli and data, and code are available https://osf.io/qr5yu/  more » « less
Award ID(s):
1755901
PAR ID:
10157010
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Page Range / eLocation ID:
1 - 12
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Temporal event sequence alignment has been used in many domains to visualize nuanced changes and interactions over time. Existing approaches align one or two sentinel events. Overview tasks require examining all alignments of interest using interaction and time or juxtaposition of many visualizations. Furthermore, any event attribute overviews are not closely tied to sequence visualizations. We present SEQUENCE BRAIDING, a novel overview visualization for temporal event sequences and attributes using a layered directed acyclic network. SEQUENCE BRAIDING visually aligns many temporal events and attribute groups simultaneously and supports arbitrary ordering, absence, and duplication of events. In a controlled experiment we compare SEQUENCE BRAIDING and IDMVis on user task completion time, correctness, error, and confidence. Our results provide good evidence that users of SEQUENCE BRAIDING can understand high-level patterns and trends faster and with similar error. A full version of this paper with all appendices; the evaluation stimuli, data, and analysis code; and source code are available at osf.io/mq2wt. 
    more » « less
  2. Continuous-time event data are common in applications such as individual behavior data, financial transactions, and medical health records. Modeling such data can be very challenging, in particular for applications with many different types of events, since it requires a model to predict the event types as well as the time of occurrence. Recurrent neural networks that parameterize time-varying intensity functions are the current state-of-the-art for predictive modeling with such data. These models typically assume that all event sequences come from the same data distribution. However, in many applications event sequences are generated by different sources, or users, and their characteristics can be very different. In this paper, we extend the broad class of neural marked point process models to mixtures of latent embeddings, where each mixture component models the characteristic traits of a given user. Our approach relies on augmenting these models with a latent variable that encodes user characteristics, represented by a mixture model over user behavior that is trained via amortized variational inference. We evaluate our methods on four large real-world datasets and demonstrate systematic improvements from our approach over existing work for a variety of predictive metrics such as log-likelihood, next event ranking, and source-of-sequence identification. 
    more » « less
  3. Understanding design processes and behaviors are important for building more effective design outcomes. During design tasks, teams exhibit sequences of actions that form strategies. This paper investigates patterns of design actions to identify successful design strategies in paired parameter design tasks. The paper uses secondary data from a design experiment in which each pair completes a series of simplified cooperative parameter design tasks to minimize completion time. Analysis of 192 task observations uses principal component analysis to identify design strategies and regression analysis to evaluate their impacts on performance outcomes. Results show that the design strategy of short average action time, small average action size, and low action variation significantly decreases completion time. Discussion of results suggests smaller and more frequent actions provide more rapid feedback about each action to improve communication and understanding between pairs, leading to more efficient design processes. Results show that task order and the number of variables also significantly contribute to performance outcomes, which aligns with past literature. Results also show a negative relationship between lower English ability, experience level, and team performance outcomes. The discussion suggests that lower English ability can be a barrier to communication between pairs, and a lower experience level can decrease the ability to create effective strategies. 
    more » « less
  4. Abstract Understanding design processes and behaviors is important for building more effective design outcomes. During design tasks, teams exhibit sequences of actions that form strategies. This article investigates patterns of design actions in a paired parameter design experiment to discover design strategies that influence outcomes. The analysis uses secondary data from a design experiment in which each pair completes a series of simplified cooperative parameter design tasks to minimize completion time. Analysis of 192 task observations uses exploratory factor analysis to identify design strategies and regression analysis to evaluate their impacts on performance outcomes. The article finds that large actions and high action size variability significantly increase completion times, leading to poor performance outcomes. However, results show that frequently changing input controllers within and among designers significantly reduces completion times, leading to higher performance outcomes. Discussion states that larger actions can introduce unexpected errors, while smaller and consistent actions enhance designers’ understanding of the effects of each action, aiding in better planning for subsequent steps. Frequent controller switching reflects effective communication and understanding within design teams, which is crucial for cooperative tasks. 
    more » « less
  5. We present a prototype virtual reality user interface for robot teleoperation that supports high-level specification of 3D object positions and orientations in remote assembly tasks. Users interact with virtual replicas of task objects. They asynchronously assign multiple goals in the form of 6DoF destination poses without needing to be familiar with specific robots and their capabilities, and manage and monitor the execution of these goals. The user interface employs two different spatiotemporal visualizations for assigned goals: one represents all goals within the user’s workspace (Aggregated View), while the other depicts each goal within a separate world in miniature (Timeline View). We conducted a user study of the interface without the robot system to compare how these visualizations affect user efficiency and task load. The results show that while the Aggregated View helped the participants finish the task faster, the participants preferred the Timeline View. 
    more » « less