skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: From 5Vs to 6Cs: Operationalizing Epidemic Data Management with COVID-19 Surveillance
Abstract—The COVID-19 pandemic brought to the forefront an unprecedented need for experts, as well as citizens, to visualize spatio-temporal disease surveillance data. Web application dashboards were quickly developed to fill t his g ap, b ut a ll of these dashboards supported a particular niche view of the pandemic (ie, current status or specific r egions). I n t his paper, we describe our work developing our COVID-19 Surveillance Dashboard, which offers a unique view of the pandemic while also allowing users to focus on the details that interest them. From the beginning, our goal was to provide a simple visual tool for comparing, organizing, and tracking near-real-time surveillance data as the pandemic progresses. In developing this dashboard, we also identified 6 key metrics which we propose as a standard for the design and evaluation of real-time epidemic science dashboards. Our dashboard was one of the first r eleased t o the public, and continues to be actively visited. Our own group uses it to support federal, state and local public health authorities, and it is used by individuals worldwide to track the evolution of the COVID-19 pandemic, build their own dashboards, and support their organizations as they plan their responses to the pandemic.  more » « less
Award ID(s):
1633028 1443054 1916805 1918656 2028004 2027541
PAR ID:
10403995
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
2020 IEEE International Conference on Big Data (Big Data)
Page Range / eLocation ID:
1380 to 1387
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The COVID-19 pandemic brought to the forefront an unprecedented need for experts, as well as citizens, to visualize spatio-temporal disease surveillance data. Web application dashboards were quickly developed to fill this gap, including those built by JHU, WHO, and CDC, but all of these dashboards supported a particular niche view of the pandemic (ie, current status or specific regions). In this paper1, we describe our work developing our own COVID-19 Surveillance Dashboard, available at https://nssac.bii.virginia.edu/covid19/dashboard/, which offers a universal view of the pandemic while also allowing users to focus on the details that interest them. From the beginning, our goal was to provide a simple visual way to compare, organize, and track near-real-time surveillance data as the pandemic progresses. Our dashboard includes a number of advanced features for zooming, filtering, categorizing and visualizing multiple time series on a single canvas. In developing this dashboard, we have also identified 6 key metrics we call the 6Cs standard which we propose as a standard for the design and evaluation of real-time epidemic science dashboards. Our dashboard was one of the first released to the public, and remains one of the most visited and highly used. Our group uses it to support federal, state and local public health authorities, and it is used by people worldwide to track the pandemic evolution, build their own dashboards, and support their organizations as they plan their responses to the pandemic. We illustrate the utility of our dashboard by describing how it can be used to support data story-telling – an important emerging area in data science. 
    more » « less
  2. During COVID-19, countless dashboards have served as central media where people learn critical information about the pandemic. Varied actors, including news organizations, government agencies, universities, and NGOs created and maintained these dashboards, conducting the onerous labor of collecting, categorizing, and taking care of COVID data. This study uncovers different forms of data practices and labor behind the building of these dashboards, based on in-depth interviews with volunteers and practitioners across India and the United States who have participated in COVID dashboard projects.Specifically, we are interested in projects that have focused on underrepresented or missing COVID data such as COVID cases in prisons and long-term care facilities, racial/ethnic breakdown of cases, as well as deaths due to COVID enforcement. These data builders employed sometimes creative, sometimes mundane and laborious data practices to not simply collect, but to produce these data that are often invisible in the official COVID dataset. In this process of data production, dashboard builders grappled with the questions of how certain data is collected, who/what is missing from the dataset, and how these data voids shape and manipulate our understanding of the pandemic. Interviewing 74 data builders who participated in COVID dashboard projects, this paper demonstrates the range of underrepresented and messy COVID data that these data builders have identified, fixed, and maintained to render them useful: disappearing data, lumped data, and absent data. Such critical engagement with messy COVID data reveals different data injustices that have tremendous potential to affect future pandemic preparation and management. 
    more » « less
  3. Data dashboards provide a means for sharing multiple data products at a glance and were ubiquitous during the COVID-19 pandemic. Data dashboards tracked global and country-specific statistics and provided cartographic visualizations of cases, deaths, vaccination rates and other metrics. We examined the role of geospatial data on COVID-19 dashboards in the form of maps, charts, and graphs. We organize our review of 193 COVID-19 dashboards by region and compare the accessibility and operationality of dashboards over time and the use of web maps and geospatial visualizations. We found that of the dashboards reviewed, only 17% included geospatial visualizations. We observe that many of the COVID-19 dashboards from our analysis are no longer accessible (66%) and consider the ephemeral nature of data and dashboards. We conclude that coordinated efforts and a call to action to ensure the standardization, storage, and maintenance of geospatial data for use on data dashboards and web maps are needed for long-term use, analyses, and monitoring to address current and future public health and other challenging issues. 
    more » « less
  4. Classroom orchestration requires teachers to concurrently manage multiple activities across multiple social levels (individual, group, and class) and under various constraints. Real-time dashboards can support teachers; however, designing actionable dashboards is a huge challenge. This paper describes a participatory design study to identify and inform critical features of a dashboard for displaying relevant, actionable, real-time data. We leveraged a Sense-Assess-Act framework to present dashboard mockups to teachers for feedback. Although the participating teachers differed in how they would use the presented information (during class or after class as a post hoc analysis tool), two common emerging themes were that they wanted to use the data to a) better support their students and b) to make broader instructional decisions. We present data from our study and propose a customizable, mobile dashboard, that can be adapted to a teacher's specific needs at a specific time, to help them better facilitate learning activities. 
    more » « less
  5. Abstract ObjectiveThe COVID-19 pandemic emphasized the value of geospatial visual analytics for both epidemiologists and the general public. However, systems struggled to encode temporal and geospatial trends of multiple, potentially interacting variables, such as active cases, deaths, and vaccinations. We sought to ask (1) how epidemiologists interact with visual analytics tools, (2) how multiple, time-varying, geospatial variables can be conveyed in a unified view, and (3) how complex spatiotemporal encodings affect utility for both experts and non-experts. Materials and MethodsWe propose encoding variables with animated, concentric, hollow circles, allowing multiple variables via color encoding and avoiding occlusion problems, and we implement this method in a browser-based tool called CoronaViz. We conduct task-based evaluations with non-experts, as well as in-depth interviews and observational sessions with epidemiologists, covering a range of tools and encodings. ResultsSessions with epidemiologists confirmed the importance of multivariate, spatiotemporal queries and the utility of CoronaViz for answering them, while providing direction for future development. Non-experts tasked with performing spatiotemporal queries unanimously preferred animation to multi-view dashboards. DiscussionWe find that conveying complex, multivariate data necessarily involves trade-offs. Yet, our studies suggest the importance of complementary visualization strategies, with our animated multivariate spatiotemporal encoding filling important needs for exploration and presentation. ConclusionCoronaViz’s unique ability to convey multiple, time-varying, geospatial variables makes it both a valuable addition to interactive COVID-19 dashboards and a platform for empowering experts and the public during future disease outbreaks. CoronaViz is open-source and a live instance is freely hosted at http://coronaviz.umiacs.io. 
    more » « less