skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: From 5Vs to 6Cs: Operationalizing Epidemic Data Management with COVID-19 Surveillance
Abstract—The COVID-19 pandemic brought to the forefront an unprecedented need for experts, as well as citizens, to visualize spatio-temporal disease surveillance data. Web application dashboards were quickly developed to fill t his g ap, b ut a ll of these dashboards supported a particular niche view of the pandemic (ie, current status or specific r egions). I n t his paper, we describe our work developing our COVID-19 Surveillance Dashboard, which offers a unique view of the pandemic while also allowing users to focus on the details that interest them. From the beginning, our goal was to provide a simple visual tool for comparing, organizing, and tracking near-real-time surveillance data as the pandemic progresses. In developing this dashboard, we also identified 6 key metrics which we propose as a standard for the design and evaluation of real-time epidemic science dashboards. Our dashboard was one of the first r eleased t o the public, and continues to be actively visited. Our own group uses it to support federal, state and local public health authorities, and it is used by individuals worldwide to track the evolution of the COVID-19 pandemic, build their own dashboards, and support their organizations as they plan their responses to the pandemic.  more » « less
Award ID(s):
1633028 1443054 1916805 1918656 2028004 2027541
PAR ID:
10403995
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
2020 IEEE International Conference on Big Data (Big Data)
Page Range / eLocation ID:
1380 to 1387
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The COVID-19 pandemic brought to the forefront an unprecedented need for experts, as well as citizens, to visualize spatio-temporal disease surveillance data. Web application dashboards were quickly developed to fill this gap, including those built by JHU, WHO, and CDC, but all of these dashboards supported a particular niche view of the pandemic (ie, current status or specific regions). In this paper1, we describe our work developing our own COVID-19 Surveillance Dashboard, available at https://nssac.bii.virginia.edu/covid19/dashboard/, which offers a universal view of the pandemic while also allowing users to focus on the details that interest them. From the beginning, our goal was to provide a simple visual way to compare, organize, and track near-real-time surveillance data as the pandemic progresses. Our dashboard includes a number of advanced features for zooming, filtering, categorizing and visualizing multiple time series on a single canvas. In developing this dashboard, we have also identified 6 key metrics we call the 6Cs standard which we propose as a standard for the design and evaluation of real-time epidemic science dashboards. Our dashboard was one of the first released to the public, and remains one of the most visited and highly used. Our group uses it to support federal, state and local public health authorities, and it is used by people worldwide to track the pandemic evolution, build their own dashboards, and support their organizations as they plan their responses to the pandemic. We illustrate the utility of our dashboard by describing how it can be used to support data story-telling – an important emerging area in data science. 
    more » « less
  2. During COVID-19, countless dashboards have served as central media where people learn critical information about the pandemic. Varied actors, including news organizations, government agencies, universities, and NGOs created and maintained these dashboards, conducting the onerous labor of collecting, categorizing, and taking care of COVID data. This study uncovers different forms of data practices and labor behind the building of these dashboards, based on in-depth interviews with volunteers and practitioners across India and the United States who have participated in COVID dashboard projects.Specifically, we are interested in projects that have focused on underrepresented or missing COVID data such as COVID cases in prisons and long-term care facilities, racial/ethnic breakdown of cases, as well as deaths due to COVID enforcement. These data builders employed sometimes creative, sometimes mundane and laborious data practices to not simply collect, but to produce these data that are often invisible in the official COVID dataset. In this process of data production, dashboard builders grappled with the questions of how certain data is collected, who/what is missing from the dataset, and how these data voids shape and manipulate our understanding of the pandemic. Interviewing 74 data builders who participated in COVID dashboard projects, this paper demonstrates the range of underrepresented and messy COVID data that these data builders have identified, fixed, and maintained to render them useful: disappearing data, lumped data, and absent data. Such critical engagement with messy COVID data reveals different data injustices that have tremendous potential to affect future pandemic preparation and management. 
    more » « less
  3. Data dashboards provide a means for sharing multiple data products at a glance and were ubiquitous during the COVID-19 pandemic. Data dashboards tracked global and country-specific statistics and provided cartographic visualizations of cases, deaths, vaccination rates and other metrics. We examined the role of geospatial data on COVID-19 dashboards in the form of maps, charts, and graphs. We organize our review of 193 COVID-19 dashboards by region and compare the accessibility and operationality of dashboards over time and the use of web maps and geospatial visualizations. We found that of the dashboards reviewed, only 17% included geospatial visualizations. We observe that many of the COVID-19 dashboards from our analysis are no longer accessible (66%) and consider the ephemeral nature of data and dashboards. We conclude that coordinated efforts and a call to action to ensure the standardization, storage, and maintenance of geospatial data for use on data dashboards and web maps are needed for long-term use, analyses, and monitoring to address current and future public health and other challenging issues. 
    more » « less
  4. Classroom orchestration requires teachers to concurrently manage multiple activities across multiple social levels (individual, group, and class) and under various constraints. Real-time dashboards can support teachers; however, designing actionable dashboards is a huge challenge. This paper describes a participatory design study to identify and inform critical features of a dashboard for displaying relevant, actionable, real-time data. We leveraged a Sense-Assess-Act framework to present dashboard mockups to teachers for feedback. Although the participating teachers differed in how they would use the presented information (during class or after class as a post hoc analysis tool), two common emerging themes were that they wanted to use the data to a) better support their students and b) to make broader instructional decisions. We present data from our study and propose a customizable, mobile dashboard, that can be adapted to a teacher's specific needs at a specific time, to help them better facilitate learning activities. 
    more » « less
  5. Due to the growing concerns surrounding the COVID-19 pandemic, colleges and universities either canceled or remotely hosted their 2020 National Science Foundation Research Experience for Undergraduates (REU) programs. This analysis is part of a larger study examining the impact of these fully remote experiences on professional and psychosocial factors such as mentees' sense of belonging, identity, and self-efficacy and their retention in STEM degree programs. We present a single-student case study and describe the dramaturgical analysis which centers on identifying five fundamental constructs within the data: objectives, conflicts, tactics, attitudes, and emotions. These items investigate what the participant in the remote REU program experienced and how this experience changed the ways in which he thinks about his future career decision-making. Our analysis explored four different sub-narratives: lack of community in virtual REU, mentor support, perception of the "real" nature of the experience in a virtual format, and future career decision-making. The mentee reported that this experience was highly beneficial and that he developed a sense of belonging and identity, despite working remotely -- often from his own bedroom. 
    more » « less