skip to main content

Title: Evaluation of the US COVID-19 Scenario Modeling Hub for informing pandemic response under uncertainty

Our ability to forecast epidemics far into the future is constrained by the many complexities of disease systems. Realistic longer-term projections may, however, be possible under well-defined scenarios that specify the future state of critical epidemic drivers. Since December 2020, the U.S. COVID-19 Scenario Modeling Hub (SMH) has convened multiple modeling teams to make months ahead projections of SARS-CoV-2 burden, totaling nearly 1.8 million national and state-level projections. Here, we find SMH performance varied widely as a function of both scenario validity and model calibration. We show scenarios remained close to reality for 22 weeks on average before the arrival of unanticipated SARS-CoV-2 variants invalidated key assumptions. An ensemble of participating models that preserved variation between models (using the linear opinion pool method) was consistently more reliable than any single model in periods of valid scenario assumptions, while projection interval coverage was near target levels. SMH projections were used to guide pandemic response, illustrating the value of collaborative hubs for longer-term scenario projections.

more » « less
Award ID(s):
2127976 2220903 2028301 2037885 2126278
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more » ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; « less
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Nature Communications
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. As the SARS-CoV-2 trajectory continues, the longer-term immuno-epidemiology of COVID-19, the dynamics of Long COVID, and the impact of escape variants are important outstanding questions. We examine these remaining uncertainties with a simple modelling framework that accounts for multiple (antigenic) exposures via infection or vaccination. If immunity (to infection or Long COVID) accumulates rapidly with the valency of exposure, we find that infection levels and the burden of Long COVID are markedly reduced in the medium term. More pessimistic assumptions on host adaptive immune responses illustrate that the longer-term burden of COVID-19 may be elevated for years to come. However, we also find that these outcomes could be mitigated by the eventual introduction of a vaccine eliciting robust (i.e. durable, transmission-blocking and/or ‘evolution-proof’) immunity. Overall, our work stresses the wide range of future scenarios that still remain, the importance of collecting real-world epidemiological data to identify likely outcomes, and the crucial need for the development of a highly effective transmission-blocking, durable and broadly protective vaccine.

    more » « less
  2. The strategy of relying solely on current SARS-CoV-2 vaccines to halt SARS-CoV-2 transmission has proven infeasible. In response, many public-health authorities have advocated for using vaccines to limit mortality while permitting unchecked SARS-CoV-2 spread (“learning to live with the disease”). The feasibility of this strategy critically depends on the infection fatality rate (IFR) of SARS-CoV-2. An expectation exists that the IFR will decrease due to selection against virulence. In this work, we perform a viral fitness estimation to examine the basis for this expectation. Our findings suggest large increases in virulence for SARS-CoV-2 would result in minimal loss of transmissibility, implying that the IFR may vary freely under neutral evolutionary drift. We use an SEIRS model framework to examine the effect of hypothetical changes in the IFR on steady-state death tolls under COVID-19 endemicity. Our modeling suggests that endemic SARS-CoV-2 implies vast transmission resulting in yearly US COVID-19 death tolls numbering in the hundreds of thousands under many plausible scenarios, with even modest increases in the IFR leading to unsustainable mortality burdens. Our findings highlight the importance of enacting a concerted strategy and continued development of biomedical interventions to suppress SARS-CoV-2 transmission and slow its evolution. 
    more » « less
  3. null (Ed.)
    The future trajectory of the coronavirus disease 2019 (COVID-19) pandemic hinges on the dynamics of adaptive immunity against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2); however, salient features of the immune response elicited by natural infection or vaccination are still uncertain. We use simple epidemiological models to explore estimates for the magnitude and timing of future COVID-19 cases, given different assumptions regarding the protective efficacy and duration of the adaptive immune response to SARS-CoV-2, as well as its interaction with vaccines and nonpharmaceutical interventions. We find that variations in the immune response to primary SARS-CoV-2 infections and a potential vaccine can lead to markedly different immune landscapes and burdens of critically severe cases, ranging from sustained epidemics to near elimination. Our findings illustrate likely complexities in future COVID-19 dynamics and highlight the importance of immunological characterization beyond the measurement of active infections for adequately projecting the immune landscape generated by SARS-CoV-2 infections. 
    more » « less
  4. Abstract

    Each year, SARS-CoV-2 is infecting an increasingly unprecedented number of species. In the present article, we combine mammalian phylogeny with the genetic characteristics of isolates found in mammals to elaborate on the host-range potential of SARS-CoV-2. Infections in nonhuman mammals mirror those of contemporary viral strains circulating in humans, although, in certain species, extensive viral circulation has led to unique genetic signatures. As in other recent studies, we found that the conservation of the ACE2 receptor cannot be considered the sole major determinant of susceptibility. However, we are able to identify major clades and families as candidates for increased surveillance. On the basis of our findings, we argue that the use of the term panzootic could be a more appropriate term than pandemic to describe the ongoing scenario. This term better captures the magnitude of the SARS-CoV-2 host range and would hopefully inspire inclusive policy actions, including systematic screenings, that could better support the management of this worldwide event.

    more » « less
  5. null (Ed.)
    Abstract We use COVID-19 case and mortality data from 1 February 2020 to 21 September 2020 and a deterministic SEIR (susceptible, exposed, infectious and recovered) compartmental framework to model possible trajectories of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infections and the effects of non-pharmaceutical interventions in the United States at the state level from 22 September 2020 through 28 February 2021. Using this SEIR model, and projections of critical driving covariates (pneumonia seasonality, mobility, testing rates and mask use per capita), we assessed scenarios of social distancing mandates and levels of mask use. Projections of current non-pharmaceutical intervention strategies by state—with social distancing mandates reinstated when a threshold of 8 deaths per million population is exceeded (reference scenario)—suggest that, cumulatively, 511,373 (469,578–578,347) lives could be lost to COVID-19 across the United States by 28 February 2021. We find that achieving universal mask use (95% mask use in public) could be sufficient to ameliorate the worst effects of epidemic resurgences in many states. Universal mask use could save an additional 129,574 (85,284–170,867) lives from September 22, 2020 through the end of February 2021, or an additional 95,814 (60,731–133,077) lives assuming a lesser adoption of mask wearing (85%), when compared to the reference scenario. 
    more » « less