skip to main content


Title: Causal inference methods for vaccine sieve analysis with effect modification
The protective effects of vaccines may vary depending on individual characteristics, such as age. Traditionally, such effect modification has been examined with subgroup analyses or inclusion of cross‐product terms in regression frameworks. However, in many vaccine settings, effect modification may also depend on the infecting pathogen's characteristics, which are measured postrandomization. Sieve analysis examines whether such effects are present by combining pathogen genetic sequence information with individual‐level data and can generate new hypotheses on the pathways whereby vaccines provide protection. In this article, we develop a causal framework for evaluating effect modification in the context of sieve analysis. Our approach can be used to assess the magnitude of sieve effects and, in particular, whether these effects are modified by individual‐level characteristics. Our method accounts for difficulties occurring in real‐world data analysis, such as competing risks, nonrandomized treatments, and differential dropout. Our approach also integrates modern machine learning techniques. We demonstrate the validity and efficiency of our approach in simulation studies and apply the methodology to a malaria vaccine study.  more » « less
Award ID(s):
2015540
NSF-PAR ID:
10455954
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Statistics in Medicine
Volume:
41
Issue:
8
ISSN:
0277-6715
Page Range / eLocation ID:
1513 to 1524
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Turner, Richard (Ed.)
    Background With the availability of multiple Coronavirus Disease 2019 (COVID-19) vaccines and the predicted shortages in supply for the near future, it is necessary to allocate vaccines in a manner that minimizes severe outcomes, particularly deaths. To date, vaccination strategies in the United States have focused on individual characteristics such as age and occupation. Here, we assess the utility of population-level health and socioeconomic indicators as additional criteria for geographical allocation of vaccines. Methods and findings County-level estimates of 14 indicators associated with COVID-19 mortality were extracted from public data sources. Effect estimates of the individual indicators were calculated with univariate models. Presence of spatial autocorrelation was established using Moran’s I statistic. Spatial simultaneous autoregressive (SAR) models that account for spatial autocorrelation in response and predictors were used to assess (i) the proportion of variance in county-level COVID-19 mortality that can explained by identified health/socioeconomic indicators (R 2 ); and (ii) effect estimates of each predictor. Adjusting for case rates, the selected indicators individually explain 24%–29% of the variability in mortality. Prevalence of chronic kidney disease and proportion of population residing in nursing homes have the highest R 2 . Mortality is estimated to increase by 43 per thousand residents (95% CI: 37–49; p < 0.001) with a 1% increase in the prevalence of chronic kidney disease and by 39 deaths per thousand (95% CI: 34–44; p < 0.001) with 1% increase in population living in nursing homes. SAR models using multiple health/socioeconomic indicators explain 43% of the variability in COVID-19 mortality in US counties, adjusting for case rates. R 2 was found to be not sensitive to the choice of SAR model form. Study limitations include the use of mortality rates that are not age standardized, a spatial adjacency matrix that does not capture human flows among counties, and insufficient accounting for interaction among predictors. Conclusions Significant spatial autocorrelation exists in COVID-19 mortality in the US, and population health/socioeconomic indicators account for a considerable variability in county-level mortality. In the context of vaccine rollout in the US and globally, national and subnational estimates of burden of disease could inform optimal geographical allocation of vaccines. 
    more » « less
  2. Read, Andrew Fraser (Ed.)
    Two of the Coronavirus Disease 2019 (COVID-19) vaccines currently approved in the United States require 2 doses, administered 3 to 4 weeks apart. Constraints in vaccine supply and distribution capacity, together with a deadly wave of COVID-19 from November 2020 to January 2021 and the emergence of highly contagious Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) variants, sparked a policy debate on whether to vaccinate more individuals with the first dose of available vaccines and delay the second dose or to continue with the recommended 2-dose series as tested in clinical trials. We developed an agent-based model of COVID-19 transmission to compare the impact of these 2 vaccination strategies, while varying the temporal waning of vaccine efficacy following the first dose and the level of preexisting immunity in the population. Our results show that for Moderna vaccines, a delay of at least 9 weeks could maximize vaccination program effectiveness and avert at least an additional 17.3 (95% credible interval [CrI]: 7.8–29.7) infections, 0.69 (95% CrI: 0.52–0.97) hospitalizations, and 0.34 (95% CrI: 0.25–0.44) deaths per 10,000 population compared to the recommended 4-week interval between the 2 doses. Pfizer-BioNTech vaccines also averted an additional 0.60 (95% CrI: 0.37–0.89) hospitalizations and 0.32 (95% CrI: 0.23–0.45) deaths per 10,000 population in a 9-week delayed second dose (DSD) strategy compared to the 3-week recommended schedule between doses. However, there was no clear advantage of delaying the second dose with Pfizer-BioNTech vaccines in reducing infections, unless the efficacy of the first dose did not wane over time. Our findings underscore the importance of quantifying the characteristics and durability of vaccine-induced protection after the first dose in order to determine the optimal time interval between the 2 doses. 
    more » « less
  3. Abstract

    Widespread uptake of vaccines is necessary to achieve herd immunity. However, uptake rates have varied across U.S. states during the first six months of the COVID-19 vaccination program. Misbeliefs may play an important role in vaccine hesitancy, and there is a need to understand relationships between misinformation, beliefs, behaviors, and health outcomes. Here we investigate the extent to which COVID-19 vaccination rates and vaccine hesitancy are associated with levels of online misinformation about vaccines. We also look for evidence of directionality from online misinformation to vaccine hesitancy. We find a negative relationship between misinformation and vaccination uptake rates. Online misinformation is also correlated with vaccine hesitancy rates taken from survey data. Associations between vaccine outcomes and misinformation remain significant when accounting for political as well as demographic and socioeconomic factors. While vaccine hesitancy is strongly associated with Republican vote share, we observe that the effect of online misinformation on hesitancy is strongest across Democratic rather than Republican counties. Granger causality analysis shows evidence for a directional relationship from online misinformation to vaccine hesitancy. Our results support a need for interventions that address misbeliefs, allowing individuals to make better-informed health decisions.

     
    more » « less
  4. null (Ed.)
    We study allocation of COVID-19 vaccines to individuals based on the structural properties of their underlying social contact network. Even optimistic estimates suggest that most countries will likely take 6 to 24 months to vaccinate their citizens. These time estimates and the emergence of new viral strains urge us to find quick and effective ways to allocate the vaccines and contain the pandemic. While current approaches use combinations of age-based and occupation-based prioritizations, our strategy marks a departure from such largely aggregate vaccine allocation strategies. We propose a novel agent-based modeling approach motivated by recent advances in (i) science of real-world networks that point to efficacy of certain vaccination strategies and (ii) digital technologies that improve our ability to estimate some of these structural properties. Using a realistic representation of a social contact network for the Commonwealth of Virginia, combined with accurate surveillance data on spatio-temporal cases and currently accepted models of within- and between-host disease dynamics, we study how a limited number of vaccine doses can be strategically distributed to individuals to reduce the overall burden of the pandemic. We show that allocation of vaccines based on individuals' degree (number of social contacts) and total social proximity time is signi ficantly more effective than the currently used age-based allocation strategy in terms of number of infections, hospitalizations and deaths. Our results suggest that in just two months, by March 31, 2021, compared to age-based allocation, the proposed degree-based strategy can result in reducing an additional 56{110k infections, 3.2{5.4k hospitalizations, and 700{900 deaths just in the Commonwealth of Virginia. Extrapolating these results for the entire US, this strategy can lead to 3{6 million fewer infections, 181{306k fewer hospitalizations, and 51{62k fewer deaths compared to age-based allocation. The overall strategy is robust even: (i) if the social contacts are not estimated correctly; (ii) if the vaccine efficacy is lower than expected or only a single dose is given; (iii) if there is a delay in vaccine production and deployment; and (iv) whether or not non-pharmaceutical interventions continue as vaccines are deployed. For reasons of implementability, we have used degree, which is a simple structural measure and can be easily estimated using several methods, including the digital technology available today. These results are signi ficant, especially for resource-poor countries, where vaccines are less available, have lower efficacy, and are more slowly distributed. 
    more » « less
  5. Low, Nicola (Ed.)
    Background While booster vaccinations clearly reduce the risk of severe Coronavirus Disease 2019 (COVID-19) and death, the impact of boosters on Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) infections has not been fully characterized: Doing so requires understanding their impact on asymptomatic and mildly symptomatic infections that often go unreported but nevertheless play an important role in spreading SARS-CoV-2. We sought to estimate the impact of COVID-19 booster doses on SARS-CoV-2 infections in a vaccinated population of young adults during an Omicron BA.1-predominant period. Methods and findings We implemented a cohort study of young adults in a college environment (Cornell University’s Ithaca campus) from a period when Omicron BA.1 was the predominant SARS-CoV-2 variant on campus (December 5 to December 31, 2021). Participants included 15,800 university students who completed initial vaccination series with vaccines approved by the World Health Organization for emergency use, were enrolled in mandatory at-least-weekly surveillance polymerase chain reaction (PCR) testing, and had no positive SARS-CoV-2 PCR test within 90 days before the start of the study period. Robust multivariable Poisson regression with the main outcome of a positive SARS-CoV-2 PCR test was performed to compare those who completed their initial vaccination series and a booster dose to those without a booster dose. A total of 1,926 unique SARS-CoV-2 infections were identified in the study population. Controlling for sex, student group membership, date of completion of initial vaccination series, initial vaccine type, and temporal effect during the study period, our analysis estimates that receiving a booster dose further reduces the rate of having a PCR-detected SARS-CoV-2 infection relative to an initial vaccination series by 56% (95% confidence interval [42%, 67%], P < 0.001). While most individuals had recent booster administration before or during the study period (a limitation of our study), this result is robust to the assumed delay over which a booster dose becomes effective (varied from 1 day to 14 days). The mandatory active surveillance approach used in this study, under which 86% of the person-days in the study occurred, reduces the likelihood of outcome misclassification. Key limitations of our methodology are that we did not have an a priori protocol or statistical analysis plan because the analysis was initially done for institutional research purposes, and some analysis choices were made after observing the data. Conclusions We observed that boosters are effective, relative to completion of initial vaccination series, in further reducing the rate of SARS-CoV-2 infections in a college student population during a period when Omicron BA.1 was predominant; booster vaccinations for this age group may play an important role in reducing incidence of COVID-19. 
    more » « less