skip to main content

Title: Dynamics of data availability in disease modeling: An example evaluating the trade-offs of ultra-fine-scale factors applied to human West Nile virus disease models in the Chicago area, USA
Background Since 1999, West Nile virus (WNV) has moved rapidly across the United States, resulting in tens of thousands of human cases. Both the number of human cases and the minimum infection rate (MIR) in vector mosquitoes vary across time and space and are driven by numerous abiotic and biotic forces, ranging from differences in microclimates to socio-demographic factors. Because the interactions among these multiple factors affect the locally variable risk of WNV illness, it has been especially difficult to model human disease risk across varying spatial and temporal scales. Cook and DuPage Counties, comprising the city of Chicago and surrounding suburbs, experience some of the highest numbers of human neuroinvasive cases of WNV in the United States. Despite active mosquito control efforts, there is consistent annual WNV presence, resulting in more than 285 confirmed WNV human cases and 20 deaths from the years 2014–2018 in Cook County alone. Methods A previous Chicago-area WNV model identified the fifty-five most high and low risk locations in the Northwest Mosquito Abatement District (NWMAD), an enclave ¼ the size of the combined Cook and DuPage county area. In these locations, human WNV risk was stratified by model performance, as indicated by differences in studentized residuals. Within these areas, an additional two-years of field collections and data processing was added to a 12-year WNV dataset that includes human cases, MIR, vector abundance, and land-use, historical climate, and socio-economic and demographic variables, and was assessed by an ultra-fine-scale (1 km spatial x 1 week temporal resolution) multivariate logistic regression model. Results Multivariate statistical methods applied to the ultra-fine-scale model identified fewer explanatory variables while improving upon the fit of the previous model. Beyond MIR and climatic factors, efforts to acquire additional covariates only slightly improved model predictive performance. Conclusions These results suggest human WNV illness in the Chicago area may be associated with fewer, but increasingly critical, key variables at finer scales. Given limited resources, these findings suggest large variations in model performance occur, depending on covariate availability, and provide guidance in variable selection for optimal WNV human illness modeling.  more » « less
Award ID(s):
Author(s) / Creator(s):
; ; ; ; ; ;
Wen, Feng
Date Published:
Journal Name:
Page Range / eLocation ID:
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Background West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases). Graphical Abstract 
    more » « less
  2. ABSTRACT Mosquito surveillance is critical to reduce the risk of West Nile virus (WNV) transmission to humans. In response to surveillance indicators such as elevated mosquito abundance or increased WNV levels, many mosquito control programs will perform truck-mounted ultra-low volume (ULV) adulticide application to reduce the number of mosquitoes and associated virus transmission. Despite the common use of truck-based ULV adulticiding as a public health measure to reduce WNV prevalence, limited evidence exists to support a role in reducing viral transmission to humans. We use a generalized additive and fused ridge regression model to quantify the location-specific impact of truck-mounted ULV adulticide spray efforts from 2010 to 2018 in the North Shore Mosquito Abatement District (NSMAD) in metropolitan Chicago, IL, on commonly assessed risk factors from NSMAD surveillance gravid traps: Culex abundance, infection rate, and vector index. Our model also takes into account environmental variables commonly associated with WNV, including temperature, precipitation, wind speed, location, and week of year. Since it is unlikely ULV adulticide spraying will have the same impact at each trap location, we use a spatially varying spray effect with a fused ridge penalty to determine how the effect varies by trap location. We found that ULV adulticide spraying has an immediate temporary reduction in abundance followed by an increase after 5 days. It is estimated that mosquito abundance increased more in sprayed areas than if left unsprayed in all but 3 trap locations. The impact on infection rate and vector index were inconclusive due to the large error associated with estimating trap-specific infection rates. 
    more » « less
  3. Since its introduction to North America in 1999, the West Nile virus (WNV) has resulted in over 50,000 human cases and 2400 deaths. WNV transmission is maintained via mosquito vectors and avian reservoir hosts, yet mosquito and avian infections are not uniform across ecological landscapes. As a result, it remains unclear whether the ecological communities of the vectors or reservoir hosts are more predictive of zoonotic risk at the microhabitat level. We examined this question in central Iowa, representative of the midwestern United States, across a land use gradient consisting of suburban interfaces with natural and agricultural habitats. At eight sites, we captured mosquito abundance data using New Jersey light traps and monitored bird communities using visual and auditory point count surveys. We found that the mosquito minimum infection rate (MIR) was better predicted by metrics of the mosquito community than metrics of the bird community, where sites with higher proportions of Culex pipiens group mosquitoes during late summer (after late July) showed higher MIRs. Bird community metrics did not significantly influence mosquito MIRs across sites. Together, these data suggest that the microhabitat suitability of Culex vector species is of greater importance than avian community composition in driving WNV infection dynamics at the urban and agricultural interface. 
    more » « less

    Within the contiguous USA, Florida is unique in having tropical and subtropical climates, a great abundance and diversity of mosquito vectors, and high rates of human travel. These factors contribute to the state being the national ground zero for exotic mosquito-borne diseases, as evidenced by local transmission of viruses spread by Aedes aegypti, including outbreaks of dengue in 2022 and Zika in 2016. Because of limited treatment options, integrated vector management is a key part of mitigating these arboviruses. Practical knowledge of when and where mosquito populations of interest exist is critical for surveillance and control efforts, and habitat predictions at various geographic scales typically rely on ecological niche modeling. However, most of these models, usually created in partnership with academic institutions, demand resources that otherwise may be too time-demanding or difficult for mosquito control programs to replicate and use effectively. Such resources may include intensive computational requirements, high spatiotemporal resolutions of data not regularly available, and/or expert knowledge of statistical analysis. Therefore, our study aims to partner with mosquito control agencies in generating operationally useful mosquito abundance models. Given the increasing threat of mosquito-borne disease transmission in Florida, our analytic approach targets recent Ae. aegypti abundance in the Tampa Bay area. We investigate explanatory variables that: 1) are publicly available, 2) require little to no preprocessing for use, and 3) are known factors associated with Ae. aegypti ecology. Out of our 4 final models, none required more than 5 out of the 36 predictors assessed (13.9%). Similar to previous literature, the strongest predictors were consistently 3- and 4-wk temperature and precipitation lags, followed closely by 1 of 2 environmental predictors: land use/land cover or normalized difference vegetation index. Surprisingly, 3 of our 4 final models included one or more socioeconomic or demographic predictors. In general, larger sample sizes of trap collections and/or citizen science observations should result in greater confidence in model predictions and validation. However, given disparities in trap collections across jurisdictions, individual county models rather than a multicounty conglomerate model would likely yield stronger model fits. Ultimately, we hope that the results of our assessment will enable more accurate and precise mosquito surveillance and control of Ae. aegypti in Florida and beyond.

    more » « less
  5. Abstract Background

    West Nile virus (WNV), primarily vectored by mosquitoes of the genusCulex, is the most important mosquito-borne pathogen in North America, having infected thousands of humans and countless wildlife since its arrival in the USA in 1999. In locations with dedicated mosquito control programs, surveillance methods often rely on frequent testing of mosquitoes collected in a network of gravid traps (GTs) and CO2-baited light traps (LTs). Traps specifically targeting oviposition-seeking (e.g. GTs) and host-seeking (e.g. LTs) mosquitoes are vulnerable to trap bias, and captured specimens are often damaged, making morphological identification difficult.


    This study leverages an alternative mosquito collection method, the human landing catch (HLC), as a means to compare sampling of potential WNV vectors to traditional trapping methods. Human collectors exposed one limb for 15 min at crepuscular periods (5:00–8:30 am and 6:00–9:30 pm daily, the time whenCulexspecies are most actively host-seeking) at each of 55 study sites in suburban Chicago, Illinois, for two summers (2018 and 2019).


    A total of 223 human-seeking mosquitoes were caught by HLC, of which 46 (20.6%) were mosquitoes of genusCulex. Of these 46 collectedCulexspecimens, 34 (73.9%) wereCx. salinarius, a potential WNV vector species not thought to be highly abundant in upper Midwest USA. Per trapping effort, GTs and LTs collected > 7.5-fold the number of individualCulexspecimens than HLC efforts.


    The less commonly used HLC method provides important insight into the complement of human-biting mosquitoes in a region with consistent WNV epidemics. This study underscores the value of the HLC collection method as a complementary tool for surveillance to aid in WNV vector species characterization. However, given the added risk to the collector, novel mitigation methods or alternative approaches must be explored to incorporate HLC collections safely and strategically into control programs.

    Graphical Abstract 
    more » « less