During the 2022–2023 unprecedented mpox epidemic, near real-time short-term forecasts of the epidemic’s trajectory were essential in intervention implementation and guiding policy. However, as case levels have significantly decreased, evaluating model performance is vital to advancing the field of epidemic forecasting. Using laboratory-confirmed mpox case data from the Centers for Disease Control and Prevention and Our World in Data teams, we generated retrospective sequential weekly forecasts for Brazil, Canada, France, Germany, Spain, the United Kingdom, the United States and at the global scale using an auto-regressive integrated moving average (ARIMA) model, generalized additive model, simple linear regression, Facebook’s Prophet model, as well as the sub-epidemic wave andn-sub-epidemic modelling frameworks. We assessed forecast performance using average mean squared error, mean absolute error, weighted interval scores, 95% prediction interval coverage, skill scores and Winkler scores. Overall, then-sub-epidemic modelling framework outcompeted other models across most locations and forecasting horizons, with the unweighted ensemble model performing best most frequently. Then-sub-epidemic and spatial-wave frameworks considerably improved in average forecasting performance relative to the ARIMA model (greater than 10%) for all performance metrics. Findings further support sub-epidemic frameworks for short-term forecasting epidemics of emerging and re-emerging infectious diseases.
more »
« less
This content will become publicly available on December 1, 2025
Short-Term Predictions of the Trajectory of Mpox in East Asian Countries, 2022–2023: A Comparative Study of Forecasting Approaches
The 2022–2023 mpox outbreak exhibited an uneven global distribution. While countries such as the UK, Brazil, and the USA were most heavily affected in 2022, many Asian countries, specifically China, Japan, South Korea, and Thailand, experienced the outbreak later, in 2023, with significantly fewer reported cases relative to their populations. This variation in timing and scale distinguishes the outbreaks in these Asian countries from those in the first wave. This study evaluates the predictability of mpox outbreaks with smaller case counts in Asian countries using popular epidemic forecasting methods, including the ARIMA, Prophet, GLM, GAM, n-Sub-epidemic, and Sub-epidemic Wave frameworks. Despite the fact that the ARIMA and GAM models performed well for certain countries and prediction windows, their results were generally inconsistent and highly dependent on the country, i.e., the dataset, as well as the prediction interval length. In contrast, n-Sub-epidemic Ensembles demonstrated more reliable and robust performance across different datasets and predictions, indicating the effectiveness of this model on small datasets and its utility in the early stages of future pandemics.
more »
« less
- Award ID(s):
- 2412914
- PAR ID:
- 10578315
- Publisher / Repository:
- MDPI
- Date Published:
- Journal Name:
- Mathematics
- Volume:
- 12
- Issue:
- 23
- ISSN:
- 2227-7390
- Page Range / eLocation ID:
- 3669
- Subject(s) / Keyword(s):
- forecasting ARIMA Prophet GAM mpox monkeypox Asia China South Korea Japan Thailand model comparison epidemiology incidence
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Mpox is an emerging, infectious disease that has caused outbreaks in at least 91 countries from May to August 2022. We assessed the link between international air travel patterns and Mpox transmission risk, and the relationship between the translocation of Mpox and human mobility dynamics after travel restrictions due to the COVID-19 pandemic had been lifted. Our three novel observations were that: i) more people traveled internationally after the removal of travel restrictions in the summer of 2022 compared to pre-pandemic levels; ii) countries with a high concentration of global air travel have the most recorded Mpox cases; and iii) Mpox transmission includes a number of previously nonendemic regions. These results suggest that international airports should be a primary location for monitoring the risk of emerging communicable diseases. Findings highlight the need for global collaboration concerning proactive measures emphasizing realtime surveillance.more » « less
-
Background The 2022 monkeypox (mpox) outbreak in Los Angeles County (LAC) emphasized the need to prepare for emergent infectious disease outbreaks. Vaccination and promotion of sexual risk reduction practices appeared successful in LAC, as mpox cases declined starting in August. Nonetheless, questions persisted regarding the effectiveness of targeting vaccinations and the role of sexual risk reduction in reducing mpox cases. Methods We collaborated with the LAC Department of Public Health to develop a microsimulation for men who have sex with men (MSM). This model tracked mpox dynamics by age, race/ethnicity, and HIV status and was calibrated and validated against surveillance data. We simulated counterfactual scenarios to understand the effects of variation in vaccination rates, timing of vaccination rollout, vaccine allocation, and sexual contact rates. Results In the simulation, doubling the vaccination rate reduced cumulative cases over a 40-week time horizon by 13% but would necessitate 88 995 additional doses. Initiating vaccination 2 weeks earlier decreased cases by 11%, while an 8-week delay yielded a 20% increase in cases. A 3-week earlier decrease in sexual contact rates reduced cumulative cases by 60%, while a 3-week delay resulted in a 95% increase. Prioritizing people with HIV (PWH) for vaccination reduced cumulative cases, while allocating vaccines to a single racial/ethnic group was not effective. Conclusions Our study highlights the significance of policies to support timely vaccination and sexual partnership reduction to address mpox outbreaks among MSM. These findings also underscore the need to target vulnerable risk groups, such as PWH.more » « less
-
null (Ed.)Climate variables influence the occurrence, growth, and distribution of Vibrio cholerae in the aquatic environment. Together with socio-economic factors, these variables affect the incidence and intensity of cholera outbreaks. The current pandemic of cholera began in the 1960s, and millions of cholera cases are reported each year globally. Hence, cholera remains a significant health challenge, notably where human vulnerability intersects with changes in hydrological and environmental processes. Cholera outbreaks may be epidemic or endemic, the mode of which is governed by trigger and transmission components that control the outbreak and spread of the disease, respectively. Traditional cholera risk assessment models, namely compartmental susceptible-exposed-infected-recovered (SEIR) type models, have been used to determine the predictive spread of cholera through the fecal–oral route in human populations. However, these models often fail to capture modes of infection via indirect routes, such as pathogen movement in the environment and heterogeneities relevant to disease transmission. Conversely, other models that rely solely on variability of selected environmental factors (i.e., examine only triggers) have accomplished real-time outbreak prediction but fail to capture the transmission of cholera within impacted populations. Since the mode of cholera outbreaks can transition from epidemic to endemic, a comprehensive transmission model is needed to achieve timely and reliable prediction with respect to quantitative environmental risk. Here, we discuss progression of the trigger module associated with both epidemic and endemic cholera, in the context of the autochthonous aquatic nature of the causative agent of cholera, V. cholerae, as well as disease prediction.more » « less
-
Abstract BackgroundBeginning May 7, 2022, multiple nations reported an unprecedented surge in monkeypox cases. Unlike past outbreaks, differences in affected populations, transmission mode, and clinical characteristics have been noted. With the existing uncertainties of the outbreak, real-time short-term forecasting can guide and evaluate the effectiveness of public health measures. MethodsWe obtained publicly available data on confirmed weekly cases of monkeypox at the global level and for seven countries (with the highest burden of disease at the time this study was initiated) from the Our World in Data (OWID) GitHub repository and CDC website. We generated short-term forecasts of new cases of monkeypox across the study areas using an ensemble n-sub-epidemic modeling framework based on weekly cases using 10-week calibration periods. We report and assess the weekly forecasts with quantified uncertainty from the top-ranked, second-ranked, and ensemble sub-epidemic models. Overall, we conducted 324 weekly sequential 4-week ahead forecasts across the models from the week of July 28th, 2022, to the week of October 13th, 2022. ResultsThe last 10 of 12 forecasting periods (starting the week of August 11th, 2022) show either a plateauing or declining trend of monkeypox cases for all models and areas of study. According to our latest 4-week ahead forecast from the top-ranked model, a total of 6232 (95% PI 487.8, 12,468.0) cases could be added globally from the week of 10/20/2022 to the week of 11/10/2022. At the country level, the top-ranked model predicts that the USA will report the highest cumulative number of new cases for the 4-week forecasts (median based on OWID data: 1806 (95% PI 0.0, 5544.5)). The top-ranked and weighted ensemble models outperformed all other models in short-term forecasts. ConclusionsOur top-ranked model consistently predicted a decreasing trend in monkeypox cases on the global and country-specific scale during the last ten sequential forecasting periods. Our findings reflect the potential impact of increased immunity, and behavioral modification among high-risk populations.more » « less