We describe a new effort to enhance climate forecast relevance and usability through the development of a system for evaluating and displaying real‐time subseasonal to seasonal (S2S) climate forecasts on a watershed scale. Water managers may not use climate forecasts to their full potential due to perceived low skill, mismatched spatial and temporal resolutions, or lack of knowledge or tools to ingest data. Most forecasts are disseminated as large‐domain maps or gridded datasets and may be systematically biased relative to watershed climatologies. Forecasts presented on a watershed scale allow water managers to view forecasts for their specific basins, thereby increasing the usability and relevance of climate forecasts. This paper describes the formulation of S2S climate forecast products based on the Climate Forecast System version 2 (CFSv2) and the North American Multi‐Model Ensemble (NMME). Forecast products include bi‐weekly CFSv2 forecasts, and monthly and seasonal NMME forecasts. Precipitation and temperature forecasts are aggregated spatially to a United States Geological Survey (USGS) hydrologic unit code 4 (HUC‐4) watershed scale. Forecast verification reveals appreciable skill in the first two bi‐weekly periods (Weeks 1–2 and 2–3) from CFSv2, and usable skill in NMME Month 1 forecast with varying skills at longer lead times dependent on the season. Application of a bias‐correction technique (quantile mapping) eliminates forecast bias in the CFSv2 reforecasts, without adding significantly to correlation skill.
Precipitation forecasts, particularly at subseasonal-to-seasonal (S2S) time scale, are essential for informed and proactive water resource management. Although S2S precipitation forecasts have been evaluated, no systematic decomposition of the skill, Nash–Sutcliffe efficiency (NSE) coefficient, has been analyzed toward understanding the forecast accuracy. We decompose the NSE of S2S precipitation forecast into its three components—correlation, conditional bias, and unconditional bias—by four seasons, three lead times (1–12, 1–22, and 1–32 days), and three models, European Centre of Medium-Range Weather Forecasts (ECMWF), National Centers for Environmental Prediction’s (NCEP) Climate Forecast System (CFS) model, and Environment and Climate Change Canada (ECCC), over the conterminous United States (CONUS). Application of a dry threshold, removal of grid cells with seasonal climatological precipitation means below 0.01 in. per day, is important as the NSE and correlations are lower across all seasons after masking areas with low precipitation values. Further, a west-to-east gradient in S2S forecast skill exists, and forecast skill was better during the winter months and for areas closer to the coast. Overall, ECMWF’s model performance was stronger than both ECCC and NCEP CFS’s performance, mainly for the forecasts issued during the fall and winter months. However, ECCC and NCEP CFS performed better for the forecast issued during the spring months and for areas further from the coast. Postprocessing using simple model output statistics could reduce both unconditional and conditional biases to zero, thereby offering better skill for regimes with high correlation. Our decomposition results show that efforts should focus on improving model parameterization and initialization schemes for climate regimes with low correlation.
more » « less- PAR ID:
- 10508577
- Publisher / Repository:
- American Meteorological Society
- Date Published:
- Journal Name:
- Journal of Hydrometeorology
- Volume:
- 25
- Issue:
- 5
- ISSN:
- 1525-755X
- Format(s):
- Medium: X Size: p. 755-770
- Size(s):
- p. 755-770
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
Abstract -
more » « less
Abstract Uncertainty attribution in water supply forecasting is crucial to improve forecast skill and increase confidence in seasonal water management planning. We develop a framework to quantify fractional forecast uncertainty and partition it between (1) snowpack quantification methods, (2) variability in post‐forecast precipitation, and (3) runoff model errors. We demonstrate the uncertainty framework with statistical runoff models in the upper Tuolumne and Merced River basins (California, USA) using snow observations at two endmember spatial resolutions: a simple snow pillow index and full‐catchment snow water equivalent (SWE) maps at 50 m resolution from the Airborne Snow Observatories. Bayesian forecast simulations demonstrate a nonlinear decrease in the skill of statistical water supply forecasts during warm snow droughts, when a low fraction of winter precipitation remains as SWE. Forecast skill similarly decreases during dry snow droughts, when winter precipitation is low. During a shift away from snow‐dominance, the uncertainty of forecasts using snow pillow data increases about 1.9 times faster than analogous forecasts using full‐catchment SWE maps in the study area. Replacing the snow pillow index with full‐catchment SWE data reduces statistical forecast uncertainty by 39% on average across all tested climate conditions. Attributing water supply forecast uncertainty to reducible error sources reveals opportunities to improve forecast reliability in a warmer future climate.
-
Forecasts of heavy precipitation delivered by atmospheric rivers (ARs) are becoming increasingly important for both flood control and water supply management in reservoirs across California. This study examines the hypothesis that medium-range forecasts of heavy precipitation at the basin scale exhibit recurrent spatial biases that are driven by mesoscale and synoptic-scale features of associated AR events. This hypothesis is tested for heavy precipitation events in the Sacramento River basin using 36 years of NCEP medium-range reforecasts from 1984 to 2019. For each event we cluster precipitation forecast error across western North America for lead times ranging from 1 to 15 days. Integrated vapor transport (IVT), 500-hPa geopotential heights, and landfall characteristics of ARs are composited across clusters and lead times to diagnose the causes of precipitation forecast biases. We investigate the temporal evolution of forecast error to characterize its persistence across lead times, and explore the accuracy of forecasted IVT anomalies across different domains of the North American west coast during heavy precipitation events in the Sacramento basin. Our results identify recurrent spatial patterns of precipitation forecast error consistent with errors of forecasted synoptic-scale features, especially at long (5–15 days) leads. Moreover, we find evidence that forecasts of AR landfalls well outside of the latitudinal bounds of the Sacramento basin precede heavy precipitation events within the basin. These results suggest the potential for using medium-range forecasts of large-scale climate features across the Pacific–North American sector, rather than just local forecasts of basin-scale precipitation, when designing forecast-informed reservoir operations.more » « less
-
more » « less
Abstract Extreme precipitation over a two-week period can cause significant impacts to life and property. Trustworthy and easy-to-understand forecasts of these extreme periods on the subseasonal-to-seasonal timeframe may provide additional time for planning. The Prediction of Rainfall Extremes at Subseasonal to Seasonal Periods (PRES2iP) project team conducted three workshops over six years to engage with stakeholders to learn what is needed for decision-making for subseasonal precipitation. In this study experimental subseasonal to seasonal (S2S) forecast products were designed, using knowledge gained from previous stakeholder workshops, and shown to decision-makers to evaluate the products for two 14-day extreme precipitation period scenarios. Our stakeholders preferred a combination of products that covered the spatial extent, regional daily values, with associated uncertainty, and text narratives with anticipated impacts for planning within the S2S timeframe. When targeting longer extremes, having information regarding timing of expected impacts was seen as crucial for planning. We found that there is increased uncertainty tolerance with stakeholders when using products at longer lead times that typical skill metrics, such as critical success index or anomaly correlation coefficient, do not capture. Therefore, the use of object-oriented verification, that allows for more flexibility in spatial uncertainty, might be beneficial for evaluating S2S forecasts. These results help to create a foundation for design, verification, and implementation of future operational forecast products with longer lead times, while also providing an example for future workshops that engage both researchers and decision-makers.
-
Abstract Background West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases). Graphical Abstractmore » « less
