Abstract Obtaining a faithful probabilistic depiction of moist convection is complicated by unknown errors in subgrid-scale physical parameterization schemes, invalid assumptions made by data assimilation (DA) techniques, and high system dimensionality. As an initial step toward untangling sources of uncertainty in convective weather regimes, we evaluate a novel Bayesian data assimilation methodology based on particle filtering within a WRF ensemble analysis and forecasting system. Unlike most geophysical DA methods, the particle filter (PF) represents prior and posterior error distributions nonparametrically rather than assuming a Gaussian distribution and can accept any type of likelihood function. This approach is known to reduce bias introduced by Gaussian approximations in low-dimensional and idealized contexts. The form of PF used in this research adopts a dimension-reduction strategy, making it affordable for typical weather applications. The present study examines posterior ensemble members and forecasts for select severe weather events between 2019 and 2020, comparing results from the PF with those from an ensemble Kalman filter (EnKF). We find that assimilating with a PF produces posterior quantities for microphysical variables that are more consistent with model climatology than comparable quantities from an EnKF, which we attribute to a reduction in DA bias. These differences are significant enough to impact the dynamic evolution of convective systems via cold pool strength and propagation, with impacts to forecast verification scores depending on the particular microphysics scheme. Our findings have broad implications for future approaches to the selection of physical parameterization schemes and parameter estimation within preexisting data assimilation frameworks. Significance StatementThe accurate prediction of severe storms using numerical weather models depends on effective parameterization schemes for small-scale processes and the assimilation of incomplete observational data in a manner that faithfully represents the probabilistic state of the atmosphere. Current generation methods for data assimilation typically assume a standard form for the error distributions of relevant quantities, which can introduce bias that not only hinders numerical prediction, but that can also confound the characterization of errors from the model itself. The current study performs data assimilation using a novel method that does not make such assumptions and explores characteristics of resulting model fields and forecasts that might make such a method useful for improving model parameterization schemes.
more »
« less
This content will become publicly available on December 1, 2025
Optimizing Numerical Weather Prediction Utility of the Maryland Mesonet with Observing System Simulation Experiments
Abstract The Maryland Mesonet project will construct a network of 75 surface observing stations with aims that include mitigating the statewide impact of severe convective storms and improving analyses of records. The spatial configuration of mesonet stations is expected to affect the utility newly provided observations will have via data assimilation, making it desirable to study the effects of mesonet configuration. Furthermore, the impact associated with any observing system configuration is constrained by errors inherent to the prediction systems used to generate forecasts, which may change with future advances in data assimilation methodology, physical parameterization schemes, and resource availability. To address such possibilities, we perform sets of observing system simulation experiments using a high-resolution regional modeling system to assess the expected impact of four candidate mesonet configurations. Experiments cover seven 18-h case study events featuring moist convective regimes associated with severe weather over the state of Maryland and are performed using two versions of our experimental modeling system: a “standard-uncertainty” configuration tuned to be representative of existing convective-allowing prediction systems and a “constrained-uncertainty” configuration with reduced boundary condition and model error that reflects a possible trajectory for future prediction systems. We find that the assimilation of mesonet data produces definitive improvements to analysis fields below 1000 m that are mediated by modeling system uncertainty. Conversely, mesonet impact on forecast verification is inconclusive and strongly variable across verification metrics. The impact of mesonet configuration appears limited by a saturation effect that caps local analysis improvements past a minimal density of observing stations. Significance StatementThe Maryland Mesonet project will construct 75 surface observing stations to improve the analysis of records for Maryland’s surface weather conditions as well as predictions for severe weather events. The spatial placement of sensors is expected to influence the utility of a mesonet, making it desirable to optimize mesonet layouts. The utility provided by a mesonet may also be impacted by errors in prediction systems used to generate analyses and forecasts, which are themselves subject to change given future advances in prediction methods and resources. This study uses observing system simulation experiments (OSSEs)—which comprehensively simulate numerical weather prediction for a known “truth state” —to characterize improvement we may expect from mesonet observations and evaluate four potential mesonet configurations.
more »
« less
- Award ID(s):
- 1848363
- PAR ID:
- 10618707
- Publisher / Repository:
- American Meteorological Society
- Date Published:
- Journal Name:
- Weather and Forecasting
- Volume:
- 39
- Issue:
- 12
- ISSN:
- 0882-8156
- Page Range / eLocation ID:
- 1849 to 1867
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract An ensemble postprocessing method is developed for the probabilistic prediction of severe weather (tornadoes, hail, and wind gusts) over the conterminous United States (CONUS). The method combines conditional generative adversarial networks (CGANs), a type of deep generative model, with a convolutional neural network (CNN) to postprocess convection-allowing model (CAM) forecasts. The CGANs are designed to create synthetic ensemble members from deterministic CAM forecasts, and their outputs are processed by the CNN to estimate the probability of severe weather. The method is tested using High-Resolution Rapid Refresh (HRRR) 1–24-h forecasts as inputs and Storm Prediction Center (SPC) severe weather reports as targets. The method produced skillful predictions with up to 20% Brier skill score (BSS) increases compared to other neural-network-based reference methods using a testing dataset of HRRR forecasts in 2021. For the evaluation of uncertainty quantification, the method is overconfident but produces meaningful ensemble spreads that can distinguish good and bad forecasts. The quality of CGAN outputs is also evaluated. Results show that the CGAN outputs behave similarly to a numerical ensemble; they preserved the intervariable correlations and the contribution of influential predictors as in the original HRRR forecasts. This work provides a novel approach to postprocess CAM output using neural networks that can be applied to severe weather prediction. Significance StatementWe use a new machine learning (ML) technique to generate probabilistic forecasts of convective weather hazards, such as tornadoes and hailstorms, with the output from high-resolution numerical weather model forecasts. The new ML system generates an ensemble of synthetic forecast fields from a single forecast, which are then used to train ML models for convective hazard prediction. Using this ML-generated ensemble for training leads to improvements of 10%–20% in severe weather forecast skills compared to using other ML algorithms that use only output from the single forecast. This work is unique in that it explores the use of ML methods for producing synthetic forecasts of convective storm events and using these to train ML systems for high-impact convective weather prediction.more » « less
-
Abstract The assimilation of radar reflectivity requires an accurate and efficient forward operator that links the model state variables to radar observations. In this study, newly developed parameterized forward operators (PFO) for radar reflectivity with a new continuous melting model are implemented to assimilate observed radar data. To assess the impact of the novel parameterized reflectivity forward operators on convective storm analysis and forecasting, two distinct sets of cycled assimilation and forecast experiments are conducted. One set of experiments (ExpRFO) uses a conventional Rayleigh‐scattering‐approximation‐based forward operator (RFO) with hydrometeor classification, while the other uses the PFO (ExpPFO_New) for radar reflectivity with a new continuous melting model. Eight high‐impact severe convective weather events from the Hazardous Weather Testbed (HWT) 2019 Spring Experiments are selected for this study. The analysis and forecast results are first examined in detail for a classic tornadic supercell case on 24 May 2019, with the potential benefits provided by the PFO then evaluated for all eight cases. It is demonstrated that ExpPFO_New provides more robust results in terms of improving the short‐term severe weather forecasts. Compared to ExpRFO, ExpPFO_New better reproduces all observed supercells in the analysis field, yields a more continuous and reasonable reflectivity distribution near the melting layer, and improves the strength of the cold pool compared to observations. Overall, ExpPFO_New, initialized from the more accurate analysis fields, produces better forecasts of reflectivity and hourly precipitation with smaller biases, especially at heavy precipitation thresholds.more » « less
-
Accurate specification of hurricane inner-core structure is critical to predicting the evolution of a hurricane. However, observations over hurricane inner cores are generally lacking. Previous studies have emphasized Tail Doppler radar (TDR) data assimilation to improve hurricane inner-core representation. Recently, Doppler wind lidar (DWL) has been used as an observing system to sample hurricane inner-core and environmental conditions. The NOAA P3 Hurricane Hunter aircraft has DWL installed and can obtain wind data over a hurricane’s inner core when the aircraft passes through the hurricane. In this study, we examine the impact of assimilating DWL winds and TDR radial winds on the prediction of Hurricane Earl (2016) with the NCEP operational Hurricane Weather Research and Forecasting (HWRF) system. A series of data assimilation experiments are conducted with the Gridpoint Statistical Interpolation (GSI)-based ensemble-3DVAR hybrid system to identify the best way to assimilate TDR and DWL data into the HWRF forecast system. The results show a positive impact of DWL data on hurricane analysis and prediction. Compared with the assimilation of u and v components, assimilation of DWL wind speed provides better hurricane track and intensity forecasts. Proper choices of data thinning distances (e.g., 5 km horizontal thinning and 70 hPa vertical thinning for DWL) can help achieve better analysis in terms of hurricane vortex representation and forecasts. In the analysis and forecast cycles, the combined TDR and DWL assimilation (DWL wind speed and TDR radial wind, along with other conventional data, e.g., NCEP Automated Data Processing (ADP) data) offsets the downgrade analysis from the absence of DWL observations in an analysis cycle and outperforms assimilation of a single type of data (either TDR or DWL) and leads to improved forecasts of hurricane track, intensity, and structure. Overall, assimilation of DWL observations has been beneficial for analysis and forecasts in most cases. The outcomes from this study demonstrate the great potential of including DWL wind profiles in the operational HWRF system for hurricane forecast improvement.more » « less
-
Abstract We utilized high temporal resolution, near-surface observations of sustained winds and gusts from two networks, the primarily airport-based Automated Surface Observing System (ASOS) and the New York State Mesonet (NYSM), to evaluate forecasts from the operational High-Resolution Rapid Refresh (HRRR) model, versions 3 and 4. Consistent with past studies, we showed the model has a high degree of skill in reproducing the diurnal variation of network-averaged wind speed of ASOS stations, but also revealed several areas where improvements could be made. Forecasts were found to be underdispersive, deficient in both temporal and spatial variability, with significant errors occurring during local nighttime hours in all regions and in forested environments for all hours of the day. This explained why the model overpredicted the network-averaged wind in the NYSM because much of that network’s stations are in forested areas. A simple gust parameterization was shown not only to have skill in predicting gusts in both networks but also to mitigate systemic biases found in the sustained wind forecasts. Significance Statement Many users depend on forecasts from operational models and need to know their strengths, weaknesses, and limitations. We examined generally high-quality near-surface observations of sustained winds and gusts from the nationwide Automated Surface Observing System (ASOS) and the New York State Mesonet (NYSM) and used them to evaluate forecasts from the previous (version 3) and current (version 4) operational High-Resolution Rapid Refresh (HRRR) model for a selected month. Evidence indicated that the wind forecasts are excellent yet imperfect and areas for further improvement remain. In particular, we showed there is a high degree of skill in representing the diurnal variation of sustained wind at ASOS stations but insufficient spatial and temporal forecast variability and overprediction at night everywhere, in forested areas at all times of day, and at NYSM sites in particular, which are more likely to be sited in the forest. Gusts are subgrid even at the fine grid spacing of the HRRR (3 km) and thus must be parameterized. Our simple gust algorithm corrected for some of these systemic biases, resulting in very good predictions of the maximum hourly gust.more » « less
An official website of the United States government
