Abstract Global Forecast System (GFS), North American Mesoscale Forecast System (NAM), and High-Resolution Rapid Refresh (HRRR) 2-m temperature, 10-m wind speed, and precipitation accumulation forecasts initialized at 1200 UTC are verified against New York State Mesonet (NYSM) observations from 1 January 2018 through 31 December 2021. NYSM observations at 126 site locations are used to calculate standard error statistics (e.g., forecast error, root-mean-square error) for temperature and wind speed and contingency table statistics for precipitation across forecast hours, meteorological seasons, and regions. The majority of the focus is placed on the first 18 forecast hours to allow for comparison among all three models. A daily NYSM station-mean temperature error analysis identified a slight cold bias at temperatures below 25°C in the GFS, a cool-to-warm bias as forecast temperatures warm in the HRRR, and a warm bias at temperatures above 30°C in each model. Differences arise when considering temperature biases with respect to lead times and seasons. Wind speeds are overforecast at all ranges in each season, and forecast wind speeds ≥ 18 m s−1are rarely observed. Performance diagrams indicate overall good forecast performance at precipitation thresholds of 0.1–1.5 mm, but with a high frequency bias in the GFS and NAM. This paper provides an overview of deterministic forecast performance across New York State, with the aim of sharing common biases associated with temperature, wind speed, and precipitation with operational forecasters and is the first step in developing a real-time model forecast uncertainty prediction tool. 
                        more » 
                        « less   
                    
                            
                            An Evaluation of Surface Wind and Gust Forecasts from the High-Resolution Rapid Refresh Model
                        
                    
    
            Abstract We utilized high temporal resolution, near-surface observations of sustained winds and gusts from two networks, the primarily airport-based Automated Surface Observing System (ASOS) and the New York State Mesonet (NYSM), to evaluate forecasts from the operational High-Resolution Rapid Refresh (HRRR) model, versions 3 and 4. Consistent with past studies, we showed the model has a high degree of skill in reproducing the diurnal variation of network-averaged wind speed of ASOS stations, but also revealed several areas where improvements could be made. Forecasts were found to be underdispersive, deficient in both temporal and spatial variability, with significant errors occurring during local nighttime hours in all regions and in forested environments for all hours of the day. This explained why the model overpredicted the network-averaged wind in the NYSM because much of that network’s stations are in forested areas. A simple gust parameterization was shown not only to have skill in predicting gusts in both networks but also to mitigate systemic biases found in the sustained wind forecasts. Significance Statement Many users depend on forecasts from operational models and need to know their strengths, weaknesses, and limitations. We examined generally high-quality near-surface observations of sustained winds and gusts from the nationwide Automated Surface Observing System (ASOS) and the New York State Mesonet (NYSM) and used them to evaluate forecasts from the previous (version 3) and current (version 4) operational High-Resolution Rapid Refresh (HRRR) model for a selected month. Evidence indicated that the wind forecasts are excellent yet imperfect and areas for further improvement remain. In particular, we showed there is a high degree of skill in representing the diurnal variation of sustained wind at ASOS stations but insufficient spatial and temporal forecast variability and overprediction at night everywhere, in forested areas at all times of day, and at NYSM sites in particular, which are more likely to be sited in the forest. Gusts are subgrid even at the fine grid spacing of the HRRR (3 km) and thus must be parameterized. Our simple gust algorithm corrected for some of these systemic biases, resulting in very good predictions of the maximum hourly gust. 
        more » 
        « less   
        
    
                            - Award ID(s):
- 1921546
- PAR ID:
- 10389149
- Date Published:
- Journal Name:
- Weather and Forecasting
- Volume:
- 37
- Issue:
- 6
- ISSN:
- 0882-8156
- Page Range / eLocation ID:
- 1049 to 1068
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
- 
            
- 
            This study investigates the predictability of downslope windstorms located in Santa Barbara County, California, locally referred to as Sundowner winds, from both observed relationships and a high-resolution, operational numerical weather prediction model. We focus on April 2022, during which the Sundowner Winds Experiment (SWEX) was conducted. We further refine our study area to the Montecito region owing to some of the highest wind measurements occurring at or near surface station MTIC1, situated on the coast-facing slope overlooking the area. Fires are not uncommon in this area, and the difficulty of egress makes the population particularly vulnerable. Area forecasters often use the sea-level pressure difference (ΔSLP) between Santa Barbara Airport (KSBA) and locations to the north such as Bakersfield (KBFL) to predict Sundowner windstorm occurrence. Our analysis indicates that ΔSLP by itself is prone to high false alarm rates and offers little information regarding downslope wind onset, duration, or magnitude. Additionally, our analysis shows that the high-resolution rapid refresh (HRRR) model has limited predictive skill overall for forecasting winds in the Montecito area. The HRRR, however, skillfully predicts KSBA-KBFL ΔSLP, as does GraphCast, a machine learning weather prediction model. Using a logistic regression model we were able to predict the occurrence of winds exceeding 9 m s−1 with a high probability of detection while minimizing false alarm rates compared to other methods analyzed. This provides a refined and easily computed algorithm for operational applications.more » « less
- 
            Abstract Shortly after 0600 UTC (midnight MDT) on 9 June 2020, a rapidly intensifying and elongating convective system produced a macroburst and extensive damage in the town of Akron on Colorado’s eastern Plains. Instantaneous winds were measured as high as 51.12 m s −1 at 2.3 m AGL from an eddy covariance (EC) tower, and a 50.45 m s −1 wind gust from an adjacent 10-m tower became the highest official thunderstorm wind gust ever measured in Colorado. Synoptic-scale storm motion was southerly, but surface winds were northerly in a post-frontal airmass, creating strong vertical wind shear. Extremely high-resolution temporal and spatial observations allow for a unique look at pressure and temperature tendencies accompanying the macroburst and reveal intriguing wave structures in the outflow. At 10-Hz frequency, the EC tower recorded a 5-hPa pressure surge in 19 seconds immediately following the strongest winds, and a 15-hPa pressure drop in the following three minutes. Surface temperature also rose 1.5°C in less than one minute, concurrent with the maximum wind gusts, and then fell sharply by 3.5°C in the following minute. Shifting wind direction observations and an NWS damage survey are suggestive of both radial outflow and a gust front passage, and model proximity soundings reveal a well-mixed surface layer topped by a strong inversion and large low-level vertical wind shear. Despite the greatest risk of severe winds forecast to be northeast of Colorado, convection-allowing model forecasts from 6-18 h in advance did show similar structures to what occurred, warranting further simulations to investigate the unique mesoscale and misoscale features associated with the macroburst.more » « less
- 
            We analyzed meteorological conditions that occurred during the December 2021 Boulder, Colorado, downslope windstorm. This event is of particular interest due to the ignition and spread of the Marshall Fire, which quickly became the most destructive wildfire in Colorado history. Observations indicated a rapid onset of fast winds with gusts as high as 51 m/s that generally remained confined to the east-facing slopes and foothills of the Rockies, similar to previous Boulder windstorms. After about 12 h, the windstorm shifted into a second, less intense phase. Midtropospheric winds above northwestern Colorado weakened prior to the onset of strong surface winds and the event strength started waning as stronger winds moved back into the area. Forecasts from NOAA high-resolution operational models initialized more than a few hours prior to windstorm onset did not simulate the start time, development rate and/or maximum strength of the windstorm correctly, and day-ahead runs even failed to develop strong downslope windstorms at all. Idealized modeling confirmed that predictability was limited by errors on the synoptic scale affecting the midtropospheric wind conditions representing the Boulder windstorm’s inflow environment. Gust forecasts for this event were critically evaluated.more » « less
- 
            Abstract An ensemble postprocessing method is developed for the probabilistic prediction of severe weather (tornadoes, hail, and wind gusts) over the conterminous United States (CONUS). The method combines conditional generative adversarial networks (CGANs), a type of deep generative model, with a convolutional neural network (CNN) to postprocess convection-allowing model (CAM) forecasts. The CGANs are designed to create synthetic ensemble members from deterministic CAM forecasts, and their outputs are processed by the CNN to estimate the probability of severe weather. The method is tested using High-Resolution Rapid Refresh (HRRR) 1–24-h forecasts as inputs and Storm Prediction Center (SPC) severe weather reports as targets. The method produced skillful predictions with up to 20% Brier skill score (BSS) increases compared to other neural-network-based reference methods using a testing dataset of HRRR forecasts in 2021. For the evaluation of uncertainty quantification, the method is overconfident but produces meaningful ensemble spreads that can distinguish good and bad forecasts. The quality of CGAN outputs is also evaluated. Results show that the CGAN outputs behave similarly to a numerical ensemble; they preserved the intervariable correlations and the contribution of influential predictors as in the original HRRR forecasts. This work provides a novel approach to postprocess CAM output using neural networks that can be applied to severe weather prediction. Significance StatementWe use a new machine learning (ML) technique to generate probabilistic forecasts of convective weather hazards, such as tornadoes and hailstorms, with the output from high-resolution numerical weather model forecasts. The new ML system generates an ensemble of synthetic forecast fields from a single forecast, which are then used to train ML models for convective hazard prediction. Using this ML-generated ensemble for training leads to improvements of 10%–20% in severe weather forecast skills compared to using other ML algorithms that use only output from the single forecast. This work is unique in that it explores the use of ML methods for producing synthetic forecasts of convective storm events and using these to train ML systems for high-impact convective weather prediction.more » « less
 An official website of the United States government
An official website of the United States government 
				
			 
					 
					
 
                                    