skip to main content

Title: Verification and Model Configuration Sensitivity of Simulated ABI Radiance Forecasts With the FV3‐LAM Model

This study evaluates simulated radiance forecasts from a series of controlled experiments consisting of FV3‐LAM forecasts with different configurations of model physics and vertical resolution. The forecasts were produced during the 2020 Hazardous Weather Testbed Spring Forecasting Experiments on the same forecast cases. The evaluation includes grid‐point, neighborhood‐based and object‐based verification. The experiments include forecasts that were identical except for the physics (EMC‐LAM vs. EMC‐LAMx), vertical resolution (EMC‐LAMx vs. NSSL‐LAM), or combined initial conditions, physics and vertical resolution (GSL‐LAM). It is found that the EMC‐LAM generally provided better simulated radiance forecasts than the other three configurations at most forecast lead times, due to its unique physics configuration. All configurations generally over‐forecasted high level clouds. EMC‐LAM reduced the over‐forecasting of high clouds, but also under‐forecasted the coverage of mid‐level clouds. In contrast, at early lead times the EMC‐LAM had relatively poor performance relative to the other forecasts. Furthermore, EMC‐LAM was an outlier in terms of the vertical structure of clouds. It is also found that the NSSL‐LAM consistently improved upon the EMC‐LAMx, which had fewer vertical levels than NSSL‐LAM. Compared to EMC‐LAMx, NSSL‐LAM had less cloud over‐forecasting bias, especially with small cloud objects, and less overall error. The differences between EMC‐LAMx and GSL‐LAM were generally much smaller than the differences between EMC‐LAMx and EMC‐LAM/NSSL‐LAM. Finally, it is found that a non‐linear bias correction conditioned on symmetric brightness temperature reduced the overall root‐mean‐square error by about a factor of 2 while improving the unrealistic vertical structure of clouds in the EMC‐LAM.

more » « less
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  ;  ;  
Publisher / Repository:
DOI PREFIX: 10.1029
Date Published:
Journal Name:
Earth and Space Science
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Sierras de Córdoba (Argentina) is characterized by the occurrence of extreme precipitation events during the austral warm season. Heavy precipitation in the region has a large societal impact, causing flash floods. This motivates the forecast performance evaluation of 24-h accumulated precipitation and vertical profiles of atmospheric variables from different numerical weather prediction (NWP) models with the final aim of helping water management in the region. The NWP models evaluated include the Global Forecast System (GFS), which parameterizes convection, and convection-permitting simulations of the Weather Research and Forecasting (WRF) Model configured by three institutions: University of Illinois at Urbana–Champaign (UIUC), Colorado State University (CSU), and National Meteorological Service of Argentina (SMN). These models were verified with daily accumulated precipitation data from rain gauges and soundings during the RELAMPAGO-CACTI field campaign. Generally all configurations of the higher-resolution WRFs outperformed the lower-resolution GFS based on multiple metrics. Among the convection-permitting WRF Models, results varied with respect to rainfall threshold and forecast lead time, but the WRFUIUC mostly performed the best. However, elevation-dependent biases existed among the models that may impact the use of the data for different applications. There is a dry (moist) bias in lower (upper) pressure levels which is most pronounced in the GFS. For Córdoba an overestimation of the northern flow forecasted by the NWP configurations at lower levels was encountered. These results show the importance of convection-permitting forecasts in this region, which should be complementary to the coarser-resolution global model forecasts to help various users and decision-makers. 
    more » « less
  2. Abstract Because geostationary satellite (Geo) imagery provides a high temporal resolution window into tropical cyclone (TC) behavior, we investigate the viability of its application to short-term probabilistic forecasts of TC convective structure to subsequently predict TC intensity. Here, we present a prototype model that is trained solely on two inputs: Geo infrared imagery leading up to the synoptic time of interest and intensity estimates up to 6 h prior to that time. To estimate future TC structure, we compute cloud-top temperature radial profiles from infrared imagery and then simulate the evolution of an ensemble of those profiles over the subsequent 12 h by applying a deep autoregressive generative model (PixelSNAIL). To forecast TC intensities at hours 6 and 12, we input operational intensity estimates up to the current time (0 h) and simulated future radial profiles up to +12 h into a “nowcasting” convolutional neural network. We limit our inputs to demonstrate the viability of our approach and to enable quantification of value added by the observed and simulated future radial profiles beyond operational intensity estimates alone. Our prototype model achieves a marginally higher error than the National Hurricane Center’s official forecasts despite excluding environmental factors, such as vertical wind shear and sea surface temperature. We also demonstrate that it is possible to reasonably predict short-term evolution of TC convective structure via radial profiles from Geo infrared imagery, resulting in interpretable structural forecasts that may be valuable for TC operational guidance. Significance Statement This work presents a new method of short-term probabilistic forecasting for tropical cyclone (TC) convective structure and intensity using infrared geostationary satellite observations. Our prototype model’s performance indicates that there is some value in observed and simulated future cloud-top temperature radial profiles for short-term intensity forecasting. The nonlinear nature of machine learning tools can pose an interpretation challenge, but structural forecasts produced by our model can be directly evaluated and, thus, may offer helpful guidance to forecasters regarding short-term TC evolution. Since forecasters are time limited in producing each advisory package despite a growing wealth of satellite observations, a tool that captures recent TC convective evolution and potential future changes may support their assessment of TC behavior in crafting their forecasts. 
    more » « less
  3. Abstract

    Ecosystems around the globe are experiencing changes in both the magnitude and fluctuations of environmental conditions due to land use and climate change. In response, ecologists are increasingly using near‐term, iterative ecological forecasts to predict how ecosystems will change in the future. To date, many near‐term, iterative forecasting systems have been developed using high temporal frequency (minute to hourly resolution) data streams for assimilation. However, this approach may be cost‐prohibitive or impossible for forecasting ecological variables that lack high‐frequency sensors or have high data latency (i.e., a delay before data are available for modeling after collection). To explore the effects of data assimilation frequency on forecast skill, we developed water temperature forecasts for a eutrophic drinking water reservoir and conducted data assimilation experiments by selectively withholding observations to examine the effect of data availability on forecast accuracy. We used in situ sensors, manually collected data, and a calibrated water quality ecosystem model driven by forecasted weather data to generate future water temperature forecasts using Forecasting Lake and Reservoir Ecosystems (FLARE), an open source water quality forecasting system. We tested the effect of daily, weekly, fortnightly, and monthly data assimilation on the skill of 1‐ to 35‐day‐ahead water temperature forecasts. We found that forecast skill varied depending on the season, forecast horizon, depth, and data assimilation frequency, but overall forecast performance was high, with a mean 1‐day‐ahead forecast root mean square error (RMSE) of 0.81°C, mean 7‐day RMSE of 1.15°C, and mean 35‐day RMSE of 1.94°C. Aggregated across the year, daily data assimilation yielded the most skillful forecasts at 1‐ to 7‐day‐ahead horizons, but weekly data assimilation resulted in the most skillful forecasts at 8‐ to 35‐day‐ahead horizons. Within a year, forecasts with weekly data assimilation consistently outperformed forecasts with daily data assimilation after the 8‐day forecast horizon during mixed spring/autumn periods and 5‐ to 14‐day‐ahead horizons during the summer‐stratified period, depending on depth. Our results suggest that lower frequency data (i.e., weekly) may be adequate for developing accurate forecasts in some applications, further enabling the development of forecasts broadly across ecosystems and ecological variables without high‐frequency sensor data.

    more » « less
  4. Abstract. Polar regions are characterized by their remoteness, making measurements challenging, but an improved knowledge of clouds and radiation is necessary to understand polar climate change. Infrared radiance spectrometers can operate continuously from the surface and have low power requirements relative to active sensors. Here we explore the feasibility of retrieving cloud height with an infrared spectrometer that would be designed for use in remote polar locations. Using a wide variety of simulated spectra of mixed-phase polar clouds at varying instrument resolutions, retrieval accuracy is explored using the CO2 slicing/sorting and the minimum local emissivity variance (MLEV) methods. In the absence of imposed errors and for clouds with optical depths greater than  ∼ 0.3, cloud-height retrievals from simulated spectra using CO2 slicing/sorting and MLEV are found to have roughly equivalent high accuracies: at an instrument resolution of 0.5cm−1, mean biases are found to be  ∼ 0.2km for clouds with bases below 2 and −0.2km for higher clouds. Accuracy is found to decrease with coarsening resolution and become worse overall for MLEV than for CO2 slicing/sorting; however, the two methods have differing sensitivity to different sources of error, suggesting an approach that combines them. For expected errors in the atmospheric state as well as both instrument noise and bias of 0.2mW/(m2srcm−1), at a resolution of 4cm−1, average retrieval errors are found to be less than  ∼ 0.5km for cloud bases within 1km of the surface, increasing to  ∼ 1.5km at 4km. This sensitivity indicates that a portable, surface-based infrared radiance spectrometer could provide an important complement in remote locations to satellite-based measurements, for which retrievals of low-level cloud are challenging.

    more » « less
  5. Abstract

    Water temperature forecasting in lakes and reservoirs is a valuable tool to manage crucial freshwater resources in a changing and more variable climate, but previous efforts have yet to identify an optimal modeling approach. Here, we demonstrate the first multi‐model ensemble (MME) reservoir water temperature forecast, a forecasting method that combines individual model strengths in a single forecasting framework. We developed two MMEs: a three‐model process‐based MME and a five‐model MME that includes process‐based and empirical models to forecast water temperature profiles at a temperate drinking water reservoir. We found that the five‐model MME improved forecast performance by 8%–30% relative to individual models and the process‐based MME, as quantified using an aggregated probabilistic skill score. This increase in performance was due to large improvements in forecast bias in the five‐model MME, despite increases in forecast uncertainty. High correlation among the process‐based models resulted in little improvement in forecast performance in the process‐based MME relative to the individual process‐based models. The utility of MMEs is highlighted by two results: (a) no individual model performed best at every depth and horizon (days in the future), and (b) MMEs avoided poor performances by rarely producing the worst forecast for any single forecasted period (<6% of the worst ranked forecasts over time). This work presents an example of how existing models can be combined to improve water temperature forecasting in lakes and reservoirs and discusses the value of utilizing MMEs, rather than individual models, in operational forecasts.

    more » « less