skip to main content


Title: Exploratory Precipitation Metrics: Spatiotemporal Characteristics, Process-Oriented, and Phenomena-Based
Abstract

Precipitation sustains life and supports human activities, making its prediction one of the most societally relevant challenges in weather and climate modeling. Limitations in modeling precipitation underscore the need for diagnostics and metrics to evaluate precipitation in simulations and predictions. While routine use of basic metrics is important for documenting model skill, more sophisticated diagnostics and metrics aimed at connecting model biases to their sources and revealing precipitation characteristics relevant to how model precipitation is used are critical for improving models and their uses. This paper illustrates examples of exploratory diagnostics and metrics including 1) spatiotemporal characteristics metrics such as diurnal variability, probability of extremes, duration of dry spells, spectral characteristics, and spatiotemporal coherence of precipitation; 2) process-oriented metrics based on the rainfall–moisture coupling and temperature–water vapor environments of precipitation; and 3) phenomena-based metrics focusing on precipitation associated with weather phenomena including low pressure systems, mesoscale convective systems, frontal systems, and atmospheric rivers. Together, these diagnostics and metrics delineate the multifaceted and multiscale nature of precipitation, its relations with the environments, and its generation mechanisms. The metrics are applied to historical simulations from phases 5 and 6 of the Coupled Model Intercomparison Project. Models exhibit diverse skill as measured by the suite of metrics, with very few models consistently ranked as top or bottom performers compared to other models in multiple metrics. Analysis of model skill across metrics and models suggests possible relationships among subsets of metrics, motivating the need for more systematic analysis to understand model biases for informing model development.

 
more » « less
Award ID(s):
1936810
NSF-PAR ID:
10393329
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  
Publisher / Repository:
American Meteorological Society
Date Published:
Journal Name:
Journal of Climate
Volume:
35
Issue:
12
ISSN:
0894-8755
Format(s):
Medium: X Size: p. 3659-3686
Size(s):
["p. 3659-3686"]
Sponsoring Org:
National Science Foundation
More Like this
  1. The combination of precipitation formation and fallout affects atmospheric flows through the release of latent heat and through the removal of mass from the atmosphere, but because the mass of water vapor is only a small fraction of the total mass of Earth's atmosphere, precipitation mass sinks are often neglected in theory and models. However, a small number of modeling studies suggest that water mass sources and sinks can intensify heavily precipitating weather systems. These studies point to a need to more systematically verify the impact of neglecting precipitation mass sinks, particularly for warmer and moister climates in which precipitation rates can be much higher. In this paper, we add precipitation mass sources and sinks to an idealized general circulation model and examine their effects on steady-state midlatitude storm track statistics. The model has several idealizations, including that all condensates immediately fall out of the atmosphere, and is run across a wide range of climates, including very warm climates. We find that modifying the model to include mass sources and sinks has no detectable effect on midlatitude variability or extremes, even in climates much warmer and moister than the modern. However, we find that a 10-fold exaggeration of mass sources and sinks is sufficient to produce more intense midlatitude weather extremes and increase surface pressure variance. This result is consistent with theoretical potential vorticity analysis, which suggests that the dynamical effects of mass sources and sinks are much smaller than the dynamical effects of accompanying latent heating unless mass sinks are artificially amplified by at least a factor of 10. Finally, we use simulations of “tropical cyclone worlds” to attempt to reconcile our results with earlier work showing stronger deepening in a simulation of a tropical cyclone case study when precipitation mass sinks were included. We demonstrate that abruptly “turning on” mass sources and sinks can lead to stronger transient deepening in some individual storms (consistent with results of past work) but weaker transient deepening in other storms, without modifying the steady-state statistics of storms in equilibrium with the large-scale environment (consistent with our other results). Our results provide a firmer foundation for using general circulation models that neglect moist mass sources and sinks in climate simulations, even in climates much warmer than today, while leaving open the possibility that their inclusion might lead to short-term improvements in forecast skill. 
    more » « less
  2. Abstract

    Mesoscale convective systems (MCSs) are the main source of precipitation in the tropics and parts of the mid‐latitudes and are responsible for high‐impact weather worldwide. Studies showed that deficiencies in simulating mid‐latitude MCSs in state‐of‐the‐art climate models can be alleviated by kilometer‐scale models. However, whether these models can also improve tropical MCSs and whether we can find model settings that perform well in both regions is understudied. We take advantage of high‐quality MCS observations collected over the Atmospheric Radiation Measurement (ARM) facilities in the US Southern Great Plains (SGP) and the Amazon basin near Manaus (MAO) to evaluate a perturbed physics ensemble of simulated MCSs with 4 km horizontal grid spacing. A new model evaluation method is developed that enables to distinguish biases stemming from spatiotemporal displacements of MCSs from biases in their reflectivity and cloud shield. Amazon MCSs are similarly well simulated across these evaluation metrics than SGP MCSs despite the challenges anticipated from weaker large‐scale forcing in the tropics. Generally, SGP MCSs are more sensitive to the choice of model microphysics, while Amazon cases are more sensitive to the planetary boundary layer (PBL) scheme. Although our tested model physics combinations had strengths and weaknesses, combinations that performed well for SGP simulations result in worse results in the Amazon basin and vice versa. However, we identified model settings that perform well at both locations, which include the Thompson and Morrison microphysics coupled with the Yonsei University (YSU) PBL scheme and the Thompson scheme coupled with the Mellor‐Yamada‐Janjic PBL scheme.

     
    more » « less
  3. null (Ed.)
    Abstract The Great Plains (GP) southerly nocturnal low-level jet (GPLLJ) is a dominant contributor to the region’s warm-season (May–September) mean and extreme precipitation, wind energy generation, and severe weather outbreaks—including mesoscale convective systems. The spatiotemporal structure, variability, and impact of individual GPLLJ events are closely related to their degree of upper-level synoptic coupling, which varies from strong coupling in synoptic trough–ridge environments to weak coupling in quiescent, synoptic ridge environments. Here, we apply an objective dynamic classification of GPLLJ upper-level coupling and fully characterize strongly coupled (C) and relatively uncoupled (UC) GPLLJs from the perspective of the ground-based observer. Through composite analyses of C and UC GPLLJ event samples taken from the European Centre for Medium-Range Weather Forecasts’ Coupled Earth Reanalysis of the twentieth century (CERA-20C), we address how the frequency of these jet types, as well as their inherent weather- and climate-relevant characteristics—including wind speed, direction, and shear; atmospheric stability; and precipitation—vary on diurnal and monthly time scales across the southern, central, and northern subregions of the GP. It is shown that C and UC GPLLJ events have similar diurnal phasing, but the diurnal amplitude is much greater for UC GPLLJs. C GPLLJs tend to have a faster and more elevated jet nose, less low-level wind shear, and enhanced CAPE and precipitation. UC GPLLJs undergo a larger inertial oscillation (Blackadar mechanism) for all subregions, and C GPLLJs have greater geostrophic forcing (Holton mechanism) in the southern and northern GP. The results underscore the need to differentiate between C and UC GPLLJs in future seasonal forecast and climate prediction activities. 
    more » « less
  4. We propose a set of MJO teleconnection diagnostics that enables an objective evaluation of model simulations, a fair model-to-model comparison, and a consistent tracking of model improvement. Various skill metrics are derived from teleconnection diagnostics including five performance-based metrics that characterize the pattern, amplitude, east–west position, persistence, and consistency of MJO teleconnections and additional two process-oriented metrics that are designed to characterize the location and intensity of the anomalous Rossby wave source (RWS). The proposed teleconnection skill metrics are used to compare the characteristics of boreal winter MJO teleconnections (500-hPa geopotential height anomaly) over the Pacific–North America (PNA) region in 29 global climate models (GCMs). The results show that current GCMs generally produce MJO teleconnections that are stronger, more persistent, and extend too far to the east when compared to those observed in reanalysis. In general, models simulate more realistic teleconnection patterns when the MJO is in phases 2–3 or phases 7–8, which are characterized by a dipole convection pattern over the Indian Ocean and western to central Pacific. The higher model skill for phases 2, 7, and 8 may be due to these phases producing more consistent teleconnection patterns between individual MJO events than other phases, although the consistency is lower in most models than observed. Models that simulate realistic RWS patterns better reproduce MJO teleconnection patterns. 
    more » « less
  5. Abstract

    The modeling of weather and climate has been a success story. The skill of forecasts continues to improve and model biases continue to decrease. Combining the output of multiple models has further improved forecast skill and reduced biases. But are we exploiting the full capacity of state-of-the-art models in making forecasts and projections? Supermodeling is a recent step forward in the multimodel ensemble approach. Instead of combining model output after the simulations are completed, in a supermodel individual models exchange state information as they run, influencing each other’s behavior. By learning the optimal parameters that determine how models influence each other based on past observations, model errors are reduced at an early stage before they propagate into larger scales and affect other regions and variables. The models synchronize on a common solution that through learning remains closer to the observed evolution. Effectively a new dynamical system has been created, a supermodel, that optimally combines the strengths of the constituent models. The supermodel approach has the potential to rapidly improve current state-of-the-art weather forecasts and climate predictions. In this paper we introduce supermodeling, demonstrate its potential in examples of various complexity, and discuss learning strategies. We conclude with a discussion of remaining challenges for a successful application of supermodeling in the context of state-of-the-art models. The supermodeling approach is not limited to the modeling of weather and climate, but can be applied to improve the prediction capabilities of any complex system, for which a set of different models exists.

     
    more » « less