An official website of the United States government
Abstract A set of diagnostics based on simple, statistical relationships between precipitation and the thermodynamic environment in observations is implemented to assess phase 6 of the Coupled Model Intercomparison Project (CMIP6) model behavior with respect to precipitation. Observational data from the Atmospheric Radiation Measurement (ARM) permanent field observational sites are augmented with satellite observations of precipitation and temperature as an observational baseline. A robust relationship across observational datasets between column water vapor (CWV) and precipitation, in which conditionally averaged precipitation exhibits a sharp pickup at some critical CWV value, provides a useful convective onset diagnostic for climate model comparison. While a few models reproduce an appropriate precipitation pickup, most models begin their pickup at too low CWV and the increase in precipitation with increasing CWV is too weak. Convective transition statistics compiled in column relative humidity (CRH) partially compensate for model temperature biases—although imperfectly since the temperature dependence is more complex than that of column saturation. Significant errors remain in individual models and weak pickups are generally not improved. The conditional-average precipitation as a function of CRH can be decomposed into the product of the probability of raining and mean precipitation during raining times (conditional intensity). The pickup behavior is primarily dependent on the probability of raining near the transition and on the conditional intensity at higher CRH. Most models roughly capture the CRH dependence of these two factors. However, compensating biases often occur: model conditional intensity that is too low at a given CRH is compensated in part by excessive probability of precipitation.
more »
« less
The ARM Data-Oriented Metrics and Diagnostics Package for Climate Models: A New Tool for Evaluating Climate Models with Field Data
Abstract The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud, and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Intercomparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.
more »
« less
- Award ID(s):
- 1936810
- PAR ID:
- 10215568
- Date Published:
- Journal Name:
- Bulletin of the American Meteorological Society
- Volume:
- 101
- Issue:
- 10
- ISSN:
- 0003-0007
- Page Range / eLocation ID:
- E1619 to E1627
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In regions of the world where topography varies significantly with distance, most global climate models (GCMs) have spatial resolutions that are too coarse to accurately simulate key meteorological variables that are influenced by topography, such as clouds, precipitation, and surface temperatures. One approach to tackle this challenge is to run climate models of sufficiently high resolution in those topographically complex regions such as the North American Regionally Refined Model (NARRM) subset of the Department of Energy’s (DOE) Energy Exascale Earth System Model version 2 (E3SM v2). Although high-resolution simulations are expected to provide unprecedented details of atmospheric processes, running models at such high resolutions remains computationally expensive compared to lower-resolution models such as the E3SM Low Resolution (LR). Moreover, because regionally refined and high-resolution GCMs are relatively new, there are a limited number of observational datasets and frameworks available for evaluating climate models with regionally varying spatial resolutions. As such, we developed a new framework to quantify the added value of high spatial resolution in simulating precipitation over the contiguous United States (CONUS). To determine its viability, we applied the framework to two model simulations and an observational dataset. We first remapped all the data into Hierarchical Equal-Area Iso-Latitude Pixelization (HEALPix) pixels. HEALPix offers several mathematical properties that enable seamless evaluation of climate models across different spatial resolutions including its equal-area and partitioning properties. The remapped HEALPix-based data are used to show how the spatial variability of both observed and simulated precipitation changes with resolution increases. This study provides valuable insights into the requirements for achieving accurate simulations of precipitation patterns over the CONUS. It highlights the importance of allocating sufficient computational resources to run climate models at higher temporal and spatial resolutions to capture spatial patterns effectively. Furthermore, the study demonstrates the effectiveness of the HEALPix framework in evaluating precipitation simulations across different spatial resolutions. This framework offers a viable approach for comparing observed and simulated data when dealing with datasets of varying spatial resolutions. By employing this framework, researchers can extend its usage to other climate variables, datasets, and disciplines that require comparing datasets with different spatial resolutions.more » « less
-
Abstract Conditional instability and the buoyancy of plumes drive moist convection but have a variety of representations in model convective schemes. Vertical thermodynamic structure information from Atmospheric Radiation Measurement (ARM) sites and reanalysis (ERA5), satellite-derived precipitation (TRMM3b42), and diagnostics relevant for plume buoyancy are used to assess climate models. Previous work has shown that CMIP6 models represent moist convective processes more accurately than their CMIP5 counterparts. However, certain biases in convective onset remain pervasive among generations of CMIP modeling efforts. We diagnose these biases in a cohort of nine CMIP6 models with subdaily output, assessing conditional instability in profiles of equivalent potential temperature,θe, and saturation equivalent potential temperature,θes, in comparison to a plume model with different mixing assumptions. Most models capture qualitative aspects of theθesvertical structure, including a substantial decrease with height in the lower free troposphere associated with the entrainment of subsaturated air. We define a “pseudo-entrainment” diagnostic that combines subsaturation and aθesmeasure of conditional instability similar to what entrainment would produce under the small-buoyancy approximation. This captures the trade-off between largerθeslapse rates (entrainment of dry air) and small subsaturation (permits positive buoyancy despite high entrainment). This pseudo-entrainment diagnostic is also a reasonable indicator of the critical value of integrated buoyancy for precipitation onset. Models with poorθe/θesstructure (those using variants of the Tiedtke scheme) or low entrainment runs of CAM5, and models with low subsaturation, such as NASA-GISS, lie outside the observational range in this diagnostic.more » « less
-
We propose a set of MJO teleconnection diagnostics that enables an objective evaluation of model simulations, a fair model-to-model comparison, and a consistent tracking of model improvement. Various skill metrics are derived from teleconnection diagnostics including five performance-based metrics that characterize the pattern, amplitude, east–west position, persistence, and consistency of MJO teleconnections and additional two process-oriented metrics that are designed to characterize the location and intensity of the anomalous Rossby wave source (RWS). The proposed teleconnection skill metrics are used to compare the characteristics of boreal winter MJO teleconnections (500-hPa geopotential height anomaly) over the Pacific–North America (PNA) region in 29 global climate models (GCMs). The results show that current GCMs generally produce MJO teleconnections that are stronger, more persistent, and extend too far to the east when compared to those observed in reanalysis. In general, models simulate more realistic teleconnection patterns when the MJO is in phases 2–3 or phases 7–8, which are characterized by a dipole convection pattern over the Indian Ocean and western to central Pacific. The higher model skill for phases 2, 7, and 8 may be due to these phases producing more consistent teleconnection patterns between individual MJO events than other phases, although the consistency is lower in most models than observed. Models that simulate realistic RWS patterns better reproduce MJO teleconnection patterns.more » « less
-
The Fire and Smoke Model Evaluation Experiment (FASMEE) is designed to collect integrated observations from large wildland fires and provide evaluation datasets for new models and operational systems. Wildland fire, smoke dispersion, and atmospheric chemistry models have become more sophisticated, and next-generation operational models will require evaluation datasets that are coordinated and comprehensive for their evaluation and advancement. Integrated measurements are required, including ground-based observations of fuels and fire behavior, estimates of fire-emitted heat and emissions fluxes, and observations of near-source micrometeorology, plume properties, smoke dispersion, and atmospheric chemistry. To address these requirements the FASMEE campaign design includes a study plan to guide the suite of required measurements in forested sites representative of many prescribed burning programs in the southeastern United States and increasingly common high-intensity fires in the western United States. Here we provide an overview of the proposed experiment and recommendations for key measurements. The FASMEE study provides a template for additional large-scale experimental campaigns to advance fire science and operational fire and smoke models.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1175/BAMS-D-19-0282.1
