Abstract A set of diagnostics based on simple, statistical relationships between precipitation and the thermodynamic environment in observations is implemented to assess phase 6 of the Coupled Model Intercomparison Project (CMIP6) model behavior with respect to precipitation. Observational data from the Atmospheric Radiation Measurement (ARM) permanent field observational sites are augmented with satellite observations of precipitation and temperature as an observational baseline. A robust relationship across observational datasets between column water vapor (CWV) and precipitation, in which conditionally averaged precipitation exhibits a sharp pickup at some critical CWV value, provides a useful convective onset diagnostic for climate model comparison. While a few models reproduce an appropriate precipitation pickup, most models begin their pickup at too low CWV and the increase in precipitation with increasing CWV is too weak. Convective transition statistics compiled in column relative humidity (CRH) partially compensate for model temperature biases—although imperfectly since the temperature dependence is more complex than that of column saturation. Significant errors remain in individual models and weak pickups are generally not improved. The conditional-average precipitation as a function of CRH can be decomposed into the product of the probability of raining and mean precipitation during raining times (conditional intensity). The pickup behavior is primarily dependent on the probability of raining near the transition and on the conditional intensity at higher CRH. Most models roughly capture the CRH dependence of these two factors. However, compensating biases often occur: model conditional intensity that is too low at a given CRH is compensated in part by excessive probability of precipitation.
more »
« less
The ARM Data-Oriented Metrics and Diagnostics Package for Climate Models: A New Tool for Evaluating Climate Models with Field Data
Abstract The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud, and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Intercomparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.
more »
« less
- Award ID(s):
- 1936810
- NSF-PAR ID:
- 10215568
- Date Published:
- Journal Name:
- Bulletin of the American Meteorological Society
- Volume:
- 101
- Issue:
- 10
- ISSN:
- 0003-0007
- Page Range / eLocation ID:
- E1619 to E1627
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Conditional instability and the buoyancy of plumes drive moist convection but have a variety of representations in model convective schemes. Vertical thermodynamic structure information from Atmospheric Radiation Measurement (ARM) sites and reanalysis (ERA5), satellite-derived precipitation (TRMM3b42), and diagnostics relevant for plume buoyancy are used to assess climate models. Previous work has shown that CMIP6 models represent moist convective processes more accurately than their CMIP5 counterparts. However, certain biases in convective onset remain pervasive among generations of CMIP modeling efforts. We diagnose these biases in a cohort of nine CMIP6 models with subdaily output, assessing conditional instability in profiles of equivalent potential temperature,
θe , and saturation equivalent potential temperature,θes , in comparison to a plume model with different mixing assumptions. Most models capture qualitative aspects of theθes vertical structure, including a substantial decrease with height in the lower free troposphere associated with the entrainment of subsaturated air. We define a “pseudo-entrainment” diagnostic that combines subsaturation and aθes measure of conditional instability similar to what entrainment would produce under the small-buoyancy approximation. This captures the trade-off between largerθes lapse rates (entrainment of dry air) and small subsaturation (permits positive buoyancy despite high entrainment). This pseudo-entrainment diagnostic is also a reasonable indicator of the critical value of integrated buoyancy for precipitation onset. Models with poorθe /θes structure (those using variants of the Tiedtke scheme) or low entrainment runs of CAM5, and models with low subsaturation, such as NASA-GISS, lie outside the observational range in this diagnostic. -
more » « less
Abstract. A comparison of polar stratospheric cloud (PSC) occurrence from 2006 to2010 is presented, as observed from the ground-based lidar station at McMurdo(Antarctica) and by the satellite-borne CALIOP lidar (Cloud-Aerosol Lidarwith Orthogonal Polarization) measuring over McMurdo. McMurdo (Antarctica) isone of the primary lidar stations for aerosol measurements of the NDACC (Network forDetection of Atmospheric Climate Change). The ground-based observations havebeen classified with an algorithm derived from the recent v2 detection andclassification scheme, used to classify PSCs observed by CALIOP.
A statistical approach has been used to compare ground-based and satellite-based observations, since point-to-point comparison is often troublesome dueto the intrinsic differences in the observation geometries and the imperfectoverlap of the observed areas.
A comparison of space-borne lidar observations and a selection of simulationsobtained from chemistry–climate models (CCMs) has been made by using a series ofquantitative diagnostics based on the statistical occurrence of different PSCtypes. The distribution of PSCs over Antarctica, calculated by severalCCMVal-2 and CCMI chemistry–climate models has been compared with the PSCcoverage observed by the satellite-borne CALIOP lidar. The use of severaldiagnostic tools, including the temperature dependence of the PSCoccurrences, evidences the merits and flaws of the different models. Thediagnostic methods have been defined to overcome (at least partially) thepossible differences due to the resolution of the models and to identifydifferences due to microphysics (e.g., the dependence of PSC occurrence onT−TNAT).
A significant temperature bias of most models has been observed, as well as alimited ability to reproduce the longitudinal variations in PSC occurrencesobserved by CALIOP. In particular, a strong temperature bias has been observedin CCMVal-2 models with a strong impact on PSC formation. The WACCM-CCMI(Whole Atmosphere Community Climate Model – Chemistry-Climate ModelInitiative) model compares rather well with the CALIOP observations, althougha temperature bias is still present.
-
more » « less
In regions of the world where topography varies significantly with distance, most global climate models (GCMs) have spatial resolutions that are too coarse to accurately simulate key meteorological variables that are influenced by topography, such as clouds, precipitation, and surface temperatures. One approach to tackle this challenge is to run climate models of sufficiently high resolution in those topographically complex regions such as the North American Regionally Refined Model (NARRM) subset of the Department of Energy’s (DOE) Energy Exascale Earth System Model version 2 (E3SM v2). Although high-resolution simulations are expected to provide unprecedented details of atmospheric processes, running models at such high resolutions remains computationally expensive compared to lower-resolution models such as the E3SM Low Resolution (LR). Moreover, because regionally refined and high-resolution GCMs are relatively new, there are a limited number of observational datasets and frameworks available for evaluating climate models with regionally varying spatial resolutions. As such, we developed a new framework to quantify the added value of high spatial resolution in simulating precipitation over the contiguous United States (CONUS). To determine its viability, we applied the framework to two model simulations and an observational dataset. We first remapped all the data into Hierarchical Equal-Area Iso-Latitude Pixelization (HEALPix) pixels. HEALPix offers several mathematical properties that enable seamless evaluation of climate models across different spatial resolutions including its equal-area and partitioning properties. The remapped HEALPix-based data are used to show how the spatial variability of both observed and simulated precipitation changes with resolution increases. This study provides valuable insights into the requirements for achieving accurate simulations of precipitation patterns over the CONUS. It highlights the importance of allocating sufficient computational resources to run climate models at higher temporal and spatial resolutions to capture spatial patterns effectively. Furthermore, the study demonstrates the effectiveness of the HEALPix framework in evaluating precipitation simulations across different spatial resolutions. This framework offers a viable approach for comparing observed and simulated data when dealing with datasets of varying spatial resolutions. By employing this framework, researchers can extend its usage to other climate variables, datasets, and disciplines that require comparing datasets with different spatial resolutions.
-
more » « less
Abstract The rapid expansion of Earth system model (ESM) data available from the Coupled Model Intercomparison Project Phase 6 (CMIP6) necessitates new methods to evaluate the performance and suitability of ESMs used for hydroclimate applications as these extremely large data volumes complicate stakeholder efforts to use new ESM outputs in updated climate vulnerability and impact assessments. We develop an analysis framework to inform ESM sub‐selection based on process‐oriented considerations and demonstrate its performance for a regional application in the US Pacific Northwest. First, a suite of global and regional metrics is calculated, using multiple historical observation datasets to assess ESM performance. These metrics are then used to rank CMIP6 models, and a culled ensemble of models is selected using a trend‐related diagnostics approach. This culling strategy does not dramatically change climate scenario trend projections in this region, despite retaining only 20% of the CMIP6 ESMs in the final model ensemble. The reliability of the culled trend projection envelope and model response similarity is also assessed using a perfect model framework. The absolute difference in temperature trend projections is reduced relative to the full ensemble compared to the model for each SSP scenario, while precipitation trend errors are largely unaffected. In addition, we find that the spread of the culled ensemble temperature and precipitation trends includes the trend of the “truth” model ∼83%‐92% of the time. This analysis demonstrates a reliable method to reduce ESM ensemble size that can ease use of ESMs for creating and understanding climate vulnerability and impact assessments.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1175/BAMS-D-19-0282.1
