skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Interpreting and Stabilizing Machine-Learning Parametrizations of Convection
Abstract Neural networks are a promising technique for parameterizing subgrid-scale physics (e.g., moist atmospheric convection) in coarse-resolution climate models, but their lack of interpretability and reliability prevents widespread adoption. For instance, it is not fully understood why neural network parameterizations often cause dramatic instability when coupled to atmospheric fluid dynamics. This paper introduces tools for interpreting their behavior that are customized to the parameterization task. First, we assess the nonlinear sensitivity of a neural network to lower-tropospheric stability and the midtropospheric moisture, two widely studied controls of moist convection. Second, we couple the linearized response functions of these neural networks to simplified gravity wave dynamics, and analytically diagnose the corresponding phase speeds, growth rates, wavelengths, and spatial structures. To demonstrate their versatility, these techniques are tested on two sets of neural networks, one trained with a superparameterized version of the Community Atmosphere Model (SPCAM) and the second with a near-global cloud-resolving model (GCRM). Even though the SPCAM simulation has a warmer climate than the cloud-resolving model, both neural networks predict stronger heating/drying in moist and unstable environments, which is consistent with observations. Moreover, the spectral analysis can predict that instability occurs when GCMs are coupled to networks that support gravity waves that are unstable and have phase speeds larger than 5 m s −1 . In contrast, standing unstable modes do not cause catastrophic instability. Using these tools, differences between the SPCAM-trained versus GCRM-trained neural networks are analyzed, and strategies to incrementally improve both of their coupled online performance unveiled.  more » « less
Award ID(s):
1835863
PAR ID:
10299894
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Journal of the Atmospheric Sciences
Volume:
77
Issue:
12
ISSN:
0022-4928
Page Range / eLocation ID:
4357 to 4375
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract In Earth’s current climate, moist convective updraft speeds increase with surface warming. This trend suggests that very vigorous convection might be the norm in extremely hot and humid atmospheres, such as those undergoing a runaway greenhouse transition. However, theoretical and numerical evidence suggests that convection is actually gentle in water-vapor-dominated atmospheres, implying that convective vigor may peak at some intermediate humidity level. Here, we perform small-domain convection-resolving simulations of an Earth-like atmosphere over a wide range of surface temperatures and confirm that there is indeed a peak in convective vigor, which we show occurs nearTs≃ 330 K. We show that a similar peak in convective vigor exists when the relative abundance of water vapor is changed by varying the amount of background (noncondensing) gas at fixedTs, which may have implications for Earth’s climate and atmospheric chemistry during the Hadean and Archean eons. We also show that Titan-like thermodynamics (i.e., a thick nitrogen atmosphere with condensing methane and low gravity) produce a peak in convective vigor atTs≃ 95 K, which is curiously close to the current surface temperature of Titan. Plotted as functions of the saturation-specific humidity at cloud base, metrics of convective vigor from both Earth-like and Titan-like experiments all peak when cloud-base air contains roughly 10% of the condensible gas by mass. Our results point to a potentially common phenomenon in terrestrial atmospheres: that moist convection is most vigorous when the condensible component is between dilute and nondilute abundance. 
    more » « less
  2. Abstract Storms operated by moist convection and the condensation of CH4or H2S have been observed on Uranus and Neptune. However, the mechanism of cloud formation, thermal structure, and mixing efficiency of ice giant weather layers remains unclear. In this paper, we show that moist convection is limited by heat transport on giant planets, especially on ice giants where planetary heat flux is weak. Latent heat associated with condensation and evaporation can efficiently bring heat across the weather layer through precipitations. This effect was usually neglected in previous studies without a complete hydrological cycle. We first derive analytical theories and show that the upper limit of cloud density is determined by the planetary heat flux and microphysics of clouds but is independent of the atmospheric composition. The eddy diffusivity of moisture depends on the planetary heat fluxes, atmospheric composition, and surface gravity but is not directly related to cloud microphysics. We then conduct convection- and cloud-resolving simulations with SNAP to validate our analytical theory. The simulated cloud density and eddy diffusivity are smaller than the results acquired from the equilibrium cloud condensation model and mixing length theory by several orders of magnitude but consistent with our analytical solutions. Meanwhile, the mass-loading effect of CH4and H2S leads to superadiabatic and stable weather layers. Our simulations produced three cloud layers that are qualitatively similar to recent observations. This study has important implications for cloud formation and eddy mixing in giant planet atmospheres in general and observations for future space missions and ground-based telescopes. 
    more » « less
  3. Abstract Convection‐generated gravity waves (CGWs) transport momentum and energy, and this momentum is a dominant driver of global features of Earth's atmosphere's general circulation (e.g., the quasi‐biennial oscillation, the pole‐to‐pole mesospheric circulation). As CGWs are not generally resolved by global weather and climate models, their effects on the circulation need to be parameterized. However, quality observations of GWs are spatiotemporally sparse, limiting understanding and preventing constraints on parameterizations. Convection‐permitting or ‐resolving simulations do generate CGWs, but validation is not possible as these simulations cannot reproduce the CGW‐forcing convection at correct times, locations, and intensities. Here, realistic convective diabatic heating, learned from full‐physics convection‐permitting Weather Research and Forecasting simulations, is predicted from weather radar observations using neural networks and a previously developed look‐up table. These heating rates are then used to force an idealized GW‐resolving dynamical model. Simulated CGWs forced in this way closely resembled those observed by the Atmospheric InfraRed Sounder in the upper stratosphere. CGW drag in these validated simulations extends 100s of kilometers away from the convective sources, highlighting errors in current gravity wave drag parameterizations due to the use of the ubiquitous single‐column approximation. Such validatable simulations have significant potential to be used to further basic understanding of CGWs, improve their parameterizations physically, and provide more restrictive constraints on tuningwith confidence. 
    more » « less
  4. Abstract With the recent advances in data science, machine learning has been increasingly applied to convection and cloud parameterizations in global climate models (GCMs). This study extends the work of Han et al. (2020,https://doi.org/10.1029/2020MS002076) and uses an ensemble of 32‐layer deep convolutional residual neural networks, referred to as ResCu‐en, to emulate convection and cloud processes simulated by a superparameterized GCM, SPCAM. ResCu‐en predicts GCM grid‐scale temperature and moisture tendencies, and cloud liquid and ice water contents from moist physics processes. The surface rainfall is derived from the column‐integrated moisture tendency. The prediction uncertainty inherent in deep learning algorithms in emulating the moist physics is reduced by ensemble averaging. Results in 1‐year independent offline validation show that ResCu‐en has high prediction accuracy for all output variables, both in the current climate and in a warmer climate with +4K sea surface temperature. The analysis of different neural net configurations shows that the success to generalize in a warmer climate is attributed to convective memory and the 1‐dimensional convolution layers incorporated into ResCu‐en. We further implement a member of ResCu‐en into CAM5 with real world geography and run the neural‐network‐enabled CAM5 (NCAM) for 5 years without encountering any numerical integration instability. The simulation generally captures the global distribution of the mean precipitation, with a better simulation of precipitation intensity and diurnal cycle. However, there are large biases in temperature and moisture in high latitudes. These results highlight the importance of convective memory and demonstrate the potential for machine learning to enhance climate modeling. 
    more » « less
  5. Convective parameterization is the long-lasting bottleneck of global climate modelling and one of the most difficult problems in atmospheric sciences. Uncertainty in convective parameterization is the leading cause of the widespread climate sensitivity in IPCC global warming projections. This paper reviews the observations and parameterizations of atmospheric convection with emphasis on the cloud structure, bulk effects, and closure assumption. The representative state-of-the-art convection schemes are presented, including the ECMWF convection scheme, the Grell scheme used in NCEP model and WRF model, the Zhang-MacFarlane scheme used in NCAR and DOE models, and parameterizations of shallow moist convection. The observed convection has self-suppression mechanisms caused by entrainment in convective updrafts, surface cold pool generated by unsaturated convective downdrafts, and warm and dry lower troposphere created by mesoscale downdrafts. The post-convection environment is often characterized by “diamond sounding” suggesting an over-stabilization rather than barely returning to neutral state. Then the pre-convection environment is characterized by slow moistening of lower troposphere triggered by surface moisture convergence and other mechanisms. The over-stabilization and slow moistening make the convection events episodic and decouple the middle/upper troposphere from the boundary layer, making the state-type quasi-equilibrium hypothesis invalid. Right now, unsaturated convective downdrafts and especially mesoscale downdrafts are missing in most convection schemes, while some schemes are using undiluted convective updrafts, all of which favour easily turned-on convection linked to double-ITCZ (inter-tropical convergence zone), overly weak MJO (Madden-Julian Oscillation) and precocious diurnal precipitation maximum. We propose a new strategy for convection scheme development using reanalysis-driven model experiments such as the assimilation runs in weather prediction centres and the decadal prediction runs in climate modelling centres, aided by satellite simulators evaluating key characteristics such as the lifecycle of convective cloud-top distribution and stratiform precipitation fraction. 
    more » « less