skip to main content


Title: An Ensemble of Neural Networks for Moist Physics Processes, Its Generalizability and Stable Integration
Abstract

With the recent advances in data science, machine learning has been increasingly applied to convection and cloud parameterizations in global climate models (GCMs). This study extends the work of Han et al. (2020,https://doi.org/10.1029/2020MS002076) and uses an ensemble of 32‐layer deep convolutional residual neural networks, referred to as ResCu‐en, to emulate convection and cloud processes simulated by a superparameterized GCM, SPCAM. ResCu‐en predicts GCM grid‐scale temperature and moisture tendencies, and cloud liquid and ice water contents from moist physics processes. The surface rainfall is derived from the column‐integrated moisture tendency. The prediction uncertainty inherent in deep learning algorithms in emulating the moist physics is reduced by ensemble averaging. Results in 1‐year independent offline validation show that ResCu‐en has high prediction accuracy for all output variables, both in the current climate and in a warmer climate with +4K sea surface temperature. The analysis of different neural net configurations shows that the success to generalize in a warmer climate is attributed to convective memory and the 1‐dimensional convolution layers incorporated into ResCu‐en. We further implement a member of ResCu‐en into CAM5 with real world geography and run the neural‐network‐enabled CAM5 (NCAM) for 5 years without encountering any numerical integration instability. The simulation generally captures the global distribution of the mean precipitation, with a better simulation of precipitation intensity and diurnal cycle. However, there are large biases in temperature and moisture in high latitudes. These results highlight the importance of convective memory and demonstrate the potential for machine learning to enhance climate modeling.

 
more » « less
NSF-PAR ID:
10470929
Author(s) / Creator(s):
 ;  ;  
Publisher / Repository:
DOI PREFIX: 10.1029
Date Published:
Journal Name:
Journal of Advances in Modeling Earth Systems
Volume:
15
Issue:
10
ISSN:
1942-2466
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    We introduce a new framework called Machine Learning (ML) based Auroral Ionospheric electrodynamics Model (ML‐AIM). ML‐AIM solves a current continuity equation by utilizing the ML model of Field Aligned Currents of Kunduri et al. (2020,https://doi.org/10.1029/2020JA027908), the FAC‐derived auroral conductance model of Robinson et al. (2020,https://doi.org/10.1029/2020JA028008), and the solar irradiance conductance model of Moen and Brekke (1993,https://doi.org/10.1029/92gl02109). The ML‐AIM inputs are 60‐min time histories of solar wind plasma, interplanetary magnetic fields (IMF), and geomagnetic indices, and its outputs are ionospheric electric potential, electric fields, Pedersen/Hall currents, and Joule Heating. We conduct two ML‐AIM simulations for a weak geomagnetic activity interval on 14 May 2013 and a geomagnetic storm on 7–8 September 2017. ML‐AIM produces physically accurate ionospheric potential patterns such as the two‐cell convection pattern and the enhancement of electric potentials during active times. The cross polar cap potentials (ΦPC) from ML‐AIM, the Weimer (2005,https://doi.org/10.1029/2004ja010884) model, and the Super Dual Auroral Radar Network (SuperDARN) data‐assimilated potentials, are compared to the ones from 3204 polar crossings of the Defense Meteorological Satellite Program F17 satellite, showing better performance of ML‐AIM than others. ML‐AIM is unique and innovative because it predicts ionospheric responses to the time‐varying solar wind and geomagnetic conditions, while the other traditional empirical models like Weimer (2005,https://doi.org/10.1029/2004ja010884) designed to provide a quasi‐static ionospheric condition under quasi‐steady solar wind/IMF conditions. Plans are underway to improve ML‐AIM performance by including a fully ML network of models of aurora precipitation and ionospheric conductance, targeting its characterization of geomagnetically active times.

     
    more » « less
  2. Abstract Tropical areas with mean upward motion—and as such the zonal-mean intertropical convergence zone (ITCZ)—are projected to contract under global warming. To understand this process, a simple model based on dry static energy and moisture equations is introduced for zonally symmetric overturning driven by sea surface temperature (SST). Processes governing ascent area fraction and zonal mean precipitation are examined for insight into Atmospheric Model Intercomparison Project (AMIP) simulations. Bulk parameters governing radiative feedbacks and moist static energy transport in the simple model are estimated from the AMIP ensemble. Uniform warming in the simple model produces ascent area contraction and precipitation intensification—similar to observations and climate models. Contributing effects include stronger water vapor radiative feedbacks, weaker cloud-radiative feedbacks, stronger convection-circulation feedbacks, and greater poleward moisture export. The simple model identifies parameters consequential for the inter-AMIP-model spread; an ensemble generated by perturbing parameters governing shortwave water vapor feedbacks and gross moist stability changes under warming tracks inter-AMIP-model variations with a correlation coefficient ∼0.46. The simple model also predicts the multimodel mean changes in tropical ascent area and precipitation with reasonable accuracy. Furthermore, the simple model reproduces relationships among ascent area precipitation, ascent strength, and ascent area fraction observed in AMIP models. A substantial portion of the inter-AMIP-model spread is traced to the spread in how moist static energy and vertical velocity profiles change under warming, which in turn impact the gross moist stability in deep convective regions—highlighting the need for observational constraints on these quantities. Significance Statement A large rainband straddles Earth’s tropics. Most, but not all, climate models predict that this rainband will shrink under global warming; a few models predict an expansion of the rainband. To mitigate some of this uncertainty among climate models, we build a simpler model that only contains the essential physics of rainband narrowing. We find several interconnected processes that are important. For climate models, the most important process is the efficiency with which clouds move heat and humidity out of rainy regions. This efficiency varies among climate models and appears to be a primary reason for why climate models do not agree on the rate of rainband narrowing. 
    more » « less
  3. Abstract

    A new version of the stochastic multiplume Jet Propulsion Laboratory Eddy‐Diffusivity/Mass‐Flux (JPL‐EDMF) parameterization which consistently couples the simplified Khairoutdinov and Kogan (2000),https://doi.org/10.1175/1520-0493(2000)128<0229:ANCPPI>2.0.CO;2, warm phase cloud microphysical parameterization with the parameterization of cloud macrophysical and subgrid scale dynamical processes is described. The new parameterization combines the EDMF approach with an assumed shape of a joint probability density function of thermodynamic and kinematic variables which provide the basis for the computation of all parameterized processes. As far as we are aware this is the first attempt to consistently couple all of these parameterized processes in the EDMF framework. This paper is part one of a two paper series. Here, the JPL‐EDMF parameterization is described and benchmark simulations of precipitating stratocumulus and cumulus convection are performed in a single‐column‐model framework. The parameterization results compare favorably to the reference large‐eddy‐simulation results. In the second part (Smalley et al., 2022,https://doi.org/10.1029/2021MS002729) the JPL‐EDMF parameterization is validated for a wide range of observation‐based scenarios covering the continuous transition from subtropical stratocumulus to cumulus convection derived from global reanalysis, and parameterization uncertainties are studied in detail.

     
    more » « less
  4. Abstract

    This paper describes an implementation of the combined hybrid‐parallel prediction (CHyPP) approach of Wikner et al. (2020),https://doi.org/10.1063/5.0005541on a low‐resolution atmospheric global circulation model (AGCM). The CHyPP approach combines a physics‐based numerical model of a dynamical system (e.g., the atmosphere) with a computationally efficient type of machine learning (ML) called reservoir computing to construct a hybrid model. This hybrid atmospheric model produces more accurate forecasts of most atmospheric state variables than the host AGCM for the first 7–8 forecast days, and for even longer times for the temperature and humidity near the earth's surface. It also produces more accurate forecasts than a model based only on ML, or a model that combines linear regression, rather than ML, with the AGCM. The potential of the CHyPP approach for climate research is demonstrated by a 10‐year long hybrid model simulation of the atmospheric general circulation, which shows that the hybrid model can simulate the general circulation with substantially smaller systematic errors and more realistic variability than the host AGCM.

     
    more » « less
  5. Abstract

    Modeling convective air movement in unsaturated porous media requires appropriate characterization of the relative air permeability (RAP). Adopting Assouline et al. (1998,https://doi.org/10.1029/97WR03039) water retention function that is based on the Weibull pore size distribution, this study was conducted to derive seven new predictive RAP models. These 7 new models, together with another 3 models developed by Assouline et al. (2016,https://doi.org/10.1002/2015WR018286), were then compared with data from 30 disturbed soil samples to investigate their predictive RAP performances. The model and data comparison results showed that the modified Burdine, modified Mualem, and modified Alexander and Skaggs relative permeability models proposed by Yang and Mohanty (2015,https://doi.org/10.1002/2014WR016190) had the highest accuracy for the RAP prediction among the 10 investigated models, which indicated that the tortuosity and connectivity exponent of water phase should be smaller than that of air phase for the disturbed soil samples. The modified Burdine, modified Mualem, and modified Alexander and Skaggs models were then the suggested RAP parameterizations for the subsurface multiphase flow numerical simulation.

     
    more » « less