skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Tuning Earth System Models Without Integrating to Statistical Equilibrium
Abstract This paper proposes algorithms for estimating parameters in Earth System Models (ESMs), specifically focusing on simulations that have not yet achieved statistical equilibrium and display climate drift. The basic idea is to treat ESM time series as outputs of an autoregressive process, with parameters that depend on those of the ESM. The maximum likelihood estimate of the parameters and the associated uncertainties are derived. This method requires solving a nonlinear system of equations and often results in unsatisfactory parameter estimates, especially in short simulations. This paper explores a strategy for overcoming this limitation by dividing the estimation process into two linear phases. This algorithm is applied to estimate parameters in the convection scheme of the Community Earth System Model version 2 (CESM2). The modified algorithm can produce accurate estimates from perturbation runs as short as 2 years, including those exhibiting climate drift. Despite accounting for climate drift, the accuracy of these estimates is comparable to that of algorithms that do not. While these initial results are not optimal, the autoregressive approach presented here remains a promising strategy for model tuning since it explicitly accounts for climate drift in a rigorous statistical framework. The current performance issues are believed to be technical in nature and potentially solvable through further investigation.  more » « less
Award ID(s):
1934529
PAR ID:
10557128
Author(s) / Creator(s):
 ;  
Publisher / Repository:
DOI PREFIX: 10.1029
Date Published:
Journal Name:
Journal of Advances in Modeling Earth Systems
Volume:
16
Issue:
12
ISSN:
1942-2466
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The impacts of climate change are felt by most critical systems, such as infrastructure, ecological systems, and power-plants. However, contemporary Earth System Models (ESM) are run at spatial resolutions too coarse for assessing effects this localized. Local scale projections can be obtained using statistical downscaling, a technique which uses historical climate observations to learn a low-resolution to high-resolution mapping. The spatio-temporal nature of the climate system motivates the adaptation of super-resolution image processing techniques to statistical downscaling. In our work, we present DeepSD, a generalized stacked super resolution convolutional neural network (SRCNN) framework with multi-scale input channels for statistical downscaling of climate variables. A comparison of DeepSD to four state-of-the-art methods downscaling daily precipitation from 1 degree (~100km) to 1/8 degrees (~12.5km) over the Continental United States. Furthermore, a framework using the NASA Earth Exchange (NEX) platform is discussed for downscaling more than 20 ESM models with multiple emission scenarios. 
    more » « less
  2. Abstract Land surface air temperatures (LSAT) inferred from weather station data differ among major research groups. The estimate by NOAA’s monthly Global Historical Climatology Network (GHCNm) averages 0.02°C cooler between 1880 and 1940 than Berkeley Earth’s and 0.14°C cooler than the Climate Research Unit estimates. Such systematic offsets can arise from differences in how poorly documented changes in measurement characteristics are detected and adjusted. Building upon an existing pairwise homogenization algorithm used in generating the fourth version of NOAA’s GHCNm(V4), PHA0, we propose two revisions to account for autocorrelation in climate variables. One version, PHA1, makes minimal modification to PHA0by extending the threshold used in breakpoint detection to be a function of LSAT autocorrelation. The other version, PHA2, uses penalized likelihood to detect breakpoints through optimizing a model-selection problem globally. To facilitate efficient optimization for series with more than 1000 time steps, a multiparent genetic algorithm is proposed for PHA2. Tests on synthetic data generated by adding breakpoints to CMIP6 simulations and realizations from a Gaussian process indicate that PHA1and PHA2both similarly outperform PHA0in recovering accurate climatic trends. Applied to unhomogenized GHCNmV4, both revised algorithms detect breakpoints that correspond with available station metadata. Uncertainties are estimated by perturbing algorithmic parameters, and an ensemble is constructed by pooling 50 PHA1- and 50 PHA2-based members. The continental-mean warming in this new ensemble is consistent with that of Berkeley Earth, despite using different homogenization approaches. Relative to unhomogenized data, our homogenization increases the 1880–2022 trend by 0.16 [0.12, 0.19]°C century−1(95% confidence interval), leading to continental-mean warming of 1.65 [1.62, 1.69]°C over 2010–22 relative to 1880–1900. Significance StatementAccurately correcting for systematic errors in observational records of land surface air temperature (LSAT) is critical for quantifying historical warming. Existing LSAT estimates are subject to systematic offsets associated with processes including changes in instrumentation and station movement. This study improves a pairwise homogenization algorithm by accounting for the fact that climate signals are correlated over time. The revised algorithms outperform the original in identifying discontinuities and recovering accurate warming trends. Applied to monthly station temperatures, the revised algorithms adjust trends in continental mean LSAT since the 1880s to be 0.16°C century−1greater relative to raw data. Our estimate is most consistent with that from Berkeley Earth and indicates lesser and greater warming than estimates from NOAA and the Met Office, respectively. 
    more » « less
  3. Abstract. Earth system models (ESMs) are useful tools forpredicting and understanding past and future aspects of the climate system.However, the biological and physical parameters used in ESMs can have widevariations in their estimates. Even small changes in these parameters canyield unexpected results without a clear explanation of how a particularoutcome was reached. The standard method for estimating ESM sensitivity isto compare spatiotemporal distributions of variables from different runs ofa single ESM. However, a potential pitfall of this method is that ESM outputcould match observational patterns because of compensating errors. Forexample, if a model predicts overly weak upwelling and low nutrientconcentrations, it might compensate for this by allowing phytoplankton tohave a high sensitivity to nutrients. Recently, we demonstrated that neuralnetwork ensembles (NNEs) are capable of extracting relationships betweenpredictor and target variables within ocean biogeochemical models. Beingable to view the relationships between variables, along with spatiotemporaldistributions, allows for a more mechanistically based examination of ESMoutputs. Here, we investigated whether we could apply NNEs to help usdetermine why different ESMs produce different spatiotemporal distributionsof phytoplankton biomass. We tested this using three cases. The first andsecond case used different runs of the same ESM, except that the physicalcirculations differed between them in the first case, while the biologicalequations differed between them in the second. Our results indicated thatthe NNEs were capable of extracting the relationships between variables fordifferent runs of a single ESM, allowing us to distinguish betweendifferences due to changes in circulation (which do not changerelationships) from changes in biogeochemical formulation (which do changerelationships). In the third case, we applied NNEs to two different ESMs.The results of the third case highlighted the capability of NNEs to contrastthe apparent relationships of different ESMs and some of the challenges itpresents. Although applied specifically to the ocean components of an ESM,our study demonstrates that Earth system modelers can use NNEs to separatethe contributions of different components of ESMs. Specifically, this allowsmodelers to compare the apparent relationships across different ESMs andobservational datasets. 
    more » « less
  4. ABSTRACT We present a novel method for generating sequential parameter estimates and quantifying epistemic uncertainty in dynamical systems within a data‐consistent (DC) framework. The DC framework differs from traditional Bayesian approaches due to the incorporation of the push‐forward of an initial density, which performs selective regularization in parameter directions not informed by the data in the resulting updated density. This extends a previous study that included the linear Gaussian theory within the DC framework and introduced the maximal updated density (MUD) estimate as an alternative to both least squares and maximum a posterior (MAP) estimates. In this work, we introduce algorithms for operational settings of MUD estimation in real‐ or near‐real time where spatio‐temporal datasets arrive in packets to provide updated estimates of parameters and identify potential parameter drift. Computational diagnostics within the DC framework prove critical for evaluating (1) the quality of the DC update and MUD estimate and (2) the detection of parameter value drift. The algorithms are applied to estimate (1) wind drag parameters in a high‐fidelity storm surge model, (2) thermal diffusivity field for a heat conductivity problem, and (3) changing infection and incubation rates of an epidemiological model. 
    more » « less
  5. The parameterization of subgrid‐scale processes such as boundary layer (PBL) turbulence introduces uncertainty in Earth System Model (ESM) results. This uncertainty can contribute to or exacerbate existing biases in representing key physical processes. This study analyzes the influence of tunable parameters in an experimental version of the Cloud Layers Unified by Binormals (CLUBBX) scheme. CLUBB is the operational PBL parameterization in the Community Atmosphere Model version 6 (CAM6), the atmospheric component of the Community ESM version 2 (CESM2). We perform the Morris one‐at‐a‐time (MOAT) parameter sensitivity analysis using short‐term (3‐day), initialized hindcasts of CAM6‐CLUBBX with 24 unique initial conditions. Several input parameters modulating vertical momentum flux appear most influential for various regionally‐averaged quantities, namely surface stress and shortwave cloud forcing (SWCF). These parameter sensitivities have a spatial dependence, with parameters governing momentum flux most influential in regions of high vertical wind shear (e.g., the mid‐latitude storm tracks). We next evaluate several experimental 20‐year simulations of CAM6‐CLUBBX with targeted parameter perturbations. We find that parameter perturbations produce similar physical mechanisms in both short‐term and long‐term simulations, but these physical responses can be muted due to nonlinear feedbacks manifesting over time scales longer than 3 days, thus causing differences in how output metrics respond in the long‐term simulations. Analysis of turbulent fluxes in CLUBBX indicates that the influential parameters affect vertical fluxes of heat, moisture, and momentum, providing physical pathways for the sensitivities identified in this study. 
    more » « less