skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A calibration method for projecting future extremes via a linear mapping of parameters
Abstract In order to study potential impacts arising from climate change, future projections of numerical model output often must be calibrated to be comparable to observations. Rather than calibrating the data values themselves, we propose a novel statistical calibration method for extremes that assumes there exists a linear relationship between parameters associated with model output and parameters associated with observations. This approach allows us to capture uncertainty in both parameter estimates and the linear calibration, which we achieve via bootstrap. To focus on extreme behavior, we assume both model output and observations have distributions composed of a mixture model combining a Weibull distribution with a generalized Pareto distribution for the tail. A simulation study shows good coverage rates. We apply the method to project future daily-averaged river runoff at the Purgatoire River in southeastern Colorado.  more » « less
Award ID(s):
1811657
PAR ID:
10556013
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Springer Science + Business Media
Date Published:
Journal Name:
Environmental and Ecological Statistics
Volume:
32
Issue:
1
ISSN:
1352-8505
Format(s):
Medium: X Size: p. 1-20
Size(s):
p. 1-20
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Stochastic Watershed Models (SWMs) are emerging tools in hydrologic modeling used to propagate uncertainty into model predictions by adding samples of model error to deterministic simulations. One of the most promising uses of SWMs is uncertainty propagation for hydrologic simulations under climate change. However, a core challenge is that the historical predictive uncertainty may not correctly characterize the error distribution under future climate. For example, the frequency of physical processes (e.g., snow accumulation and melt) may change under climate change, and so too may the frequency of errors associated with those processes. In this work, we explore for the first time non‐stationarity in hydrologic model errors under climate change in an idealized experimental design. We fit one hydrologic model to historical observations, and then fit a second model to the simulations of the first, treating the first model as the true hydrologic system. We then force both models with climate change impacted meteorology and investigate changes to the error distribution between the models. We develop a hybrid machine learning method that maps model state variables to predictive errors, allowing for non‐stationary error distributions based on changes in the frequency of model states. We find that this procedure provides an internally consistent methodology to overcome stationarity assumptions in error modeling and offers an important advance for implementing SWMs under climate change. We test this method on three hydrologically distinct watersheds in California (Feather River, Sacramento River, Calaveras River), finding that the hybrid model performs best in larger and less flashy basins. 
    more » « less
  2. This article proposes and demonstrates a calibration-based integral formulation for resolving the forcing function in a mass–spring–damper system, given either displacement or acceleration data. The proposed method is novel in the context of vibrations, being thoroughly studied in the field of heat transfer. The approach can be expanded and generalized further to multi-variable systems associated with machine parts, vehicle suspensions, translational and rotational systems, gear systems, etc. when mathematically described by a system of constant property, linear, time-invariant ordinary differential equations. The analytic approach and subsequent numerical reconstruction of the forcing function is based on resolving a parameter-free inverse formulation for the equation(s) of motion. The calibration approach is formulated in the frequency domain and takes advantage of several observations produced by the dimensionality reduction leading to an algebratized system involving an input–output relationship and a transfer function possessing all the system parameters. The transfer function is eliminated in lieu of experimental data, from a calibration effort, thus leading to a reduction of systematic errors. These parameter-free, reduced systematic error aspects are the distinct and novel advantages of the proposed method. A first-kind Volterra integral equation is formed containing only the unknown forcing function and experimental data. As with all ill-posed problems, regularization must be introduced for system stabilization. A future-time technique is instituted for forming a family of predictions based on the chosen regularization parameter. The optimal regularization parameter is estimated using a combination of phase–plane analysis and cross-correlation principles. Finally, a numerical simulation is performed verifying the proposed approach. 
    more » « less
  3. Abstract Data limitations often challenge the reliability of water quality models, especially in intensively managed watersheds. While numerous studies report successful hydrological model setup and calibration, few have addressed in detail the data challenges for multisite and multivariable model calibration to an intensively managed watershed. In this study, we address some of these challenges based on our reflective experience calibrating the Soil and Water Assessment Tool (SWAT) to the Upper Sangamon River Watershed in central Illinois based on daily flow, annual crop yield, and monthly sediment, nitrate, and total phosphorus loads. We highlight some challenges in SWAT calibration processes due to data errors and inconsistencies, and insufficient precipitation and water quality observations. Following, we demonstrate the merits of additional weather and water quality observations that could help reduce input uncertainties, and we provide suggestions for selecting appropriate observations for the model calibration. After dealing with the data issues, we show that the SWAT model could be calibrated with acceptable results for the case study watershed. 
    more » « less
  4. ABSTRACT We develop a Bayesian model that jointly constrains receiver calibration, foregrounds, and cosmic 21 cm signal for the EDGES global 21 cm experiment. This model simultaneously describes calibration data taken in the lab along with sky-data taken with the EDGES low-band antenna. We apply our model to the same data (both sky and calibration) used to report evidence for the first star formation in 2018. We find that receiver calibration does not contribute a significant uncertainty to the inferred cosmic signal ($$\lt 1{{\ \rm per\ cent}}$$), though our joint model is able to more robustly estimate the cosmic signal for foreground models that are otherwise too inflexible to describe the sky data. We identify the presence of a significant systematic in the calibration data, which is largely avoided in our analysis, but must be examined more closely in future work. Our likelihood provides a foundation for future analyses in which other instrumental systematics, such as beam corrections and reflection parameters, may be added in a modular manner. 
    more » « less
  5. Abstract Climate models are generally calibrated manually by comparing selected climate statistics, such as the global top‐of‐atmosphere energy balance, to observations. The manual tuning only targets a limited subset of observational data and parameters. Bayesian calibration can estimate climate model parameters and their uncertainty using a larger fraction of the available data and automatically exploring the parameter space more broadly. In Bayesian learning, it is natural to exploit the seasonal cycle, which has large amplitude compared with anthropogenic climate change in many climate statistics. In this study, we develop methods for the calibration and uncertainty quantification (UQ) of model parameters exploiting the seasonal cycle, and we demonstrate a proof‐of‐concept with an idealized general circulation model (GCM). UQ is performed using the calibrate‐emulate‐sample approach, which combines stochastic optimization and machine learning emulation to speed up Bayesian learning. The methods are demonstrated in a perfect‐model setting through the calibration and UQ of a convective parameterization in an idealized GCM with a seasonal cycle. Calibration and UQ based on seasonally averaged climate statistics, compared to annually averaged, reduces the calibration error by up to an order of magnitude and narrows the spread of the non‐Gaussian posterior distributions by factors between two and five, depending on the variables used for UQ. The reduction in the spread of the parameter posterior distribution leads to a reduction in the uncertainty of climate model predictions. 
    more » « less