skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 8:00 PM ET on Friday, March 21 until 8:00 AM ET on Saturday, March 22 due to maintenance. We apologize for the inconvenience.


Title: Multiblock Parameter Calibration in Computer Models

Parameter calibration aims to estimate unobservable parameters used in a computer model by using physical process responses and computer model outputs. In the literature, existing studies calibrate all parameters simultaneously using an entire data set. However, in certain applications, some parameters are associated with only a subset of data. For example, in the building energy simulation, cooling (heating) season parameters should be calibrated using data collected during the cooling (heating) season only. This study provides a new multiblock calibration approach that considers such heterogeneity. Unlike existing studies that build emulators for the computer model response, such as the widely used Bayesian calibration approach, we consider multiple loss functions to be minimized, each for a block of parameters that use the corresponding data set, and estimate the parameters using a nonlinear optimization technique. We present the convergence properties under certain conditions and quantify the parameter estimation uncertainties. The superiority of our approach is demonstrated through numerical studies and a real-world building energy simulation case study.

History: Bianca Maria Colosimo served as the senior editor for this article.

Funding: This work was partially supported by the National Science Foundation [Grants CMMI-1662553, CMMI-2226348, and CBET-1804321].

Data Ethics & Reproducibility Note: The code capsule is available on Code Ocean at https://codeocean.com/capsule/8623151/tree/v1 and in the e-Companion to this article (available at https://doi.org/10.1287/ijds.2023.0029 ).

 
more » « less
Award ID(s):
2226348
PAR ID:
10481380
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
INFORMS
Date Published:
Journal Name:
INFORMS Journal on Data Science
Volume:
2
Issue:
2
ISSN:
2694-4022
Page Range / eLocation ID:
116 to 137
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. As the energy consumption from residential and commercial buildings makes up approximately three-quarters of the U.S. electricity loads, analyzing building energy consumption behavior becomes essential for effective power grid operation. An accurate physics-based building energy simulator that is built on first principles can predict an individual building’s energy response, such as energy consumption and indoor environmental conditions under different weather and operational control scenarios. In the building energy simulator, several parameters that specify building characteristics need to be set a priori. Among those parameters, some parameters are season-dependent, whereas other parameters should be globally employed throughout a year. Existing studies in parameter calibration ignore such heterogeneity, which causes suboptimal calibration results. This study presents a new calibration approach that considers the seasonal dependency. 
    more » « less
  2. Simulation models of critical systems often have parameters that need to be calibrated using observed data. For expensive simulation models, calibration is done using an emulator of the simulation model built on simulation output at different parameter settings. Using intelligent and adaptive selection of parameters to build the emulator can drastically improve the efficiency of the calibration process. The article proposes a sequential framework with a novel criterion for parameter selection that targets learning the posterior density of the parameters. The emergent behavior from this criterion is that exploration happens by selecting parameters in uncertain posterior regions while simultaneously exploitation happens by selecting parameters in regions of high posterior density. The advantages of the proposed method are illustrated using several simulation experiments and a nuclear physics reaction model. 
    more » « less
  3. We consider a common problem occurring after using a statistical process control (SPC) method based on three-dimensional measurements: locate where on the surface of the part that triggered an out-of-control alarm there is a significant shape difference with respect to either an in-control part or its nominal (computer-aided design (CAD)) design. In the past, only registration-based solutions existed for this problem, which first orient and locate the part and its nominal design under the same frame of reference. Recently, spectral Laplacian methods have been proposed for the SPC of discrete parts and their measured surface meshes. These techniques provide an intrinsic solution to the SPC problem: that is, a solution exclusively based on data whose coordinates lie on the surfaces without making reference to their ambient space, thus avoiding registration. Registration-free methods avoid the computationally expensive, nonconvex registration step needed to align the parts as required by previous methods, eliminating registration errors, and they are important in industry because of the increasing use of portable noncontact scanners. In this paper, we first present a new registration-free solution to the post-SPC part defect localization problem. The approach uses a spectral decomposition of the Laplace–Beltrami operator in order to construct a functional map between the CAD and measured manifolds to locate defects on the suspected part. A computational complexity analysis demonstrates the approach scales better with the mesh size and is more stable than a registration-based approach. To reduce computational expense, a new mesh partitioning algorithm is presented to find a region of interest on the surface of the part where defects are more likely to exist. The functional map method involves a large number of point-to-point comparisons based on noisy measurements, and a new statistical thresholding method used to filter the false positives in the underlying massive multiple comparisons problem is also provided.

    Funding: This research was partially funded by the National Science Foundation [Grant CMMI 2121625].

    Data Ethics & Reproducibility Note: There are no data ethics considerations. The code capsule is available on Code Ocean at https://codeocean.com/capsule/4615101/tree/v1 and in the e-Companion to this article (available https://doi.org/10.1287/ijds.2023.0030 ).

     
    more » « less
  4. The participation of residents plays a key role in residential energy saving strategies because they make decisions on how to operate building heating and cooling systems. Eco-feedback is an effective tool to motivate energy conserving behaviours (ECBs) by providing information on energy efficiency and associated benefits. The main purpose of this study is to develop an online data-driven building energy model to evaluate heating and cooling-related behaviour changes for eco-feedback design in a multifamily residential building. A grey-box state-space model is presented that is updated with realtime data using a particle filter approach. The model accounts for the evolution of parameters and captures the unobserved inter-unit heat transfer without modelling the whole building thermal network through sequential Bayesian update. The model is developed and validated using data collected in an actual multifamily residential building 
    more » « less
  5. null (Ed.)
    Abstract Computer model calibration typically operates by fine-tuning parameter values in a computer model so that the model output faithfully predicts reality. By using performance targets in place of observed data, we show that calibration techniques can be repurposed for solving multi-objective design problems. Our approach allows us to consider all relevant sources of uncertainty as an integral part of the design process. We demonstrate our proposed approach through both simulation and fine-tuning material design settings to meet performance targets for a wind turbine blade. 
    more » « less