skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: DESIGN OF EXPERIMENTS VIA MULTI-FIDELITY SURROGATES AND STATISTICAL SENSITIVITY MEASURES
Parameter estimation and optimal experimental design problems have been widely studied across scienceand engineering. The two are inextricably linked, with optimally designed experiments leading to better-estimated parameters. This link becomes even more crucial when available experiments produce minimal data due to practical constraints of limited experimental budgets. This work presents a novel framework that allows for the identification of optimal experimental arrangement, from a finite set of possibilities, for precise parameter estimation. The proposed framework relies on two pillars. First, we use multi-fidelity modeling to create reliable surrogates that relate unknown parameters to a measurable quantity of interest for a multitude of available choices defined through a set of candidate control vectors. Secondly, we quantify the estimation potential of an arrangement from the set of control vectors through the examination of statistical sensitivity measures calculated from the constructed surrogates. The measures of sensitivity are defined using analysis of variance as well as directional statistics. Two numerical examples are provided, where we demonstrate how the correlation between the estimation potential and the frequency of precise parameter estimation can inform the choice of optimal arrangement.  more » « less
Award ID(s):
2208277
PAR ID:
10621785
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
begell house
Date Published:
Journal Name:
Journal of Machine Learning for Modeling and Computing
Volume:
5
Issue:
4
ISSN:
2689-3967
Page Range / eLocation ID:
95 to 121
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Model-based approaches to navigation, control, and fault detection that utilize precise nonlinear models of vehicle plant dynamics will enable more accurate control and navigation, assured autonomy, and more complex missions for such vehicles. This paper reports novel theoretical and experimental results addressing the problem of parameter estimation of plant and actuator models for underactuated underwater vehicles operating in 6 degrees-of-freedom (DOF) whose dynamics are modeled by finite-dimensional Newton-Euler equations. This paper reports the first theoretical approach and experimental validation to identify simultaneously plant-model parameters (parameters such as mass, added mass, hydrodynamic drag, and buoyancy) and control-actuator parameters (control-surface models and thruster models) in 6-DOF. Most previously reported studies on parameter identification assume that the control-actuator parameters are known a priori. Moreover, this paper reports the first proof of convergence of the parameter estimates to the true set of parameters for this class of vehicles under a persistence of excitation condition. The reported adaptive identification (AID) algorithm does not require instrumentation of 6-DOF vehicle acceleration, which is required by conventional approaches to parameter estimation such as least squares. Additionally, the reported AID algorithm is applicable under any arbitrary open-loop or closed-loop control law. We report simulation and experimental results for identifying the plant-model and control-actuator parameters for an L3 OceanServer Iver3 autonomous underwater vehicle. We believe this general approach to AID could be extended to apply to other classes of machines and other classes of marine, land, aerial, and space vehicles. 
    more » « less
  2. Abstract This paper addresses the parameter estimation problem for lithium-ion battery pack models comprising cells in series. This valuable information can be exploited in fault diagnostics to estimate the number of cells that are exhibiting abnormal behaviour, e.g. large resistances or small capacities. In particular, we use a Bayesian approach to estimate the parameters of a two-cell arrangement modelled using equivalent circuits. Although our modeling framework has been extensively reported in the literature, its structural identifiability properties have not been reported yet to the best of the authors’ knowledge. Moreover, most contributions in the literature tackle the estimation problem through point-wise estimates assuming Gaussian noise using e.g. least-squares methods (maximum likelihood estimation) or Kalman filters (maximum a posteriori estimation). In contrast, we apply methods that are suitable for nonlinear and non-Gaussian estimation problems and estimate the full posterior probability distribution of the parameters. We study how the model structure, available measurements and prior knowledge of the model parameters impact the underlying posterior probability distribution that is recovered for the parameters. For two cells in series, a bimodal distribution is obtained whose modes are centered around the real values of the parameters for each cell. Therefore, bounds on the model parameters for a battery pack can be derived. 
    more » « less
  3. Emerging lithium-ion battery systems require high-fidelity electrochemical models for advanced control, diagnostics, and design. Accordingly, battery parameter estimation is an active research domain where novel algorithms are being developed to calibrate complex models from input-output data. Amidst these efforts, little focus has been placed on the fundamental mechanisms governing estimation accuracy, spurring the question, why is an estimate accurate or inaccurate? In response, we derive a generalized estimation error equation under the commonly adopted least-squares objective function, which reveals that the error can be represented as a combination of system uncertainties (i.e., in model, measurement, and parameter) and uncertainty-propagating sensitivity structures in the data. We then relate the error equation to conventional error analysis criteria, such as the Fisher information matrix, CramĂ©r-Rao bound, and parameter sensitivity, to assess the benefits and limitations of each. The error equation is validated through several uni- and bivariate estimations of lithium-ion battery electrochemical parameters using experimental data. These results are also analyzed with the error equation to study the error compositions and parameter identifiability under different data. Finally, we show that adding target parameters to the estimation without increasing the amount of data intrinsically reduces the robustness of the results to system uncertainties. 
    more » « less
  4. Abstract. Spatially distributed hydrological models are commonly employed to optimize the locations of engineering control measures across a watershed. Yet, parameter screening exercises that aim to reduce the dimensionality of the calibration search space are typically completed only for gauged locations, like the watershed outlet, and use screening metrics that are relevant to calibration instead of explicitly describing the engineering decision objectives. Identifying parameters that describe physical processes in ungauged locations that affect decision objectives should lead to a better understanding of control measure effectiveness. This paper provides guidance on evaluating model parameter uncertainty at the spatial scales and flow magnitudes of interest for such decision-making problems. We use global sensitivity analysis to screen parameters for model calibration, and to subsequently evaluate the appropriateness of using multipliers to adjust the values of spatially distributed parameters to further reduce dimensionality. We evaluate six sensitivity metrics, four of which align with decision objectives and two of which consider model residual error that would be considered in spatial optimizations of engineering designs. We compare the resulting parameter selection for the basin outlet and each hillslope. We also compare basin outlet results for four calibration-relevant metrics. These methods were applied to a RHESSys ecohydrological model of an exurban forested watershed near Baltimore, MD, USA. Results show that (1) the set of parameters selected by calibration-relevant metrics does not include parameters that control decision-relevant high and low streamflows, (2) evaluating sensitivity metrics at the basin outlet misses many parameters that control streamflows in hillslopes, and (3) for some multipliers, calibrating all parameters in the set being adjusted may be preferable to using the multiplier if parameter sensitivities are significantly different, while for others, calibrating a subset of the parameters may be preferable if they are not all influential. Thus, we recommend that parameter screening exercises use decision-relevant metrics that are evaluated at the spatial scales appropriate to decision making. While including more parameters in calibration will exacerbate equifinality, the resulting parametric uncertainty should be important to consider in discovering control measures that are robust to it. 
    more » « less
  5. Yamashita, Y.; Kano, M. (Ed.)
    Patterned charged membranes with engendered useful characteristics can offer selective transport of electrolytes. Chemical patterning across the membrane surface via a physical inkjet deposition process requires precise control of the reactive-ink formulation, which enables the introduction of charged functionality to the membrane. This study develops a new dynamic mathematical model for the primary step of the batch reactive-ink formulation considering an ink mixture of copper sulphate and ascorbic acid. Nonlinear least squares parameter estimation is performed to infer three kinetic model parameters by analysing data from nine dynamic experiments simultaneously. Global sensitivity and Fisher information matrix (FIM) analyses reveal only one kinetic parameter is identifiable from time-series pH measurements. The fitted model can capture the overall nonlinear dynamics of the batch reaction and works best for initial Cu2 + concentrations between 30 and 50 mM. Time-series Cu2 + or Cu+ concentration measurements are recommended in future experiments to elucidate the kinetics of reactive-ink formulation. 
    more » « less