Abstract Mathematical models are increasingly being developed and calibrated in tandem with data collection, empowering scientists to intervene in real time based on quantitative model predictions. Well-designed experiments can help augment the predictive power of a mathematical model but the question of when to collect data to maximize its utility for a model is non-trivial. Here we define data as model-informative if it results in a unique parametrization, assessed through the lens of practical identifiability. The framework we propose identifies an optimal experimental design (how much data to collect and when to collect it) that ensures parameter identifiability (permitting confidence in model predictions), while minimizing experimental time and costs. We demonstrate the power of the method by applying it to a modified version of a classic site-of-action pharmacokinetic/pharmacodynamic model that describes distribution of a drug into the tumor microenvironment (TME), where its efficacy is dependent on the level of target occupancy in the TME. In this context, we identify a minimal set of time points when data needs to be collected that robustly ensures practical identifiability of model parameters. The proposed methodology can be applied broadly to any mathematical model, allowing for the identification of a minimally sufficient experimental design that collects the most informative data.
more »
« less
A geometric characterization of observability in inertial parameter identification
This paper presents an algorithm to geometrically characterize inertial parameter identifiability for an articulated robot. The geometric approach tests identifiability across the infinite space of configurations using only a finite set of conditions and without approximation. It can be applied to general open-chain kinematic trees ranging from industrial manipulators to legged robots, and it is the first solution for this broad set of systems that is provably correct. The high-level operation of the algorithm is based on a key observation: Undetectable changes in inertial parameters can be represented as sequences of inertial transfers across the joints. Drawing on the exponential parameterization of rigid-body kinematics, undetectable inertial transfers are analyzed in terms of observability from linear systems theory. This analysis can be applied recursively, and lends an overall complexity of O( N) to characterize parameter identifiability for a system of N bodies. Matlab source code for the new algorithm is provided.
more »
« less
- Award ID(s):
- 2220924
- PAR ID:
- 10526674
- Publisher / Repository:
- SAGE Publications
- Date Published:
- Journal Name:
- The International Journal of Robotics Research
- Volume:
- 43
- Issue:
- 14
- ISSN:
- 0278-3649
- Format(s):
- Medium: X Size: p. 2274-2302
- Size(s):
- p. 2274-2302
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This paper describes a geometric approach to parameter identifiability analysis in models of power systems dynamics. When a model of a power system is to be compared with measurements taken at discrete times, it can be interpreted as a mapping from parameter space into a data or prediction space. Generically, model mappings can be interpreted as manifolds with dimensionality equal to the number of structurally identifiable parameters. Empirically it is observed that model mappings often correspond to bounded manifolds. We propose a new definition of practical identifiability based the topological definition of a manifold with boundary. In many ways, our proposed definition extends the properties of structural identifiability. We construct numerical approximations to geodesics on the model manifold and use the results, combined with insights derived from the mathematical form of the equations, to identify combinations of practically identifiable and unidentifiable parameters. We give several examples of application to dynamic power systems models.more » « less
-
Abstract Hyporheic exchange in streams is critical to ecosystem functions such as nutrient cycling along river corridors, especially for slowly moving or small stream systems. The transient storage model (TSM) has been widely used for modeling of hyporheic exchange. TSM calibration, for hyporheic exchange, is typically used to estimate four parameters, including the mass exchange rate coefficient, the dispersion coefficient, stream cross‐sectional area, and hyporheic zone cross‐sectional area. Prior studies have raised concerns regarding the non‐uniqueness of the inverse problem for the TSM, that is, the occurrence of different parameter vectors resulting in TSM solution that reproduces the observed in‐stream tracer break through curve (BTC) with the same error. This leads to practical non‐identifiability in determining the unknown parameter vector values even when global‐optimal values exist, and the parameter optimization becomes practically non‐unique. To address this problem, we applied the simulated annealing method to calibrate the TSM to BTCs, because it is less susceptible to local minima‐induced non‐identifiability. A hypothetical (or synthetic) tracer test data set with known parameters was developed to demonstrate the capability of the simulated annealing method to find the global minimum parameter vector, and it identified the “hypothetically‐true” global minimum parameter vector even with input data that were modified with up to 10% noise without increasing the number of iterations required for convergence. The simulated annealing TSM was then calibrated using two in‐stream tracer tests conducted in East Fork Poplar Creek, Tennessee. Simulated annealing was determined to be appropriate for quantifying the TSM parameter vector because of its search capability for the global minimum parameter vector.more » « less
-
Physiologically-based pharmacokinetic (PBPK) modeling is important for studying drug delivery in the central nervous system, including determining antibody exposure, predicting chemical concentrations at target locations, and ensuring accurate dosages. The complexity of PBPK models, involving many variables and parameters, requires a consideration of parameter identifiability; i.e., which parameters can be uniquely determined from data for a specified set of concentrations. We introduce the use of a local sensitivity-based parameter subset selection algorithm in the context of a minimal PBPK (mPBPK) model of the brain for antibody therapeutics. This algorithm is augmented by verification techniques, based on response distributions and energy statistics, to provide a systematic and robust technique to determine identifiable parameter subsets in a PBPK model across a specified time domain of interest. The accuracy of our approach is evaluated for three key concentrations in the mPBPK model for plasma, brain interstitial fluid and brain cerebrospinal fluid. The determination of accurate identifiable parameter subsets is important for model reduction and uncertainty quantification for PBPK models.more » « less
-
We extend the sensitivity rank condition (SERC), which tests for identifiability of smooth input-output systems, to a broader class of systems. Particularly, we build on our recently developed lexicographic SERC (L-SERC) theory and methods to achieve an identifiability test for differential-algebraic equation (DAE) systems for the first time, including nonsmooth systems. Additionally, we develop a method to determine the identifiable and non-identifiable parameter sets. We show how this new theory can be used to establish a (non-local) parameter reduction procedure and we show how parameter estimation problems can be solved. We apply the new methods to problems in wind turbine power systems and glucose-insulin kinetics.more » « less
An official website of the United States government
