skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Parameter Estimation in the Age of Degeneracy and Unidentifiability
Parameter estimation from observable or experimental data is a crucial stage in any modeling study. Identifiability refers to one’s ability to uniquely estimate the model parameters from the available data. Structural unidentifiability in dynamic models, the opposite of identifiability, is associated with the notion of degeneracy where multiple parameter sets produce the same pattern. Therefore, the inverse function of determining the model parameters from the data is not well defined. Degeneracy is not only a mathematical property of models, but it has also been reported in biological experiments. Classical studies on structural unidentifiability focused on the notion that one can at most identify combinations of unidentifiable model parameters. We have identified a different type of structural degeneracy/unidentifiability present in a family of models, which we refer to as the Lambda-Omega (Λ-Ω) models. These are an extension of the classical lambda-omega (λ-ω) models that have been used to model biological systems, and display a richer dynamic behavior and waveforms that range from sinusoidal to square wave to spike like. We show that the Λ-Ω models feature infinitely many parameter sets that produce identical stable oscillations, except possible for a phase shift (reflecting the initial phase). These degenerate parameters are not identifiable combinations of unidentifiable parameters as is the case in structural degeneracy. In fact, reducing the number of model parameters in the Λ-Ω models is minimal in the sense that each one controls a different aspect of the model dynamics and the dynamic complexity of the system would be reduced by reducing the number of parameters. We argue that the family of Λ-Ω models serves as a framework for the systematic investigation of degeneracy and identifiability in dynamic models and for the investigation of the interplay between structural and other forms of unidentifiability resulting on the lack of information from the experimental/observational data.  more » « less
Award ID(s):
1608077 1715808
PAR ID:
10387689
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Mathematics
Volume:
10
Issue:
2
ISSN:
2227-7390
Page Range / eLocation ID:
170
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper describes a geometric approach to parameter identifiability analysis in models of power systems dynamics. When a model of a power system is to be compared with measurements taken at discrete times, it can be interpreted as a mapping from parameter space into a data or prediction space. Generically, model mappings can be interpreted as manifolds with dimensionality equal to the number of structurally identifiable parameters. Empirically it is observed that model mappings often correspond to bounded manifolds. We propose a new definition of practical identifiability based the topological definition of a manifold with boundary. In many ways, our proposed definition extends the properties of structural identifiability. We construct numerical approximations to geodesics on the model manifold and use the results, combined with insights derived from the mathematical form of the equations, to identify combinations of practically identifiable and unidentifiable parameters. We give several examples of application to dynamic power systems models. 
    more » « less
  2. Abstract We prove that, for an undirected graph with n vertices and m edges, each labeled with a linear function of a parameter $$\lambda $$ λ , the number of different minimum spanning trees obtained as the parameter varies can be $$\Omega (m\log n)$$ Ω ( m log n ) . 
    more » « less
  3. Abstract—We describe a method for simultaneously identifying and reducing dynamic power systems models in the form of differential-algebraic equations. Often, these models are large and complex, containing more parameters than can be identified from the available system measurements. We demonstrate our method on transient stability models, using the IEEE 14-bus test system. Our approach uses techniques of information geometry to remove unidentifiable parameters from the model. We examine the case of a networked system with 58 parameters using full observations throughout the network. We show that greater reduction can be achieved when only partial observations are available, including reduction of the network itself. Index Terms—Parameter Estimation, Reduced Order Systems, System Identification. 
    more » « less
  4. Proportion variables, also known as compositional data, are very common in ecology. Unfortunately, few scientists are aware of how compositional data, when used as covariates, can adversely impact statistical analysis. We describe here how proportion covariates result in multicollinearity and parameter identifiability problems. Using simulated data on bird species richness as a function of land use, we show how these problems manifest when fitting a wide range of models in R, both in a frequentist and Bayesian framework. In particular, we show that similar models can often generate substantially different parameter estimates, leading to very different conclusions. Dropping a covariate or the intercept from the model can solve the multicollinearity and parameter identifiability problems. Unfortunately, these solutions do not fix the inherent challenges associated with interpreting parameter estimates. To this end, we propose focusing the interpretation on the difference of slope parameters to avoid the inherent unidentifiability of individual parameters. We also propose conditional plots with two‐axes and marginal plots as visualization techniques that can help users better interpret their modeling results. We illustrate these problems and proposed solutions using empirical data from the North American Breeding Bird Survey. The practical and straightforward approaches suggested in this article will help the fitting of linear models and interpretation of its results when some of the covariates are proportions. 
    more » « less
  5. The many-body localised (MBL) to thermal crossover observed in exactdiagonalisation studies remains poorly understood as the accessiblesystem sizes are too small to be in an asymptotic scaling regime.We develop a model of the crossover in short 1D chains in which theMBL phase is destabilised by the formation of many-body resonances.The model reproduces several properties of the numerically observedcrossover, including an apparent correlation length exponent \nu=1 ν = 1 ,exponential growth of the Thouless time with disorder strength, lineardrift of the critical disorder strength with system size, scale-freeresonances, apparent 1/\omega 1 / ω dependence of disorder-averaged spectral functions, and sub-thermalentanglement entropy of small subsystems.In the crossover, resonances induced by a local perturbation are rareat numerically accessible system sizes L L which are smaller than a \lambda λ .For L \gg \sqrt{\lambda} L ≫ λ (in lattice units), resonances typically overlap, and this model doesnot describe the asymptotic transition.The model further reproduces controversial numerical observationswhich Refs. claimed to be inconsistent with MBL. We thus argue that thenumerics to date is consistent with a MBL phase in the thermodynamiclimit. 
    more » « less