skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Information geometry for multiparameter models: new perspectives on the origin of simplicity
Abstract Complex models in physics, biology, economics, and engineering are often sloppy , meaning that the model parameters are not well determined by the model predictions for collective behavior. Many parameter combinations can vary over decades without significant changes in the predictions. This review uses information geometry to explore sloppiness and its deep relation to emergent theories. We introduce the model manifold of predictions, whose coordinates are the model parameters. Its hyperribbon structure explains why only a few parameter combinations matter for the behavior. We review recent rigorous results that connect the hierarchy of hyperribbon widths to approximation theory, and to the smoothness of model predictions under changes of the control variables. We discuss recent geodesic methods to find simpler models on nearby boundaries of the model manifold—emergent theories with fewer parameters that explain the behavior equally well. We discuss a Bayesian prior which optimizes the mutual information between model parameters and experimental data, naturally favoring points on the emergent boundary theories and thus simpler models. We introduce a ‘projected maximum likelihood’ prior that efficiently approximates this optimal prior, and contrast both to the poor behavior of the traditional Jeffreys prior. We discuss the way the renormalization group coarse-graining in statistical mechanics introduces a flow of the model manifold, and connect stiff and sloppy directions along the model manifold with relevant and irrelevant eigendirections of the renormalization group. Finally, we discuss recently developed ‘intensive’ embedding methods, allowing one to visualize the predictions of arbitrary probabilistic models as low-dimensional projections of an isometric embedding, and illustrate our method by generating the model manifold of the Ising model.  more » « less
Award ID(s):
1753357 1834332
PAR ID:
10404588
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Reports on Progress in Physics
Volume:
86
Issue:
3
ISSN:
0034-4885
Page Range / eLocation ID:
035901
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract In this article we review how categorical equivalences are realized by renormalization group flow in physical realizations of stacks, derived categories, and derived schemes. We begin by reviewing the physical realization of sigma models on stacks, as (universality classes of) gauged sigma models, and look in particular at properties of sigma models on gerbes (equivalently, sigma models with restrictions on nonperturbative sectors), and ‘decomposition,’ in which two‐dimensional sigma models on gerbes decompose into disjoint unions of ordinary theories. We also discuss stack structures on examples of moduli spaces of SCFTs, focusing on elliptic curves, and implications of subtleties there for string dualities in other dimensions. In the second part of this article, we review the physical realization of derived categories in terms of renormalization group flow (time evolution) of combinations of D‐branes, antibranes, and tachyons. In the third part of this article, we review how Landau–Ginzburg models provide a physical realization of derived schemes, and also outline an example of a derived structure on a moduli spaces of SCFTs. 
    more » « less
  2. In this paper, we consider the problem of quantifying parametric uncertainty in classical empirical interatomic potentials (IPs) using both Bayesian (Markov Chain Monte Carlo) and frequentist (profile likelihood) methods. We interface these tools with the Open Knowledgebase of Interatomic Models and study three models based on the Lennard-Jones, Morse, and Stillinger–Weber potentials. We confirm that IPs are typically sloppy, i.e., insensitive to coordinated changes in some parameter combinations. Because the inverse problem in such models is ill-conditioned, parameters are unidentifiable. This presents challenges for traditional statistical methods, as we demonstrate and interpret within both Bayesian and frequentist frameworks. We use information geometry to illuminate the underlying cause of this phenomenon and show that IPs have global properties similar to those of sloppy models from fields, such as systems biology, power systems, and critical phenomena. IPs correspond to bounded manifolds with a hierarchy of widths, leading to low effective dimensionality in the model. We show how information geometry can motivate new, natural parameterizations that improve the stability and interpretation of uncertainty quantification analysis and further suggest simplified, less-sloppy models. 
    more » « less
  3. This paper describes a geometric approach to parameter identifiability analysis in models of power systems dynamics. When a model of a power system is to be compared with measurements taken at discrete times, it can be interpreted as a mapping from parameter space into a data or prediction space. Generically, model mappings can be interpreted as manifolds with dimensionality equal to the number of structurally identifiable parameters. Empirically it is observed that model mappings often correspond to bounded manifolds. We propose a new definition of practical identifiability based the topological definition of a manifold with boundary. In many ways, our proposed definition extends the properties of structural identifiability. We construct numerical approximations to geodesics on the model manifold and use the results, combined with insights derived from the mathematical form of the equations, to identify combinations of practically identifiable and unidentifiable parameters. We give several examples of application to dynamic power systems models. 
    more » « less
  4. A bstract We analyze, in perturbation theory, a theory of weakly interacting fractons and non-relativistic fermions in a 2+1 dimensional Quantum Field Theory. In particular we compute the 1-loop corrections to the self energies and interaction vertex, and calculate the associated 1-loop Renormalization Group flows of the coupling constants. Surprisingly, we find that the fracton-fermion coupling does not flow due to an emergent coordinate-dependent symmetry of the effective Lagrangian, making this model a well-defined quantum field theory. We provide additional discussions on the regularization and renormalization of interacting fractonic theories, as well as both qualitative and quantitative remarks regarding the theory at finite temperature and finite chemical potential. 
    more » « less
  5. We discuss some higher-loop studies of renormalization-group flows and fixed points in various quantum field theories 
    more » « less