skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: When you can’t count, sample!: Computable entropies beyond equilibrium from basin volumes
In statistical mechanics, measuring the number of available states and their probabilities, and thus the system’s entropy, enables the prediction of the macroscopic properties of a physical system at equilibrium. This predictive capacity hinges on the knowledge of the a priori probabilities of observing the states of the system, given by the Boltzmann distribution. Unfortunately, the successes of equilibrium statistical mechanics are hardto replicate out of equilibrium, where the a priori probabilities of observing states are, in general, not known, precluding the naı̈ve application of common tools. In the last decade, exciting developments have occurred that enable direct numerical estimation of the entropy and density of states of athermal and non-equilibrium systems, thanks to significant methodological advances in the computation of the volume of high-dimensional basins of attraction. Here, we provide a detailed account of these methods, underscoring the challenges present in such estimations, recent progress on the matter, and promising directions for future work.  more » « less
Award ID(s):
2226387
PAR ID:
10397534
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Papers in Physics
Volume:
15
ISSN:
1852-4249
Page Range / eLocation ID:
150001
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, Optics Letters)
    By utilizing notions from statistical mechanics, we develop a general and self-consistent theoretical framework capable of describing any weakly nonlinear optical multimode system involving conserved quantities. We derive the fundamental relations that govern the grand canonical ensemble through maximization of the Gibbs entropy at equilibrium. In this classical picture of statistical photo-mechanics, we obtain analytical expressions for the probability distribution, the grand partition function, and the relevant thermodynamic potentials. Our results universally apply to any other weakly nonlinear multimode bosonic system. 
    more » « less
  2. (, Journal of Physics: Condensed Matter)
    Abstract Today’s thermodynamics is largely based on the combined law for equilibrium systems and statistical mechanics derived by Gibbs in 1873 and 1901, respectively, while irreversible thermodynamics for nonequilibrium systems resides essentially on the Onsager Theorem as a separate branch of thermodynamics developed in 1930s. Between them, quantum mechanics was invented and quantitatively solved in terms of density functional theory (DFT) in 1960s. These three scientific domains operate based on different principles and are very much separated from each other. In analogy to the parable of the blind men and the elephant articulated by Perdew, they individually represent different portions of a complex system and thus are incomplete by themselves alone, resulting in the lack of quantitative agreement between their predictions and experimental observations. Over the last two decades, the author’s group has developed a multiscale entropy approach (recently termed as zentropy theory) that integrates DFT-based quantum mechanics and Gibbs statistical mechanics and is capable of accurately predicting entropy and free energy of complex systems. Furthermore, in combination with the combined law for nonequilibrium systems presented by Hillert, the author developed the theory of cross phenomena beyond the phenomenological Onsager Theorem. The zentropy theory and theory of cross phenomena jointly provide quantitative predictive theories for systems from electronic to any observable scales as reviewed in the present work. 
    more » « less
  3. ; (, Physical Review Letters)
    It has been shown that entropy differences between certain states of perturbative quantum gravity can be computed without specifying an ultraviolet completion. This is analogous to the situation in classical statistical mechanics, where entropy differences are defined but absolute entropy is not. Unlike in classical statistical mechanics, however, the entropy differences computed in perturbative quantum gravity do not have a clear physical interpretation. Here we construct a family of perturbative black hole states for which the entropy difference can be interpreted as a relative counting of states. Conceptually, this Letter begins with the algebra of mass fluctuations around a fixed black hole background, and points out that while this is a type I algebra, it is not a factor and therefore has no canonical definition of entropy. As in previous work, coupling the mass fluctuations to quantum matter embeds the mass algebra within a type II factor, in which entropy differences (but not absolute entropies) are well defined. It is then shown that for microcanonical wave functions of mass fluctuation, the type II entropy difference equals the logarithm of the dimension of the extra Hilbert space that is needed to map one microcanonical window to another using gauge-invariant unitaries. The Letter closes with comments on type II entropy difference in a more general class of states, where the von Neumann entropy difference does not have a physical interpretation, but “one-shot” entropy differences do. Published by the American Physical Society2024 
    more » « less
  4. ; (, Proceedings of the National Academy of Sciences)
    Active matter systems, from self-propelled colloids to motile bacteria, are characterized by the conversion of free energy into useful work at the microscopic scale. They involve physics beyond the reach of equilibrium statistical mechanics, and a persistent challenge has been to understand the nature of their nonequilibrium states. The entropy production rate and the probability current provide quantitative ways to do so by measuring the breakdown of time-reversal symmetry. Yet, their efficient computation has remained elusive, as they depend on the system’s unknown and high-dimensional probability density. Here, building upon recent advances in generative modeling, we develop a deep learning framework to estimate the score of this density. We show that the score, together with the microscopic equations of motion, gives access to the entropy production rate, the probability current, and their decomposition into local contributions from individual particles. To represent the score, we introduce a spatially local transformer network architecture that learns high-order interactions between particles while respecting their underlying permutation symmetry. We demonstrate the broad utility and scalability of the method by applying it to several high-dimensional systems of active particles undergoing motility-induced phase separation (MIPS). We show that a single network trained on a system of 4,096 particles at one packing fraction can generalize to other regions of the phase diagram, including to systems with as many as 32,768 particles. We use this observation to quantify the spatial structure of the departure from equilibrium in MIPS as a function of the number of particles and the packing fraction. 
    more » « less
  5. ; (, Journal of Physics A: Mathematical and Theoretical)
    Abstract Statistical thermodynamics is valuable as a conceptual structure that shapes our thinking about equilibrium thermodynamic states. A cloud of unresolved questions surrounding the foundations of the theory could lead an impartial observer to conclude that statistical thermodynamics is in a state of crisis though. Indeed, the discussion about the microscopic origins of irreversibility has continued in the scientific community for more than a hundred years. This paper considers these questions while beginning to develop a statistical thermodynamics for finite non-equilibrium systems. Definitions are proposed for all of the extrinsic variables of the fundamental thermodynamic relation that are consistent with existing results in the equilibrium thermodynamic limit. The probability density function on the phase space is interpreted as a subjective uncertainty about the microstate, and the Gibbs entropy formula is modified to allow for entropy creation without introducing additional physics or modifying the phase space dynamics. Resolutions are proposed to the mixing paradox, Gibbs’ paradox, Loschmidt’s paradox, and Maxwell’s demon thought experiment. Finally, the extrinsic variables of the fundamental thermodynamic relation are evaluated as functions of time and space for a diffusing ideal gas, and the initial and final values are shown to coincide with the expected equilibrium values. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email