skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The DOI auto-population feature in the Public Access Repository (PAR) will be unavailable from 4:00 PM ET on Tuesday, July 8 until 4:00 PM ET on Wednesday, July 9 due to scheduled maintenance. We apologize for the inconvenience caused.


Title: Nonequilibrium statistical mechanics of money/energy exchange models
Abstract Many-body dynamical models in which Boltzmann statistics can be derived directly from the underlying dynamical laws without invoking the fundamental postulates of statistical mechanics are scarce. Interestingly, one such model is found in econophysics and in chemistry classrooms: the money game, in which players exchange money randomly in a process that resembles elastic intermolecular collisions in a gas, giving rise to the Boltzmann distribution of money owned by each player. Although this model offers a pedagogical example that demonstrates the origins of Boltzmann statistics, such demonstrations usually rely on computer simulations. In fact, a proof of the exponential steady-state distribution in this model has only become available in recent years. Here, we study this random money/energy exchange model and its extensions using a simple mean-field-type approach that examines the properties of the one-dimensional random walk performed by one of its participants. We give a simple derivation of the Boltzmann steady-state distribution in this model. Breaking the time-reversal symmetry of the game by modifying its rules results in non-Boltzmann steady-state statistics. In particular, introducing ‘unfair’ exchange rules in which a poorer player is more likely to give money to a richer player than to receive money from that richer player, results in an analytically provable Pareto-type power-law distribution of the money in the limit where the number of players is infinite, with a finite fraction of players in the ‘ground state’ (i.e. with zero money). For a finite number of players, however, the game may give rise to a bimodal distribution of money and to bistable dynamics, in which a participant’s wealth jumps between poor and rich states. The latter corresponds to a scenario where the player accumulates nearly all the available money in the game. The time evolution of a player’s wealth in this case can be thought of as a ‘chemical reaction’, where a transition between ‘reactants’ (rich state) and ‘products’ (poor state) involves crossing a large free energy barrier. We thus analyze the trajectories generated from the game using ideas from the theory of transition paths and highlight non-Markovian effects in the barrier crossing dynamics.  more » « less
Award ID(s):
1955552
PAR ID:
10498356
Author(s) / Creator(s):
; ;
Publisher / Repository:
IOP Publishing
Date Published:
Journal Name:
Journal of Physics A: Mathematical and Theoretical
Volume:
57
Issue:
15
ISSN:
1751-8113
Format(s):
Medium: X Size: Article No. 155003
Size(s):
Article No. 155003
Sponsoring Org:
National Science Foundation
More Like this
  1. ABSTRACT Chemical exchange line broadening is an important phenomenon in nuclear magnetic resonance (NMR) spectroscopy, in which a nuclear spin experiences more than one magnetic environment as a result of chemical or conformational changes of a molecule. The dynamic process of chemical exchange strongly affects the sensitivity and resolution of NMR experiments and increasingly provides a powerful probe of the interconversion between chemical and conformational states of proteins, nucleic acids, and other biologic macromolecules. A simple and often used theoretic description of chemical exchange in NMR spectroscopy is based on an idealized 2-state jump model (the random phase or telegraph signal). However, chemical exchange can also be represented as a barrier crossing event that can be modeled by using chemical reaction rate theory. The timescale of crossing is determined by the barrier height, the temperature, and the dissipation modeled as collisional or frictional damping. This tutorial explores the connection between the NMR theory of chemical exchange line broadening and strong collision models for chemical kinetics in statistical mechanics. Theoretic modeling and numeric simulation are used to map the rate of barrier crossing dynamics of a particle on a potential energy surface to the chemical exchange relaxation rate constant. By developing explicit models for the exchange dynamics, the tutorial aims to elucidate the underlying dynamical processes that give rise to the rich phenomenology of chemical exchange observed in NMR spectroscopy. Software for generating and analyzing the numeric simulations is provided in the form of Python and Fortran source codes. 
    more » « less
  2. The goal of the paper is to develop the theory of finite state mean field games with major and minor players when the state space of the game is finite. We introduce the finite player games and derive a mean field game formulation in the limit when the number of minor players tends to infinity. In this limit, we prove that the value functions of the optimization problems are viscosity solutions of PIDEs of the HJB type, and we construct the best responses for both types of players. From there, we prove existence of Nash equilibria under reasonable assumptions. Finally we prove that a form of propagation of chaos holds in the present context and use this result to prove existence of approximate Nash equilibria for the finite player games from the solutions of the mean field games. this vindicate our formulation of the mean field game problem. 
    more » « less
  3. We study a dynamical system defined by a repeated game on a 1D lattice, in which the players keep track of their gross payoffs over time in a bank. Strategy updates are governed by a Boltzmann distribution, which depends on the neighborhood bank values associated with each strategy, relative to a temperature scale, which defines the random fluctuations. Players with higher bank values are, thus, less likely to change strategy than players with a lower bank value. For a parameterized rock–paper–scissors game, we derive a condition under which communities of a given strategy form with either fixed or drifting boundaries. We show the effect of a temperature increase on the underlying system and identify surprising properties of this model through numerical simulations. 
    more » « less
  4. null (Ed.)
    This paper investigates the use of model-free reinforcement learning to compute the optimal value in two-player stochastic games with parity objectives. In this setting, two decision makers, player Min and player Max, compete on a finite game arena - a stochastic game graph with unknown but fixed probability distributions - to minimize and maximize, respectively, the probability of satisfying a parity objective. We give a reduction from stochastic parity games to a family of stochastic reachability games with a parameter ε, such that the value of a stochastic parity game equals the limit of the values of the corresponding simple stochastic games as the parameter ε tends to 0. Since this reduction does not require the knowledge of the probabilistic transition structure of the underlying game arena, model-free reinforcement learning algorithms, such as minimax Q-learning, can be used to approximate the value and mutual best-response strategies for both players in the underlying stochastic parity game. We also present a streamlined reduction from 1 1/2-player parity games to reachability games that avoids recourse to nondeterminism. Finally, we report on the experimental evaluations of both reductions 
    more » « less
  5. In a recent work, Moshkovitz [FOCS '14] presented a transformation on two-player games called ``fortification'', and gave an elementary proof of an (exponential decay) parallel repetition theorem for fortified two-player projection games. In this paper, we give an \emph{analytic reformulation} of Moshkovitz's fortification framework, which was originally cast in combinatorial terms. This reformulation allows us to expand the scope of the fortification method to new settings. First, we show \emph{any} game (not just projection games) can be fortified, and give a simple proof of parallel repetition for general fortified games. Then, we prove parallel repetition and fortification theorems for games with players sharing quantum entanglement, as well as games with more than two players. This gives a new gap amplification method for general games in the quantum and multiplayer settings, two problems which have recently received much attention. An important component of our work is a variant of the fortification transformation, called ``ordered fortification", that preserves the entangled value of a game. The original fortification of Moshkovitz does not in general preserve the entangled value of a game, and this was a barrier to extending the fortification framework to the quantum setting. 
    more » « less