An official website of the United States government
The framework of mean-field games (MFGs) is used for modeling the collective dynamics of large populations of non-cooperative decision-making agents. We formulate and analyze a kinetic MFG model for an interacting system of non-cooperative motile agents with inertial dynamics and finite-range interactions, where each agent is minimizing a biologically inspired cost function. By analyzing the associated coupled forward–backward in a time system of nonlinear Fokker–Planck and Hamilton–Jacobi–Bellman equations, we obtain conditions for closed-loop linear stability of the spatially homogeneous MFG equilibrium that corresponds to an ordered state with non-zero mean speed. Using a combination of analysis and numerical simulations, we show that when energetic cost of control is reduced below a critical value, this equilibrium loses stability, and the system transitions to a traveling wave solution. Our work provides a game-theoretic perspective to the problem of collective motion in non-equilibrium biological and bio-inspired systems.
more »
« less
This content will become publicly available on March 1, 2026
Topological bifurcations in a mean-field game
Mean-field games (MFGs) provide a statistical physics-inspired modelling framework for decision-making in large populations of strategic, non-cooperative agents. Mathematically, these systems consist of a forwards–backwards in time-system of two coupled nonlinear partial differential equations (PDEs), namely, the Fokker–Plank (FP) and the Hamilton–Jacobi–Bellman (HJB) equations, governing the agent state and control distribution, respectively. In this work, we study a finite-time MFG with a rich global bifurcation structure using a reduced-order model (ROM). The ROM is a four-dimensional (4D) two-point boundary value problem (BVP) obtained by restricting the controlled dynamics to the first two moments of the agent state distribution, i.e. the mean and the variance. Phase space analysis of the ROM reveals that the invariant manifolds of periodic orbits around the so-called ‘ergodic MFG equilibrium’ play a crucial role in determining the bifurcation diagram and imparting a topological signature to various solution branches. We show a qualitative agreement of these results with numerical solutions of the full-order MFG PDE system.
more »
« less
- Award ID(s):
- 2102112
- PAR ID:
- 10579408
- Publisher / Repository:
- The Royal Society Publishing
- Date Published:
- Journal Name:
- Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Volume:
- 481
- Issue:
- 2310
- ISSN:
- 1471-2946
- Subject(s) / Keyword(s):
- mean field games bifurcation theory three body problem hamiltonian systems tube dynamics invariant manifolds collective behavior
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
ABSTRACT We investigate an infinite‐horizon time‐inconsistent mean‐field game (MFG) in a discrete time setting. We first present a classic equilibrium for the MFG and its associated existence result. This classic equilibrium aligns with the conventional equilibrium concept studied in MFG literature when the context is time‐consistent. Then we demonstrate that while this equilibrium produces an approximate optimal strategy when applied to the related ‐agent games, it does so solely in a precommitment sense. Therefore, it cannot function as a genuinely approximate equilibrium strategy from the perspective of a sophisticated agent within the ‐agent game. To address this limitation, we propose a newconsistentequilibrium concept in both the MFG and the ‐agent game. We show that a consistent equilibrium in the MFG can indeed function as an approximate consistent equilibrium in the ‐agent game. Additionally, we analyze the convergence of consistent equilibria for ‐agent games toward a consistent MFG equilibrium as tends to infinity.more » « less
-
We consider the problem of representing collective behavior of large popula- tions and predicting the evolution of a population distribution over a discrete state space. A discrete time mean field game (MFG) is motivated as an interpretable model founded on game theory for understanding the aggregate effect of individ- ual actions and predicting the temporal evolution of population distributions. We achieve a synthesis of MFG and Markov decision processes (MDP) by showing that a special MFG is reducible to an MDP. This enables us to broaden the scope of mean field game theory and infer MFG models of large real-world systems via deep inverse reinforcement learning. Our method learns both the reward function and forward dynamics of an MFG from real data, and we report the first empirical test of a mean field game model of a real-world social media population.more » « less
-
This paper proposes a scalable learning framework to solve a system of coupled forward–backward partial differential equations (PDEs) arising from mean field games (MFGs). The MFG system incorporates a forward PDE to model the propagation of population dynamics and a backward PDE for a representative agent’s optimal control. Existing work mainly focus on solving the mean field game equilibrium (MFE) of the MFG system when given fixed boundary conditions, including the initial population state and terminal cost. To obtain MFE efficiently, particularly when the initial population density and terminal cost vary, we utilize a physics-informed neural operator (PINO) to tackle the forward–backward PDEs. A learning algorithm is devised and its performance is evaluated on one application domain, which is the autonomous driving velocity control. Numerical experiments show that our method can obtain the MFE accurately when given different initial distributions of vehicles. The PINO exhibits both memory efficiency and generalization capabilities compared to physics-informed neural networks (PINNs).more » « less
-
This paper outlines a methodology for the construction of vector fields that can enable a multi-robot system moving on the plane to generate multiple dynamical behaviors by adjusting a single scalar parameter. This parameter essentially triggers a Hopf bifurcation in an underlying time-varying dynamical system that steers a robotic swarm. This way, the swarm can exhibit a variety of behaviors that arise from the same set of continuous differential equations. Other approaches to bifurcation-based swarm coordination rely on agent interaction which cannot be realized if the swarm members cannot sense or communicate with one another. The contribution of this paper is to offer an alternative method for steering minimally instrumented multi-robot collectives with a control strategy that can realize a multitude of dynamical behaviors without switching their constituent equations. Through this approach, analytical solutions for the bifurcation parameter are provided, even for more complex cases that are described in the literature, along with the process to apply this theory in a multi-agent setup. The theoretical predictions are confirmed via simulation and experimental results with the latter also demonstrating real-world applicability.more » « less
