skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


This content will become publicly available on July 7, 2026

Title: Extended Mean Field Type Control Theory: A Master Equation Approach With Some Applications
The primary objective of this article is to present a general framework for users and applications of the master equation approach in extended mean field type control, for- mulated with a McKean-Vlasov stochastic differential equation that depends on the law of both the control and state variables. This control problem has recently gained significant attention and has been extensively studied at the level of the Bellman equa- tion. Here, we extend the analysis to the master equation and derive the corresponding Hamilton-Jacobi-Bellman equation. A key novelty of our approach is that we do not directly rely on the Fokker-Planck equation, which surprisingly leads to a significant simplification. We provide a concise theoretical presentation with proofs, as the stan- dard theory of stochastic control is not directly applicable. In the current work, the solution is constructed using an ansatz-based approach to dynamic programming via the master equation.We illustrate this method with a practical example. All proofs are presented in a self-contained manner. This paper offers a structured presentation of the extended mean field type control problem, serving as a valuable toolbox for users who are less focused on mathematical intricacies but seek a general framework for application.  more » « less
Award ID(s):
2204795
PAR ID:
10627983
Author(s) / Creator(s):
; ;
Publisher / Repository:
Springer Verlag
Date Published:
Journal Name:
Journal of optimization theory and applications
ISSN:
1573-2878
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, ESAIM: Control, Optimisation and Calculus of Variations)
    Buttazzo, G.; Casas, E.; de Teresa, L.; Glowinski, R.; Leugering, G.; Trélat, E.; Zhang, X. (Ed.)
    In our present article, we follow our way of developing mean field type control theory in our earlier works [Bensoussanet al., Mean Field Games and Mean Field Type Control Theory.Springer, New York (2013)], by first introducing the Bellman and then master equations, the system of Hamilton-Jacobi-Bellman (HJB) and Fokker-Planck (FP) equations, and then tackling them by looking for the semi-explicit solution for the linear quadratic case, especially with an arbitrary initial distribution; such a problem, being left open for long, has not been specifically dealt with in the earlier literature, such as Bensoussan [Stochastic Control of Partially Observable Systems. Cambridge University Press, (1992)] and Nisio [Stochastic control theory: Dynamic programming principle. Springer (2014)], which only tackled the linear quadratic setting with Gaussian initial distributions. Thanks to the effective mean-field theory, we propose a solution to this long standing problem of the general non-Gaussian case. Besides, our problem considered here can be reduced to the model in Bandiniet al.[Stochastic Process. Appl.129(2019) 674–711], which is fundamentally different from our present proposed framework. 
    more » « less
  2. ; ; (, ESAIM: Control, Optimisation and Calculus of Variations)
    In this article, we provide an original systematic global-in-time analysis of mean field type control problems on ℝnwith generic cost functions allowing quadratic growth by a novel “lifting” approach which is not the same as the traditional lifting. As an alternative to the recent popular analytical method of tackling master equations, we resolve the control problem in a proper Hilbert subspace of the whole space ofL2random variables, it can be regarded as a tangent space attached at the initial probability measure. The problem is linked to the global solvability of the Hilbert-space-valued forward–backward stochastic differential equation (FBSDE), which is solved by variational techniques here. We also rely on the Jacobian flow of the solution to this FBSDE to establish the regularity of the value function, including its linearly functional differentiability, which leads to the classical wellposedness of the Bellman equation. Together with the linear functional derivatives and the gradient of the linear functional derivatives of the solution to the FBSDE, we also obtain the classical wellposedness of the master equation. Our current approach imposes structural conditions directly on the cost functions. The contributions of adopting this framework in our study are twofold: (i) compared with imposing conditions on Hamiltonian, the structural conditions imposed in this work are easily verified, and less demanding on the cost functions while solving the master equation; and (ii) when the cost functions are not convex in the state variable or there is a lack of monotonicity of cost functions, an accurate lifespan can be provided for the local existence, which may not be that small in many cases. 
    more » « less
  3. ; ; (, International game theory review)
    In this paper, we study the maximum principle of mean field type control problems when the volatility function depends on the state and its measure and also the control, by using our recently developed method in [Bensoussan, A., Huang, Z. and Yam, S. C. P. [2023] Control theory on Wasserstein space: A new approach to optimality conditions, Ann. Math. Sci. Appl.; Bensoussan, A., Tai, H. M. and Yam, S. C. P. [2023] Mean field type control problems, some Hilbert-space-valued FBSDEs, and related equations, preprint (2023), arXiv:2305.04019; Bensoussan, A. and Yam, S. C. P. [2019] Control problem on space of random variables and master equation, ESAIM Control Optim. Calc. Var. 25, 10]. Our method is to embed the mean field type control problem into a Hilbert space to bypass the evolution in the Wasserstein space. We here give a necessary condition and a sufficient condition for these control problems in Hilbert spaces, and we also derive a system of forward–backward stochastic differential equations. 
    more » « less
  4. ; ; (, International Game Theory Review)
    In this paper, we study the maximum principle of mean field type control problems when the volatility function depends on the state and its measure and also the control, by using our recently developed method in [Bensoussan, A., Huang, Z. and Yam, S. C. P. [2023] Control theory on Wasserstein space: A new approach to optimality conditions, Ann. Math. Sci. Appl.; Bensoussan, A., Tai, H. M. and Yam, S. C. P. [2023] Mean field type control problems, some Hilbert-space-valued FBSDEs, and related equations, preprint (2023), arXiv:2305.04019; Bensoussan, A. and Yam, S. C. P. [2019] Control problem on space of random variables and master equation, ESAIM Control Optim. Calc. Var. 25, 10]. Our method is to embed the mean field type control problem into a Hilbert space to bypass the evolution in the Wasserstein space. We here give a necessary condition and a sufficient condition for these control problems in Hilbert spaces, and we also derive a system of forward–backward stochastic differential equations. 
    more » « less
  5. (, Risks)
    We study a toy model of linear-quadratic mean field game with delay. We “lift" the delayed dynamic into an infinite dimensional space, and recast the mean field game system which is made of a forward Kolmogorov equation and a backward Hamilton-Jacobi-Bellman equation. We identify the corresponding master equation. A solution to this master equation is computed, and we show that it provides an approximation to a Nash equilibrium of the finite player game. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email