skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Stochastic Differential Games: A Sampling Approach via FBSDEs
The aim of this work is to present a sampling-based algorithm designed to solve various classes of stochastic differential games. The foundation of the proposed approach lies in the formulation of the game solution in terms of a decoupled pair of forward and backward stochastic differential equations (FBSDEs). In light of the nonlinear version of the Feynman–Kac lemma, probabilistic representations of solutions to the nonlinear Hamilton–Jacobi–Isaacs equations that arise for each class are obtained. These representations are in form of decoupled systems of FBSDEs, which may be solved numerically.  more » « less
Award ID(s):
1662523 1662542
PAR ID:
10077890
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Dynamic Games and Applications
ISSN:
2153-0785
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Analysis and Applications)
    null (Ed.)
    Forward-backward stochastic differential equation (FBSDE) systems were introduced as a probabilistic description for parabolic type partial differential equations. Although the probabilistic behavior of the FBSDE system makes it a natural mathematical model in many applications, the stochastic integrals contained in the system generate uncertainties in the solutions which makes the solution estimation a challenging task. In this paper, we assume that we could receive partial noisy observations on the solutions and introduce an optimal filtering method to make a data informed solution estimation for FBSDEs. 
    more » « less
  2. ; ; ; ; ; (, ESAIM. Proceedings and surveys)
    This project investigates numerical methods for solving fully coupled forward-backward stochastic differential equations (FBSDEs) of McKean-Vlasov type. Having numerical solvers for such mean field FBSDEs is of interest because of the potential application of these equations to optimization problems over a large population, say for instance mean field games (MFG) and optimal mean field control problems . Theory for this kind of problems has met with great success since the early works on mean field games by Lasry and Lions, see [29], and by Huang, Caines, and Malhame, see [26]. Generally speaking, the purpose is to understand the continuum limit of optimizers or of equilibria (say in Nash sense) as the number of underlying players tends to infinity. When approached from the probabilistic viewpoint, solutions to these control problems (or games) can be described by coupled mean field FBSDEs, meaning that the coefficients depend upon the own marginal laws of the solution. In this note, we detail two methods for solving such FBSDEs which we implement and apply to five benchmark problems . The first method uses a tree structure to represent the pathwise laws of the solution, whereas the second method uses a grid discretization to represent the time marginal laws of the solutions. Both are based on a Picard scheme; importantly, we combine each of them with a generic continuation method that permits to extend the time horizon (or equivalently the coupling strength between the two equations) for which the Picard iteration converges. 
    more » « less
  3. (, arXiv.org)
    This project investigates numerical methods for solving fully coupled forward-backward stochastic differential equations (FBSDEs) of McKean-Vlasov type. Having numerical solvers for such mean field FBSDEs is of interest because of the potential application of these equations to optimization problems over a large population, say for instance mean field games (MFG) and optimal mean field control problems. Theory for this kind of problems has met with great success since the early works on mean field games by Lasry and Lions, and by Huang, Caines, and Malhame. Generally speaking, the purpose is to understand the continuum limit of optimizers or of equilibria (say in Nash sense) as the number of underlying players tends to infinity. When approached from the probabilistic viewpoint, solutions to these control problems (or games) can be described by coupled mean field FBSDEs, meaning that the coefficients depend upon the own marginal laws of the solution. In this note, we detail two methods for solving such FBSDEs which we implement and apply to five benchmark problems. The first method uses a tree structure to represent the pathwise laws of the solution, whereas the second method uses a grid discretization to represent the time marginal laws of the solutions. Both are based on a Picard scheme; importantly, we combine each of them with a generic continuation method that permits to extend the time horizon (or equivalently the coupling strength between the two equations) for which the Picard iteration converges. 
    more » « less
  4. ; ; (, ESAIM: Mathematical Modelling and Numerical Analysis)
    null (Ed.)
    In this paper, we propose a local discontinuous Galerkin (LDG) method for nonlinear and possibly degenerate parabolic stochastic partial differential equations, which is a high-order numerical scheme. It extends the discontinuous Galerkin (DG) method for purely hyperbolic equations to parabolic equations and shares with the DG method its advantage and flexibility. We prove the L 2 -stability of the numerical scheme for fully nonlinear equations. Optimal error estimates ( O ( h (k+1) )) for smooth solutions of semi-linear stochastic equations is shown if polynomials of degree k are used. We use an explicit derivative-free order 1.5 time discretization scheme to solve the matrix-valued stochastic ordinary differential equations derived from the spatial discretization. Numerical examples are given to display the performance of the LDG method. 
    more » « less
  5. ; ; (, International game theory review)
    In this paper, we study the maximum principle of mean field type control problems when the volatility function depends on the state and its measure and also the control, by using our recently developed method in [Bensoussan, A., Huang, Z. and Yam, S. C. P. [2023] Control theory on Wasserstein space: A new approach to optimality conditions, Ann. Math. Sci. Appl.; Bensoussan, A., Tai, H. M. and Yam, S. C. P. [2023] Mean field type control problems, some Hilbert-space-valued FBSDEs, and related equations, preprint (2023), arXiv:2305.04019; Bensoussan, A. and Yam, S. C. P. [2019] Control problem on space of random variables and master equation, ESAIM Control Optim. Calc. Var. 25, 10]. Our method is to embed the mean field type control problem into a Hilbert space to bypass the evolution in the Wasserstein space. We here give a necessary condition and a sufficient condition for these control problems in Hilbert spaces, and we also derive a system of forward–backward stochastic differential equations. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email