A class of nonlinear, stochastic staticization control problems (including minimization problems with smooth, convex, coercive payoffs) driven by diffusion dynamics with constant diffusion coefficient is considered. A fundamental solution form is obtained where the same solution can be used for a limited variety of terminal costs without resolution of the problem. One may convert this fundamental solution form from a stochastic control problem form to a deterministic control problem form. This yields an equivalence between certain secondorder (in space) HamiltonJacobi partial differential equations (HJ PDEs) and associated firstorder HJ PDEs. This reformulation has substantial numerical implications.
more »
« less
Conversion of a Class of Stochastic Control Problems to FundamentalSolution Deterministic Control Problems
A class of nonlinear, stochastic staticization control
problems (including minimization problems with smooth, convex,
coercive payoffs) driven by diffusion dynamics and constant
diffusion coefficient is considered. Using dynamic programming
and tools from static duality, a fundamental solution form is
obtained where the same solution can be used for a variety of
terminal costs without resolution of the problem. Further, this
fundamental solution takes the form of a deterministic control
problem rather than a stochastic control problem.
more »
« less
 Award ID(s):
 1908918
 NSFPAR ID:
 10171194
 Date Published:
 Journal Name:
 Proceedings of the American Control Conference
 ISSN:
 07431619
 Page Range / eLocation ID:
 28142819
 Format(s):
 Medium: X
 Sponsoring Org:
 National Science Foundation
More Like this


By exploiting minplus linearity, semiconcavity, and semigroup properties of dynamic programming, a fundamental solution semigroup for a class of approximate finite horizon linear infinite dimensional optimal control problems is constructed. Elements of this fundamental solution semigroup are parameterized by the time horizon, and can be used to approximate the solution of the corresponding finite horizon optimal control problem for any terminal cost. They can also be composed to compute approximations on longer horizons. The value function approximation provided takes the form of a minplus convolution of a kernel with the terminal cost. A general construction for this kernel is provided, along with a spectral representation for a restricted class of subproblems.more » « less

We consider the problem of finitehorizon optimal control of a discrete linear timevarying system subject to a stochastic disturbance and fully observable state. The initial state of the system is drawn from a known Gaussian distribution, and the final state distribution is required to reach a given target Gaussian distribution, while minimizing the expected value of the control effort. We derive the linear optimal control policy by first presenting an efficient solution for the diffusionless case, and we then solve the case with diffusion by reformulating the system as a superposition of diffusionless systems. We show that the resulting solution coincides with a LQG problem with particular terminal cost weight matrix.more » « less

Linear quadratic stochastic optimal control problems with operator coefficients: openloop solutionsAn optimal control problem is considered for linear stochastic differential equations with quadratic cost functional. The coefficients of the state equation and the weights in the cost functional are bounded operators on the spaces of square integrable random variables. The main motivation of our study is linear quadratic (LQ, for short) optimal control problems for meanfield stochastic differential equations. Openloop solvability of the problem is characterized as the solvability of a system of linear coupled forwardbackward stochastic differential equations (FBSDE, for short) with operator coefficients, together with a convexity condition for the cost functional. Under proper conditions, the wellposedness of such an FBSDE, which leads to the existence of an openloop optimal control, is established. Finally, as applications of our main results, a general meanfield LQ control problem and a concrete meanvariance portfolio selection problem in the openloop case are solved.more » « less

We study Mean Field stochastic control problems where the cost function and the state dynamics depend upon the joint distribution of the controlled state and the control process. We prove suitable versions of the Pontryagin stochastic maximum principle, both in necessary and in sufficient form, which extend the known conditions to this general framework. Furthermore, we suggest a variational approach to study a weak formulation of these control problems. We show a natural connection between this weak formulation and optimal transport on path space, which inspires a novel discretization scheme.more » « less