A class of nonlinear, stochastic staticization control problems (including minimization problems with smooth, convex, coercive payoffs) driven by diffusion dynamics with constant diffusion coefficient is considered. A fundamental solution form is obtained where the same solution can be used for a limited variety of terminal costs without resolution of the problem. One may convert this fundamental solution form from a stochastic control problem form to a deterministic control problem form. This yields an equivalence between certain secondorder (in space) HamiltonJacobi partial differential equations (HJ PDEs) and associated firstorder HJ PDEs. This reformulation has substantial numerical implications.
Conversion of a Class of Stochastic Control Problems to FundamentalSolution Deterministic Control Problems
A class of nonlinear, stochastic staticization control
problems (including minimization problems with smooth, convex,
coercive payoffs) driven by diffusion dynamics and constant
diffusion coefficient is considered. Using dynamic programming
and tools from static duality, a fundamental solution form is
obtained where the same solution can be used for a variety of
terminal costs without resolution of the problem. Further, this
fundamental solution takes the form of a deterministic control
problem rather than a stochastic control problem.
 Award ID(s):
 1908918
 Publication Date:
 NSFPAR ID:
 10171194
 Journal Name:
 Proceedings of the American Control Conference
 Page Range or eLocationID:
 28142819
 ISSN:
 07431619
 Sponsoring Org:
 National Science Foundation
More Like this


By exploiting minplus linearity, semiconcavity, and semigroup properties of dynamic programming, a fundamental solution semigroup for a class of approximate finite horizon linear infinite dimensional optimal control problems is constructed. Elements of this fundamental solution semigroup are parameterized by the time horizon, and can be used to approximate the solution of the corresponding finite horizon optimal control problem for any terminal cost. They can also be composed to compute approximations on longer horizons. The value function approximation provided takes the form of a minplus convolution of a kernel with the terminal cost. A general construction for this kernel is provided, along with a spectral representation for a restricted class of subproblems.

A new method is developed for solving optimal control problems whose solutions are nonsmooth. The method developed in this paper employs a modified form of the Legendre–Gauss–Radau orthogonal direct collocation method. This modified Legendre–Gauss–Radau method adds two variables and two constraints at the end of a mesh interval when compared with a previously developed standard Legendre– Gauss–Radau collocation method. The two additional variables are the time at the interface between two mesh intervals and the control at the end of each mesh inter val. The two additional constraints are a collocation condition for those differential equations that depend upon the control and an inequality constraint on the control at the endpoint of each mesh interval. The additional constraints modify the search space of the nonlinear programming problem such that an accurate approximation to the location of the nonsmoothness is obtained. The transformed adjoint system of the modified Legendre–Gauss–Radau method is then developed. Using this transformed adjoint system, a method is developed to transform the Lagrange multipliers of the nonlinear programming problem to the costate of the optimal control problem. Fur thermore, it is shown that the costate estimate satisfies one of the Weierstrass–Erdmann optimality conditions. Finally, the method developed inmore »

Linear quadratic stochastic optimal control problems with operator coefficients: openloop solutionsAn optimal control problem is considered for linear stochastic differential equations with quadratic cost functional. The coefficients of the state equation and the weights in the cost functional are bounded operators on the spaces of square integrable random variables. The main motivation of our study is linear quadratic (LQ, for short) optimal control problems for meanfield stochastic differential equations. Openloop solvability of the problem is characterized as the solvability of a system of linear coupled forwardbackward stochastic differential equations (FBSDE, for short) with operator coefficients, together with a convexity condition for the cost functional. Under proper conditions, the wellposedness of such an FBSDE, which leads to the existence of an openloop optimal control, is established. Finally, as applications of our main results, a general meanfield LQ control problem and a concrete meanvariance portfolio selection problem in the openloop case are solved.

We study Mean Field stochastic control problems where the cost function and the state dynamics depend upon the joint distribution of the controlled state and the control process. We prove suitable versions of the Pontryagin stochastic maximum principle, both in necessary and in sufficient form, which extend the known conditions to this general framework. Furthermore, we suggest a variational approach to study a weak formulation of these control problems. We show a natural connection between this weak formulation and optimal transport on path space, which inspires a novel discretization scheme.