Bayesian Learning for Data-Driven Stochastic Optimal Control Stochastic optimal control (SOC) provides a principled approach to dynamic decision making under uncertainty. It models the transition of the system state with a dynamic equation driven by randomness, with the assumption that the distribution of randomness is known. However, in practical problems, modeling randomness frequently depends on data or observations, which introduces uncertainty regarding the distribution of randomness. To address the data-driven SOC problem, in “Episodic Bayesian Optimal Control with Unknown Randomness Distributions,” Shapiro, Zhou, Lin, and Wang propose a new approach that incorporates Bayesian learning with optimal control in an episodic manner. They show the convergence and convergence rate results for their approach. They also develop an efficient computational method for a class of problems that have convex cost functions and linear state dynamics.
more »
« less
This content will become publicly available on November 1, 2026
Asymptotic compatibility of parametrized optimal design problems
We study optimal design problems where the design corresponds to a coefficient in the principal part of the state equation. The state equation, in addition, is parameter dependent, and we allow it to change type in the limit of this (modeling) parameter. We develop a framework that guarantees asymptotic compatibility, that is unconditional convergence with respect to modeling and discretization parameters to the solution of the corresponding limiting problems. This framework is then applied to two distinct classes of problems where the modeling parameter represents the degree of nonlocality. Specifically, we show unconditional convergence of optimal design problems when the state equation is either a scalar-valued fractional equation, or a strongly coupled system of nonlocal equations derived from the bond-based model of peridynamics.
more »
« less
- PAR ID:
- 10689917
- Publisher / Repository:
- ESAIM
- Date Published:
- Journal Name:
- ESAIM: Mathematical Modelling and Numerical Analysis
- Volume:
- 59
- Issue:
- 6
- ISSN:
- 2822-7840
- Page Range / eLocation ID:
- 3069 to 3105
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
ABSTRACT A tracking‐type optimal control problem governed by the viscous wave equation with a distributed‐source control and ‐ control costs is investigated. For this class of PDE‐constrained linear‐convex problems, a Pontryagin maximum principle (PMP) in the PDE setting is derived, and it is shown that the pointwise maximization condition is also sufficient for optimality. Based on the PMP, a sequential quadratic Hamiltonian (SQH) method is implemented, and a sufficient decrease property is established by introducing an adaptive penalization parameter. Convergence of the SQH method is discussed for both interval‐valued and discrete‐valued control sets. For the state and adjoint equations, a second‐order finite‐difference discretization is analysed. Numerical experiments validate both the approximation properties of the discretization and the effectiveness of the PMP‐based optimization framework.more » « less
-
Parameter estimation and optimal experimental design problems have been widely studied across scienceand engineering. The two are inextricably linked, with optimally designed experiments leading to better-estimated parameters. This link becomes even more crucial when available experiments produce minimal data due to practical constraints of limited experimental budgets. This work presents a novel framework that allows for the identification of optimal experimental arrangement, from a finite set of possibilities, for precise parameter estimation. The proposed framework relies on two pillars. First, we use multi-fidelity modeling to create reliable surrogates that relate unknown parameters to a measurable quantity of interest for a multitude of available choices defined through a set of candidate control vectors. Secondly, we quantify the estimation potential of an arrangement from the set of control vectors through the examination of statistical sensitivity measures calculated from the constructed surrogates. The measures of sensitivity are defined using analysis of variance as well as directional statistics. Two numerical examples are provided, where we demonstrate how the correlation between the estimation potential and the frequency of precise parameter estimation can inform the choice of optimal arrangement.more » « less
-
We establish a uniform-in-scaling error estimate for the asymptotic preserving (AP) scheme proposed by Xu and Wang [Commun. Math. Sci. 21 (2023), pp. 1–23] for the Lévy-Fokker-Planck (LFP) equation. The main difficulties stem not only from the interplay between the scaling and numerical parameters but also the slow decay of the tail of the equilibrium state. We tackle these problems by separating the parameter domain according to the relative size of the scaling parameter : in the regime where is large, we design a weighted norm to mitigate the issue caused by the fat tail, while in the regime where is small, we prove a strong convergence of LFP towards its fractional diffusion limit with an explicit convergence rate. This method extends the traditional AP estimates to cases where uniform bounds are unavailable. Our result applies to any dimension and to the whole span of the fractional power.more » « less
-
We develop a family of stabilized backward differentiation formula (sBDF) schemes of orders one through four for semilinear parabolic equations. The proposed methods are designed to achieve three properties that are rarely available simultaneously in high-order time discretizations: unconditional preservation of the maximum bound principle (MBP), unconditional discrete energy stability, and practical matrix-free implementation. The construction integrates carefully designed stabilization terms, fixed-point iterations, and a pointwise cut-off strategy. The nonlinear algebraic systems arising from the implicit sBDF discretizations are solved by fixed-point iteration, resulting in fully matrix-free algorithms. This makes the approach particularly attractive for practical computations on general domains and under mixed boundary conditions, where FFT-based exponential time differencing methods are often unavailable or inefficient. We further present a unified analysis for the fully implemented schemes, explicitly incorporating the interplay among time discretization, nonlinear iteration, and cutoff. Unconditional contractivity of the fixed-point iterations and error estimates are established. For the Allen–Cahn equation, we additionally prove an unconditional discrete energy dissipation law. Numerical experiments confirm the theoretical convergence rates and demonstrate the robustness and efficiency of the proposed methods, particularly relative to ETD-based approaches for problems with mixed boundary conditions.more » « less
An official website of the United States government
