More Like this

1. H_\infty Optimal Estimation for Linear Coupled {PDE} Systems

   Das, A.; Shivakumar, S.; Weiland, S.; Peet, M. (January 2020, Proceedings of the IEEE Conference on Decision & Control)

   In this work, we present a Linear Matrix Inequality (LMI) based method to synthesize an optimal H1 estimator for a large class of linear coupled partial differential equations (PDEs) utilizing only finite dimensional measurements. Our approach extends the newly developed framework for representing and analyzing distributed parameter systems using operators on the space of square integrable functions that are equipped with multipliers and kernels of semi-separable class. We show that by redefining the state, the PDEs can be represented using operators that embed the boundary conditions and input-output relations explicitly. The optimal estimator synthesis problem is formulated as a convex optimization subject to LMIs that require no approximation or discretization. A scalable algorithm is presented to synthesize the estimator. The algorithm is illustrated by suitable examples. 

   more » « less
2. On Abstraction-Based Controller Design With Output Feedback

   https://doi.org/10.1145/3365365.3382219  

   Majumdar, Rupak; Ozay, Necmiye; Schmuck, Anne-Kathrin (January 2020, Proc. Hybrid Systems Computation and Control (HSCC) 2020.)

   null (Ed.)

   We consider abstraction-based design of output-feedback controllers for dynamical systemswith a finite set of inputs and outputs against specifications in linear-time temporal logic. The usual procedure for abstraction-based controller design (ABCD) first constructs a finite-state abstraction of the underlying dynamical system, and second, uses reactive synthesis techniques to compute an abstract state-feedback controller on the abstraction. In this context, our contribution is two-fold: (I) we define a suitable relation between the original systemand its abstractionwhich characterizes the soundness and completeness conditions for an abstract state-feedback controller to be refined to a concrete output-feedback controller for the original system, and (II) we provide an algorithm to compute a sound finite-state abstraction fulfilling this relation. Our relation generalizes feedback-refinement relations fromABCD with state-feedback. Our algorithm for constructing sound finitestate abstractions is inspired by the simultaneous reachability and bisimulation minimization algorithm of Lee and Yannakakis. We lift their idea to the computation of an observation-equivalent system and show how sound abstractions can be obtained by stopping this algorithm at any point. Additionally, our new algorithm produces a realization of the topological closure of the input/output behavior of the original system if it is finite state realizable. 

   more » « less
3. Sample Complexity Bound for Evaluating the Robust Observer’s Performance under Coprime Factors Uncertainty

   Sabau, Serban; Zhang, Yifei; Ukil, Sourav Kumar (June 2023, Proceedings of Machine Learning Research)

   Lawrence, N (Ed.)

   This paper addresses the end-to-end sample complexity bound for learning in closed loop the state estimator-based robust H2 controller for an unknown (possibly unstable) Linear Time Invariant (LTI) system, when given a fixed state-feedback gain. We build on the results from Ding et al. (1994) to bridge the gap between the parameterization of all state-estimators and the celebrated Youla parameterization. Refitting the expression of the relevant closed loop allows for the optimal linear observer problem given a fixed state feedback gain to be recast as a convex problem in the Youla parameter. The robust synthesis procedure is performed by considering bounded additive model uncertainty on the coprime factors of the plant, such that a min-max optimization problem is formulated for the robust H2 controller via an observer approach. The closed-loop identification scheme follows Zhang et al. (2021), where the nominal model of the true plant is identified by constructing a Hankel-like matrix from a single time-series of noisy, finite length input-output data by using the ordinary least squares algorithm from Sarkar et al. (2020). Finally, a H∞ bound on the estimated model error is provided, as the robust synthesis procedure requires bounded additive uncertainty on the coprime factors of the model. Reference Zhang et al. (2022b) is the extended version of this paper. 

   more » « less
4. The Role of Strategic Load Participants in Two-Stage Settlement Electricity Markets

   https://doi.org/10.1109/CDC40024.2019.9029514  

   You, Pengcheng; Gayme, Dennice F.; Mallada, Enrique (December 2019, Conference on Decision and Control)

   We consider the problem of designing a feedback controller that guides the input and output of a linear time-invariant system to a minimizer of a convex optimization problem. The system is subject to an unknown disturbance, piecewise constant in time, which shifts the feasible set defined by the system equilibrium constraints. Our proposed design combines proportional-integral control with gradient feedback, and enforces the Karush-Kuhn-Tucker optimality conditions in steady-state without incorporating dual variables into the controller. We prove that the input and output variables achieve optimality in steady-state, and provide a stability criterion based on absolute stability theory. The effectiveness of our approach is illustrated on a simple example system. 

   more » « less
5. Learning-based adaptive optimal control of linear time-delay systems: A value iteration approach

   https://doi.org/10.1016/j.automatica.2024.111944  

   Cui, Leilei; Pang, Bo; Krstić, Miroslav; Jiang, Zhong-Ping (January 2025, Automatica)

   This paper proposes a novel learning-based adaptive optimal controller design method for a class of continuous-time linear time-delay systems. A key strategy is to exploit the state-of-the-art reinforcement learning (RL) techniques and adaptive dynamic programming (ADP), and propose a data-driven method to learn the near-optimal controller without the precise knowledge of system dynamics. Specifically, a value iteration (VI) algorithm is proposed to solve the infinite-dimensional Riccati equation for the linear quadratic optimal control problem of time-delay systems using finite samples of input-state trajectory data. It is rigorously proved that the proposed VI algorithm converges to the near-optimal solution. Compared with the previous literature, the nice features of the proposed VI algorithm are that it is directly developed for continuous-time systems without discretization and an initial admissible controller is not required for implementing the algorithm. The efficacy of the proposed methodology is demonstrated by two practical examples of metal cutting and autonomous driving. 

   more » « less