skip to main content


Title: Scalable Robust Adaptive Control from the System Level Perspective
We will present a new general framework for robust and adaptive control that allows for distributed and scalable learning and control of large systems of interconnected linear subsystems. The control method is demonstrated for a linear time-invariant system with bounded parameter uncertainties, disturbances and noise. The presented scheme continuously collects measurements to reduce the uncertainty about the system parameters and adapts dynamic robust controllers online in a stable and performance-improving way. A key enabler for our approach is choosing a time-varying dynamic controller implementation, inspired by recent work on System Level Synthesis [1]. We leverage a new robustness result for this implementation to propose a general robust adaptive control algorithm. In particular, the algorithm allows us to impose communication and delay constraints on the controller implementation and is formulated as a sequence of robust optimization problems that can be solved in a distributed manner. The proposed control methodology performs particularly well when the interconnection between systems is sparse and the dynamics of local regions of subsystems depend only on a small number of parameters. As we will show on a five-dimensional exemplary chain-system, the algorithm can utilize system structure to efficiently learn and control the entire system while respecting communication and implementation constraints. Moreover, although current theoretical results require the assumption of small initial uncertainties to guarantee robustness, we will present simulations that show good closed-loop performance even in the case of large uncertainties, which suggests that this assumption is not critical for the presented technique and future work will focus on providing less conservative guarantees.  more » « less
Award ID(s):
1735003
NSF-PAR ID:
10155684
Author(s) / Creator(s):
;
Date Published:
Journal Name:
2019 American Control Conference (ACC)
Page Range / eLocation ID:
3683 to 3688
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Summary

    Robust control of parameter‐dependent input delay linear parameter‐varying (LPV) systems via gain‐scheduled dynamic output‐feedback control is considered in this paper. The controller is designed to provide disturbance rejection in the context of the induced‐norm or thenorm of the closed‐loop system in the presence of uncertainty and disturbances. A reciprocally convex approach is employed to bound the Lyapunov‐Krasovskii functional derivative and extract sufficient conditions for the controller characterization in terms of linear matrix inequalities (LMIs). The approach does not require the rate of the delay to be bounded, hence encompasses a broader family of input‐delay LPV systems with fast‐varying delays. The method is then applied to the air‐fuel ratio (AFR) control in spark ignition (SI) engines where the delay and the plant parameters are functions of the engine speed and mass air flow. The objectives are to track the commanded AFR signal and to optimize the performance of the three‐way catalytic converter (TWC) through the precise AFR control and oxygen level regulation, resulting in improved fuel efficiency and reduced emissions. The designed AFR controller seeks to provide canister purge disturbance rejection over the full operating envelope of the SI engine in the presence of uncertainties. Closed‐loop simulation results are presented to validate the controller performance and robustness while meeting AFR tracking and disturbance rejection requirements.

     
    more » « less
  2. Liu, Tengfei ; Ou, Yan. (Ed.)
    We design a regulation-triggered adaptive controller for robot manipulators to efficiently estimate unknown parameters and to achieve asymptotic stability in the presence of coupled uncertainties. Robot manipulators are widely used in telemanipulation systems where they are subject to model and environmental uncertainties. Using conventional control algorithms on such systems can cause not only poor control performance, but also expensive computational costs and catastrophic instabilities. Therefore, system uncertainties need to be estimated through designing a computationally efficient adaptive control law. We focus on robot manipulators as an example of a highly nonlinear system. As a case study, a 2-DOF manipulator subject to four parametric uncertainties is investigated. First, the dynamic equations of the manipulator are derived, and the corresponding regressor matrix is constructed for the unknown parameters. For a general nonlinear system, a theorem is presented to guarantee the asymptotic stability of the system and the convergence of parameters’ estimations. Finally, simulation results are discussed for a two-link manipulator, and the performance of the proposed scheme is thoroughly evaluated. 
    more » « less
  3. We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems commonly model the nonlinear effects of an unknown environment on a nominal system. We optimize over a class of nonlinear feedback policies inspired by certainty equivalent "estimate-and-cancel" control laws pioneered in classical adaptive control to achieve significant performance improvements in the presence of uncertainties of large magnitude, a setting in which existing learning-based predictive control algorithms often struggle to guarantee safety. In contrast to previous work in robust adaptive MPC, our approach allows us to take advantage of structure (i.e., the numerical predictions) in the a priori unknown dynamics learned online through function approximation. Our approach also extends typical nonlinear adaptive control methods to systems with state and input constraints even when we cannot directly cancel the additive uncertain function from the dynamics. Moreover, we apply contemporary statistical estimation techniques to certify the system’s safety through persistent constraint satisfaction with high probability. Finally, we show in simulation that our method can accommodate more significant unknown dynamics terms than existing methods. 
    more » « less
  4. This paper presents a novel decentralized control strategy for a class of uncertain nonlinear large-scale systems with mismatched interconnections. First, it is shown that the decentralized controller for the overall system can be represented by an array of optimal control policies of auxiliary subsystems. Then, within the framework of adaptive dynamic programming, a simultaneous policy iteration (SPI) algorithm is developed to solve the Hamilton–Jacobi–Bellman equations associated with auxiliary subsystem optimal control policies. The convergence of the SPI algorithm is guaranteed by an equivalence relationship. To implement the present SPI algorithm, actor and critic neural networks are applied to approximate the optimal control policies and the optimal value functions, respectively. Meanwhile, both the least squares method and the Monte Carlo integration technique are employed to derive the unknown weight parameters. Furthermore, by using Lyapunov’s direct method, the overall system with the obtained decentralized controller is proved to be asymptotically stable. Finally, the effectiveness of the proposed decentralized control scheme is illustrated via simulations for nonlinear plants and unstable power systems. 
    more » « less
  5. Abstract This paper presents a hierarchical nonlinear control algorithm for the real-time planning and control of cooperative locomotion of legged robots that collaboratively carry objects. An innovative network of reduced-order models subject to holonomic constraints, referred to as interconnected linear inverted pendulum (LIP) dynamics, is presented to study cooperative locomotion. The higher level of the proposed algorithm employs a supervisory controller, based on event-based model predictive control (MPC), to effectively compute the optimal reduced-order trajectories for the interconnected LIP dynamics. The lower level of the proposed algorithm employs distributed nonlinear controllers to reduce the gap between reduced- and full-order complex models of cooperative locomotion. In particular, the distributed controllers are developed based on quadratic programing (QP) and virtual constraints to impose the full-order dynamical models of each agent to asymptotically track the reduced-order trajectories while having feasible contact forces at the leg ends. The paper numerically investigates the effectiveness of the proposed control algorithm via full-order simulations of a team of collaborative quadrupedal robots, each with a total of 22 degrees-of-freedom. The paper finally investigates the robustness of the proposed control algorithm against uncertainties in the payload mass and changes in the ground height profile. Numerical studies show that the cooperative agents can transport unknown payloads whose masses are up to 57%, 97%, and 137% of a single agent's mass with a team of two, three, and four legged robots. 
    more » « less