skip to main content

Explore Research Products in the NSF-PAR

Title: Adaptive-Control-Oriented Meta-Learning for Nonlinear Systems
Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics terms are linearly parameterizable with known nonlinear features. However, it is often difficult to specify such features a priori, such as for aerodynamic disturbances on rotorcraft or interaction forces between a manipulator arm and various objects. In this paper, we turn to data-driven modeling with neural networks to learn, offline from past data, an adaptive controller with an internal parametric model of these nonlinear features. Our key insight is that we can better prepare the controller for deployment with control-oriented meta-learning of features in closed-loop simulation, rather than regression-oriented meta-learning of features to fit input-output data. Specifically, we meta-learn the adaptive controller with closed-loop tracking simulation as the base-learner and the average tracking error as the meta-objective. With a nonlinear planar rotorcraft subject to wind, we demonstrate that our adaptive controller outperforms other controllers trained with regression-oriented meta-learning when deployed in closed-loop for trajectory tracking control.  more » « less
Award ID(s):
1931815
NSF-PAR ID:
10248926
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Robotics science and systems
ISSN:
2330-7668
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ( , ASME Dynamic Systems and Control Conference)
    null (Ed.)
    A common rehabilitative technique for those with neuro-muscular disorders is functional electrical stimulation (FES) induced exercise such as FES-induced biceps curls. FES has been shown to have numerous health benefits, such as increased muscle mass and retraining of the nervous system. Closed-loop control of a motorized FES system presents numerous challenges since the system has nonlinear and uncertain dynamics and switching is required between motor and FES control, which is further complicated by the muscle having an uncertain control effectiveness. An additional complication of FES systems is that high gain feedback from traditional robust controllers can be uncomfortable to the participant. In this paper, data-based, opportunistic learning is achieved by implementing an integral concurrent learning (ICL) controller during a motorized and FES-induced biceps curl exercise. The ICL controller uses adaptive feedforward terms to augment the FES controller to reduce the required control input. A Lyapunov-based analysis is performed to ensure exponential trajectory tracking and opportunistic, exponential learning of the uncertain human and machine parameters. In addition to improved tracking performance and robustness, the potential of learning the specific dynamics of a person during a rehabilitative exercise could be clinically significant. Preliminary simulation results are provided and demonstrate an average position error of 0.14 ± 1.17 deg and an average velocity error of 0.004 ± 1.18 deg/s. 
    more » « less
  2. ; ; ; ( , International Journal of Robust and Nonlinear Control)
    Summary

    Scenario‐based model predictive control (MPC) methods can mitigate the conservativeness inherent to open‐loop robust MPC. Yet, the scenarios are often generated offline based on worst‐case uncertainty descriptions obtaineda priori, which can in turn limit the improvements in the robust control performance. To this end, this paper presents a learning‐based, adaptive‐scenario‐tree model predictive control approach for uncertain nonlinear systems with time‐varying and/or hard‐to‐model dynamics. Bayesian neural networks (BNNs) are used to learn a state‐ and input‐dependent description of model uncertainty, namely the mismatch between a nominal (physics‐based or data‐driven) model of a system and its actual dynamics. We first present a new approach for training robust BNNs (RBNNs) using probabilistic Lipschitz bounds to provide a less conservative uncertainty quantification. Then, we present an approach to evaluate the credible intervals of RBNN predictions and determine the number of samples required for estimating the credible intervals given a credible level. The performance of RBNNs is evaluated with respect to that of standard BNNs and Gaussian process (GP) as a basis of comparison. The RBNN description of plant‐model mismatch with verified accurate credible intervals is employed to generate adaptive scenarios online for scenario‐based MPC (sMPC). The proposed sMPC approach with adaptive scenario tree can improve the robust control performance with respect to sMPC with a fixed, worst‐case scenario tree and with respect to an adaptive‐scenario‐based MPC (asMPC) using GP regression on a cold atmospheric plasma system. Furthermore, closed‐loop simulation results illustrate that robust model uncertainty learning via RBNNs can enhance the probability of constraint satisfaction of asMPC.

     
    more » « less
  3. ( , International Journal of Adaptive Control and Signal Processing)
    M. Grimble (Ed.)
    Summary

    This paper presents the first model reference adaptive control system for nonlinear, time‐varying, hybrid dynamical plants affected by matched and parametric uncertainties, whose resetting events are unknown functions of time and the plant's state. In addition to a control law and an adaptive law, which resemble those of the classical model reference adaptive control framework for continuous‐time dynamical systems, the proposed framework allows imposing instantaneous variations in the reference model's trajectory to rapidly steer the trajectory tracking error to zero, while retaining the closed‐loop system's ability to follow a user‐defined signal. These results are enabled by the first extension of the classical LaSalle–Yoshizawa theorem to time‐varying hybrid dynamical systems, which is presented in this paper as well. A numerical simulation shows the key features of the proposed adaptive control system and highlights its ability to reduce both the control effort and the trajectory tracking error over a classical model reference adaptive control system applied to the same problem.

     
    more » « less
  4. ; ; ; ( , Proceedings of the American Control Conference)
    This paper is focused on the output tracking control problem of a wave equation with both matched and unmatched boundary uncertainties. An adaptive boundary feedback control scheme is proposed by utilizing radial basis function neural networks (RBF NNs) to deal with the effect of system uncertainties. Specifically, two RBF NN models are first developed to approximate the matched and unmatched system uncertain dynamics respectively. Based on this, an adaptive NN control scheme is derived, which consists of: (i) an adaptive boundary feedback controller embedded by the NN model approximating the matched uncertainty, for rendering stable and accurate tracking control; and (ii) a reference model embedded by the NN model approximating the unmatched uncertainty, for generating a prescribed reference trajectory. Rigorous analysis is performed using the Lyapunov theory and the C0-semigroup theory to prove that our proposed control scheme can guarantee closed-loop stability and wellposedness. Simulation study has been conducted to demonstrate effectiveness of the proposed approach. 
    more » « less
  5. ; ( , IEEE International Conference on Automation Science and Engineering CASE)
    We propose a hierarchical learning architecture for predictive control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different environments. A parameterized environment model generates state constraints specific to each task, which are satisfied by the stored trajectories. Our goal is to find a feasible trajectory for a new task in an unknown environment. From stored data, we learn strategies in the form of target sets in a reduced-order state space. These strategies are applied to the new task in real-time using a local forecast of the new environment, and the resulting output is used as a terminal region by a low-level receding horizon controller. We show how to i) design the target sets from past data and then ii) incorporate them into a model predictive control scheme with shifting horizon that ensures safety of the closed-loop system when performing the new task. We prove the feasibility of the resulting control policy, and verify the proposed method in a robotic path planning application. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email