skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Lie Algebraic Cost Function Design for Control on Lie Groups
This paper presents a control framework on Lie groups by designing the control objective in its Lie algebra. Control on Lie groups is challenging due to its nonlinear nature and difficulties in system parameterization. Existing methods to design the control objective on a Lie group and then derive the gradient for controller design are non-trivial and can result in slow convergence in tracking control. We show that with a proper left-invariant metric, setting the gradient of the cost function as the tracking error in the Lie algebra leads to a quadratic Lyapunov function that enables globally exponential convergence. In the PD control case, we show that our controller can maintain an exponential convergence rate even when the initial error is approaching π in SO(3). We also show the merit of this proposed framework in trajectory optimization. The proposed cost function enables the iterative Linear Quadratic Regulator (iLQR) to converge much faster than the Differential Dynamic Programming (DDP) with a well-adopted cost function when the initial trajectory is poorly initialized on SO(3).  more » « less
Award ID(s):
2103026
PAR ID:
10415215
Author(s) / Creator(s):
Date Published:
Journal Name:
Proc. IEEE CDC 2022
Page Range / eLocation ID:
1867-1874
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, American Control Conference (ACC))
    We present an analytical design and experimental verification of trajectory tracking control of a 7-DOF robot manipulator, which achieves convergence of all tracking errors to the origin within a finite terminal time. A key feature of this control strategy is that this terminal convergence time is explicitly prescribed by the control designer, and is thus independent of the initial conditions of the tracking errors. In order to achieve this beneficial property of the proposed controller, a scaling of the state by a function of time that grows unbounded towards the terminal time is employed. Through Lyapunov analysis, we first demonstrate that the proposed controller achieves regulation of all tracking errors within the prescribed time as well as the uniform boundedness of the joint torques, even in the presence of a matched, non-vanishing disturbance. Then, through both simulation and experiment, we demonstrate that the proposed controller is capable of converging to the desired trajectory within the prescribed time, despite large initial conditions of the tracking errors and a sinusoidal disturbance being applied in each joint. 
    more » « less
  2. ; (, 60th IEEE Conference on Decision and Control (CDC),)
    Common reinforcement learning methods seek optimal controllers for unknown dynamical systems by searching in the "policy" space directly. A recent line of research, starting with [1], aims to provide theoretical guarantees for such direct policy-update methods by exploring their performance in classical control settings, such as the infinite horizon linear quadratic regulator (LQR) problem. A key property these analyses rely on is that the LQR cost function satisfies the "gradient dominance" property with respect to the policy parameters. Gradient dominance helps guarantee that the optimal controller can be found by running gradient-based algorithms on the LQR cost. The gradient dominance property has so far been verified on a case-by-case basis for several control problems including continuous/discrete time LQR, LQR with decentralized controller, H2/H∞ robust control.In this paper, we make a connection between this line of work and classical convex parameterizations based on linear matrix inequalities (LMIs). Using this, we propose a unified framework for showing that gradient dominance indeed holds for a broad class of control problems, such as continuous- and discrete-time LQR, minimizing the L2 gain, and problems using system-level parameterization. Our unified framework provides insights into the landscape of the cost function as a function of the policy, and enables extending convergence results for policy gradient descent to a much larger class of problems. 
    more » « less
  3. ; ; (, Journal of Dynamic Systems, Measurement, and Control)
    Abstract We present an analytical design and experimental verification of trajectory tracking control of a 7-DOF robot manipulator, which achieves convergence of all tracking errors to the origin within a finite terminal time, also referred to as the “settling time.” A key feature of this control strategy is that the settling time is explicitly assigned by the control designer to a value desired, or “prescribed” by the user and that the settling time is independent of the initial conditions and of the reference signal. In order to achieve this beneficial property with the controller, a scaling of the state by a function of time that grows unbounded toward the terminal time is employed. Through Lyapunov analysis, we first demonstrate that the proposed controller achieves regulation of all tracking errors within the prescribed time as well as the uniform boundedness of the joint torques, even in the presence of a matched, nonvanishing disturbance. Then, through both simulation and experiment, we demonstrate that the proposed controller is capable of converging to the desired trajectory within the prescribed time, despite large distance between the initial conditions and the reference trajectory, i.e., in spite of large initial tracking errors, and in spite of a sinusoidal disturbance being applied in each joint. 
    more » « less
  4. ; ; (, Sensors)
    This paper presents a tracking controller for nonlinear systems with matched uncertainties based on contraction metrics and disturbance estimation that provides exponential convergence guarantees. Within the proposed approach, a disturbance estimator is proposed to estimate the pointwise value of the uncertainties, with a pre-computable estimation error bounds (EEB). The estimated disturbance and the EEB are then incorporated in a robust Riemannian energy condition to compute the control law that guarantees exponential convergence of actual state trajectories to desired ones. Simulation results on aircraft and planar quadrotor systems demonstrate the efficacy of the proposed controller, which yields better tracking performance than existing controllers for both systems. 
    more » « less
  5. ; (, Proceedings of Machine Learning Research)
    Chiappa, Silvia; Calandra, Roberto (Ed.)
    The article considers smooth optimization of functions on Lie groups. By generalizing NAG variational principle in vector space (Wibisono et al., 2016) to general Lie groups, continuous Lie-NAG dynamics which are guaranteed to converge to local optimum are obtained. They correspond to momentum versions of gradient flow on Lie groups. A particular case of SO(𝑛) is then studied in details, with objective functions corresponding to leading Generalized EigenValue problems: the Lie-NAG dynamics are first made explicit in coordinates, and then discretized in structure preserving fashions, resulting in optimization algorithms with faithful energy behavior (due to conformal symplecticity) and exactly remaining on the Lie group. Stochastic gradient versions are also investigated. Numerical experiments on both synthetic data and practical problem (LDA for MNIST) demonstrate the effectiveness of the proposed methods as optimization algorithms (\emph{not} as a classification method). 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email