An official website of the United States government
A general problem encompassing output regulation and pattern generation can be formulated as the design of controllers to achieve convergence to a persistent trajectory within the zero dynamics on which an output vanishes. We develop an optimal control theory for such design by adding the requirement to minimize the H2 norm of a closed-loop transfer function. Within the framework of eigenstructure assignment, the optimal control is proven identical to the standard H2 control in form. However, the solution to the Riccati equation for the linear quadratic regulator is not stabilizing. Instead it partially stabilizes the closed-loop dynamics excluding the zero dynamics. The optimal control architecture is shown to have the feedback of the deviation from the subspace of the zero dynamics and the feedforward of the control input to remain in the subspace.
more »
« less
Linear Optimal Control for Autonomous Pattern Generation
An important objective in the design of feedback control systems is the pattern generation. The term ‘pattern’ denotes the behavior of the individual plant states relative to one another in steady-state, e.g. periodic with a specified frequency and phase offset. Here we solve the optimal, linear, output feedback problem in which the controller is autonomous, achieves pattern generation, and minimizes the L2 norm of the transient portion of the impulse response. Our result reveals the optimal control architecture comprising a linear quadratic regulator and a Kalman filter, along with additional feedback/feedforward to/from a pattern generator, with gains constrained by the regulator equation and its dual, respectively. In contrast to the standard output regulation, the pattern generator is embedded in the feedback loop, allowing the reference signals to be modified autonomously in response to disturbances. A design example illustrates the controller’s ability to recalculate and track the target trajectory following a disturbance.
more »
« less
- Award ID(s):
- 2113528
- PAR ID:
- 10552121
- Publisher / Repository:
- IEEE
- Date Published:
- Journal Name:
- IEEE Transactions on Automatic Control
- Volume:
- 69
- Issue:
- 3
- ISSN:
- 0018-9286
- Page Range / eLocation ID:
- 1402 to 1417
- Subject(s) / Keyword(s):
- Optimal control eigenstructure assignment pattern formation autonomous control linear systems
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In feedback control of dynamical systems, the choice of a higher loop gain is typically desirable to achieve a faster closed-loop dynamics, smaller tracking error, and more effective disturbance suppression. Yet, an increased loop gain requires a higher control effort, which can extend beyond the actuation capacity of the feedback system and intermittently cause actuator saturation. To benefit from the advantages of a high feedback gain and simultaneously avoid actuator saturation, this paper advocates a dynamic gain adaptation technique in which the loop gain is lowered whenever necessary to prevent actuator saturation, and is raised again whenever possible. This concept is optimized for linear systems based on an optimal control formulation inspired by the notion of linear quadratic regulator (LQR). The quadratic cost functional adopted in LQR is modified into a certain quasi-quadratic form in which the control cost is dynamically emphasized or deemphasized as a function of the system state. The optimal control law resulted from this quasi-quadratic cost functional is essentially nonlinear, but its structure resembles an LQR with an adaptable gain adjusted by the state of system, aimed to prevent actuator saturation. Moreover, under mild assumptions analogous to those of LQR, this optimal control law is stabilizing. As an illustrative example, application of this optimal control law in feedback design for dc servomotors is examined, and its performance is verified by numerical simulations.more » « less
-
Quadratic performance indices associated with linear plants offer simplicity and lead to linear feedback control laws, but they may not adequately capture the complexity and flexibility required to address various practical control problems. One notable example is to improve, by using possibly nonlinear laws, on the trade-off between rise time and overshoot commonly observed in classical regulator problems with linear feedback control laws. To address these issues, non-quadratic terms can be introduced into the performance index, resulting in nonlinear control laws. In this study, we tackle the challenge of solving optimal control problems with non-quadratic performance indices using the closed-loop neighboring extremal optimal control (NEOC) approach and homotopy method. Building upon the foundation of the Linear Quadratic Regulator (LQR) framework, we introduce a parameter associated with the non-quadratic terms in the cost function, which is continuously adjusted from 0 to 1. We propose an iterative algorithm based on a closed-loop NEOC framework to handle each gradual adjustment. Additionally, we discuss and analyze the classical work of Bass and Webber, whose approach involves including additional non-quadratic terms in the performance index to render the resulting Hamilton-Jacobi equation analytically solvable. Our findings are supported by numerical examples.more » « less
-
Gradient-based methods have been widely used for system design and optimization in diverse application domains. Recently, there has been a renewed interest in studying theoretical properties of these methods in the context of control and reinforcement learning. This article surveys some of the recent developments on policy optimization, a gradient-based iterative approach for feedback control synthesis that has been popularized by successes of reinforcement learning. We take an interdisciplinary perspective in our exposition that connects control theory, reinforcement learning, and large-scale optimization. We review a number of recently developed theoretical results on the optimization landscape, global convergence, and sample complexityof gradient-based methods for various continuous control problems, such as the linear quadratic regulator (LQR), [Formula: see text] control, risk-sensitive control, linear quadratic Gaussian (LQG) control, and output feedback synthesis. In conjunction with these optimization results, we also discuss how direct policy optimization handles stability and robustness concerns in learning-based control, two main desiderata in control engineering. We conclude the survey by pointing out several challenges and opportunities at the intersection of learning and control.more » « less
-
Motor systems in animals are highly dependent on sensory information for optimal control and precision, with mechanosensory feedback from the somatosensory system playing a critical role. These mechanosensory pathways are woven into the descending feedforward pathways and local central pattern generator circuits that control and generate movement, respectively. Somatosensory feedback in mammals and insects, the two animal classes this review touches upon, is complex due to the increased demands that limbed locomotion, weight-bearing, and corrective movements place on sensorimotor control. In this review, we outline the salient features of the proprioceptive and exteroceptive sensory feedback pathways animals rely on for controlling movement and highlight some of the key principles of sensory feedback that are shared across the animal kingdom.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1109/TAC.2023.3326866
