skip to main content


Title: Hierarchical MPC with Coordinating Terminal Costs
The performance of hierarchical Model Predictive Control (MPC) is highly dependent on the mechanisms used to coordinate the decisions made by controllers at different levels of the hierarchy. Conventionally, reference tracking serves as the primary coordination mechanism, where optimal state and input trajectories determined by upper-level controllers are communicated down the hierarchy to be tracked by lower-level controllers. As such, significant tuning is required for each controller in the hierarchy to achieve the desired closed-loop system performance. This paper presents a novel terminal cost coordination mechanism using constrained zonotopes, designed to improve system performance under hierarchical control. These terminal costs allow lower-level controllers to balance both short- and long-term control performance without the need for controller tuning. Unlike terminal costs widely used to guarantee MPC stability, the proposed terminal costs are time-varying and computed on-line based on the optimal state trajectory of the upper-level controllers. A numerical example demonstrates the provable performance benefits achieved using the proposed terminal cost coordination mechanism.  more » « less
Award ID(s):
1849500
NSF-PAR ID:
10250493
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
American Control Conference
Page Range / eLocation ID:
4126 - 4133
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Hybrid-electric aircraft represent an important step in the transition from conventional fuel-based propulsion to fully-electric aircraft. For hybrid power systems, overall aircraft performance and efficiency highly depend on the coordination of the fuel and electrical systems and the ability to effectively control state and input trajectories at the limits of safe operation. In such a safety-critical application, the chosen control strategy must ensure the closed-loop system adheres to these operational limits. While hierarchical Model Predictive Control (MPC) has proven to be a computationally efficient approach to coordinated control of complex systems across multiple timescales, most formulations are not supported by theoretical guarantees of actuator and state constraint satisfaction. To provide guaranteed constraint satisfaction, this paper presents set-based hierarchical MPC of a 16 state hybrid-electric aircraft power system. Within the proposed two-level vertical hierarchy, the long-term control decisions of the upper-level controller and the short-term control decisions of the lower-level controller are coordinated through the use of waysets. Simulation results show the benefits of this coordination in the context of hybrid-electric aircraft performance and demonstrate the practicality of applying set-based hierarchical MPC to complex multi-timescale systems. 
    more » « less
  2. null (Ed.)
    In modern high-performance aircraft, the Fuel Thermal Management System (FTMS) plays a critical role in the overall thermal energy management of the aircraft. Actuator and state constraints in the FTMS limit the thermal endurance and capabilities of the aircraft. Thus, an effective control strategy must plan and execute optimized transient fuel mass and temperature trajectories subject to these constraints over the entire course of operation. For the control of linear systems, hierarchical Model Predictive Control (MPC) has shown to be an effective approach to coordinating both short- and long-term system operation with reduced computational complexity. However, for controlling nonlinear systems, common approaches to system linearization may no longer be effective due to the long prediction horizons of upper-level controllers. This paper explores the limitations of using linear models for hierarchical MPC of the nonlinear FTMS found in aircraft. Numerical simulation results show that linearized models work well for lower-level controllers with short prediction horizons but lead to significant reductions in aircraft thermal endurance when used for upper-level controllers with long prediction horizons. Therefore, a mixed-linearity hierarchical MPC formulation is presented with a nonlinear upper-level controller and a linear lower-level controller to achieve both high performance and high computational efficiency. 
    more » « less
  3. The control of cryogenic qubits in today’s super-conducting quantum computer prototypes presents significant scalability challenges due to the massive costs of generating/routing the analog control signals that need to be sent from a classical controller at room temperature to the quantum chip inside the dilution refrigerator. Thus, researchers in industry and academia have focused on designing in-fridge classical controllers in order to mitigate these challenges. Due to the maturity of CMOS logic, many industrial efforts (Microsoft, Intel) have focused on Cryo-CMOS as a near-term solution to design in-fridge classical controllers. Meanwhile, Supercon-ducting Single Flux Quantum (SFQ) is an alternative, less mature classical logic family proposed for large-scale in-fridge controllers. SFQ logic has the potential to maximize scalability thanks to its ultra-high speed and very low power consumption. However, architecture design for SFQ logic poses challenges due to its unconventional pulse-driven nature and lack of dense memory and logic. Thus, research at the architecture level is essential to guide architects to design SFQ-based classical controllers for large-scale quantum machines.In this paper, we present DigiQ, the first system-level design of a Noisy Intermediate Scale Quantum (NISQ)-friendly SFQ-based classical controller. We perform a design space exploration of SFQ-based controllers and co-design the quantum gate decompositions and SFQ-based implementation of those decompositions to find an optimal SFQ-friendly design point that trades area and power for latency and control while ensuring good quantum algorithmic performance. Our co-design results in a single instruction, multiple data (SIMD) controller architecture, which has high scalability, but imposes new challenges on the calibration of control pulses. We present software-level solutions to address these challenges, which if unaddressed would degrade quantum circuit fidelity given the imperfections of qubit hardware.To validate and characterize DigiQ, we first implement it using hardware description languages and synthesize it using state-of-the-art/validated SFQ synthesis tools. Our synthesis results show that DigiQ can operate within the tight power and area budget of dilution refrigerators at >42,000-qubit scales. Second, we confirm the effectiveness of DigiQ in running quantum algorithms by modeling the execution time and fidelity of a variety of NISQ applications. We hope that the promising results of this paper motivate experimentalists to further explore SFQ-based quantum controllers to realize large-scale quantum machines with maximized scalability. 
    more » « less
  4. Abstract This paper presents a hierarchical nonlinear control algorithm for the real-time planning and control of cooperative locomotion of legged robots that collaboratively carry objects. An innovative network of reduced-order models subject to holonomic constraints, referred to as interconnected linear inverted pendulum (LIP) dynamics, is presented to study cooperative locomotion. The higher level of the proposed algorithm employs a supervisory controller, based on event-based model predictive control (MPC), to effectively compute the optimal reduced-order trajectories for the interconnected LIP dynamics. The lower level of the proposed algorithm employs distributed nonlinear controllers to reduce the gap between reduced- and full-order complex models of cooperative locomotion. In particular, the distributed controllers are developed based on quadratic programing (QP) and virtual constraints to impose the full-order dynamical models of each agent to asymptotically track the reduced-order trajectories while having feasible contact forces at the leg ends. The paper numerically investigates the effectiveness of the proposed control algorithm via full-order simulations of a team of collaborative quadrupedal robots, each with a total of 22 degrees-of-freedom. The paper finally investigates the robustness of the proposed control algorithm against uncertainties in the payload mass and changes in the ground height profile. Numerical studies show that the cooperative agents can transport unknown payloads whose masses are up to 57%, 97%, and 137% of a single agent's mass with a team of two, three, and four legged robots. 
    more » « less
  5. We are developing a system for long term Semi-Automated Rehabilitation At the Home (SARAH) that relies on low-cost and unobtrusive video-based sensing. We present a cyber-human methodology used by the SARAH system for automated assessment of upper extremity stroke rehabilitation at the home. We propose a hierarchical model for automatically segmenting stroke survivor's movements and generating training task performance assessment scores during rehabilitation. The hierarchical model fuses expert therapist knowledge-based approaches with data-driven techniques. The expert knowledge is more observable in the higher layers of the hierarchy (task and segment) and therefore more accessible to algorithms incorporating high level constraints relating to activity structure (i.e., type and order of segments per task). We utilize an HMM and a Decision Tree model to connect these high level priors to data driven analysis. The lower layers (RGB images and raw kinematics) need to be addressed primarily through data driven techniques. We use a transformer based architecture operating on low-level action features (tracking of individual body joints and objects) and a Multi-Stage Temporal Convolutional Network(MS-TCN) operating on raw RGB images. We develop a sequence combining these complimentary algorithms effectively, thus encoding the information from different layers of the movement hierarchy. Through this combination, we produce a robust segmentation and task assessment results on noisy, variable and limited data, which is characteristic of low cost video capture of rehabilitation at the home. Our proposed approach achieves 85% accuracy in per-frame labeling, 99% accuracy in segment classification and 93% accuracy in task completion assessment. Although the methodology proposed in this paper applies to upper extremity rehabilitation using the SARAH system, it can potentially be used, with minor alterations, to assist automation in many other movement rehabilitation contexts (i.e., lower extremity training for neurological accidents). 
    more » « less