skip to main content


Title: Kullback-Leibler-Quadratic Optimal Control of Flexible Power Demand
A new stochastic control methodology is introduced for distributed control, motivated by the goal of creating virtual energy storage from flexible electric loads, i.e. Demand Dispatch. In recent work, the authors have introduced Kullback- Leibler-Quadratic (KLQ) optimal control as a stochastic control methodology for Markovian models. This paper develops KLQ theory and demonstrates its applicability to demand dispatch. In one formulation of the design, the grid balancing authority simply broadcasts the desired tracking signal, and the hetero-geneous population of loads ramps power consumption up and down to accurately track the signal. Analysis of the Lagrangian dual of the KLQ optimization problem leads to a menu of solution options, and expressions of the gradient and Hessian suitable for Monte-Carlo-based optimization. Numerical results illustrate these theoretical results.  more » « less
Award ID(s):
1646229
NSF-PAR ID:
10211832
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
IEEE Conference Decision and Control
Page Range / eLocation ID:
4195 to 4201
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. There is enormous flexibility potential in the power consumption of the majority of electric loads. This flexibility can be harnessed to obtain services for managing the grid: with carefully designed decision rules in place, power consumption for the population of loads can be ramped up and down, just like charging and discharging a battery, without any significant impact to consumers' needs. The concept is called Demand Dispatch, and the grid resource obtained from this design virtual energy storage (VES). In order to deploy VES, a balancing authority is faced with two challenges: 1. how to design local decision rules for each load given the target aggregate power consumption (distributed control problem), and 2. how to coordinate a portfolio of resources to maintain grid balance, given a forecast of net-load (resource allocation problem).Rather than separating resource allocation and distributed control, in this paper the two problems are solved simultaneously using a single convex program. The joint optimization model is cast as a finite-horizon optimal control problem in a mean-field setting, based on the new KLQ optimal control approach proposed recently by the authors.The simplicity of the proposed control architecture is remarkable: With a large portfolio of heterogeneous flexible resources, including loads such as residential water heaters, commercial water heaters, irrigation, and utility-scale batteries, the control architecture leads to a single scalar control signal broadcast to every resource in the domain of the balancing authority. Keywords: Smart grids, demand dispatch, distributed control, controlled Markov chains. 
    more » « less
  2. Andrea Serrani (Ed.)
    Over the past decade, there has been significant progress on the science of load control for the creation of virtual energy storage. This is an alternative to demand response, and it is termed demand dispatch. Distributed control is used to manage millions of flexible loads to modify the power consumption of the aggregation, which can be ramped up and down, just like discharging and charging a battery. A challenge with distributed control is heterogeneity of the population of loads, which complicates control at the aggregate level. It is shown in this article that additional control at each load in the population can result in a far aggregate model. The local control is designed to flatten resonances and produce approximately all-pass response. Analysis is based on mean-field control for the heterogeneous population; the mean-field model is only justified because of the additional local control introduced in this article. Theory and simulations indicate that the resulting input--output dynamics of the aggregate has a nearly flat input--output response: the behavior of an ideal, multi-GW battery system. 
    more » « less
  3. null (Ed.)
    Stability and reliability are of the most important concern for isolated microgrid systems that have no support from the utility grid. Interval predictions are often applied to ensure the system stability of isolated microgrids as they cover more uncertainties and robust control can be achieved based on more sufficient information. In this paper, we propose a probabilistic microgrid energy exchange method based on the Model Predictive Control (MPC) approach to make better use of the prediction intervals so that the system stability and cost efficiency of isolated microgrids are improved simultaneously. Appropriate scenarios are selected from the predictions according to the evaluation of future trends and system capacity. In the meantime, a two-stage adaptive reserve strategy is adopted to further utilize the potential of interval predictions and maintain the system security adaptively. Reserves are determined at the optimization stage to prepare some extra capacity for the fluctuations in the renewable generation and load demand at the operation stage based on the aggressive and conservative level of the system, which is automatically updated at each step. The optimal dispatch problem is finally formulated using the mixed-integer linear programming model and the MPC is formulated as an optimization problem with a discount factor introduced to adjust the weights. Case studies show that the proposed method could effectively guarantee the stability of the system and improve economic performance. 
    more » « less
  4. Editor-in-Chief: George Yin (Ed.)
    This paper presents approaches to mean-field control, motivated by distributed control of multi-agent systems. Control solutions are based on a convex optimization problem, whose domain is a convex set of probability mass functions (pmfs). The main contributions follow: 1. Kullback-Leibler-Quadratic (KLQ) optimal control is a special case, in which the objective function is composed of a control cost in the form of Kullback-Leibler divergence between a candidate pmf and the nominal, plus a quadratic cost on the sequence of marginals. Theory in this paper extends prior work on deterministic control systems, establishing that the optimal solution is an exponential tilting of the nominal pmf. Transform techniques are introduced to reduce complexity of the KLQ solution, motivated by the need to consider time horizons that are much longer than the inter-sampling times required for reliable control. 2. Infinite-horizon KLQ leads to a state feedback control solution with attractive properties. It can be expressed as either state feedback, in which the state is the sequence of marginal pmfs, or an open loop solution is obtained that is more easily computed. 3. Numerical experiments are surveyed in an application of distributed control of residential loads to provide grid services, similar to utility-scale battery storage. The results show that KLQ optimal control enables the aggregate power consumption of a collection of flexible loads to track a time-varying reference signal, while simultaneously ensuring each individual load satisfies its own quality of service constraints. 
    more » « less
  5. null (Ed.)
    This paper presents a multi-objective (MO) optimization for economic/emission dispatch (EED) problem incorporating hydrothermal plants, wind power generation, energy storage systems (ESSs) and responsive loads. The uncertain behavior of wind turbines and electric loads is modeled by scenarios. Stochastic programming is proposed to achieve the expected cost and emission production. Moreover, the carbon capture systems are considered to lower the level of carbon emission produced by conventional thermal units. The proposed optimization problem is tested on the IEEE 24-bus case study using DC power flow calculation. The optimal Pareto frontier is obtained, and a fuzzy decision-making tool determined the best solution among obtained Pareto points. The problem is modeled as mixed-integer non-linear programming in the General Algebraic Modelling System (GAMS) and solved using DICOPT solver. 
    more » « less