skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Wide-area Measurement System-based Low Frequency Oscillation Damping Control through Reinforcement Learning
Ensuring the stability of power systems is gaining more attention today than ever before due to the rapid growth of uncertainties in load and increased renewable energy penetration. Lately, wide-area measurement system (WAMS)-based centralized controlling techniques are offering flexibility and more robust control to keep the system stable. WAMS-based controlling techniques, however, face pressing challenges of irregular delays in long-distance communication channels and subsequent responses of equipment to control actions. This paper presents an innovative control strategy for damping down low-frequency oscillations in transmission systems. The method uses a reinforcement learning technique to overcome the challenges of communication delays and other non-linearity in wide-area damping control. It models the traditional problem of oscillation damping control as a novel faster exploration-based deep deterministic policy gradient (DDPG-S). An effective reward function is designed to capture necessary features of oscillations enabling timely damping of such oscillations, even under various kinds of uncertainties. A detailed analysis and a systematically designed numerical validation are presented to prove feasibility, scalability, interpretability, and comparative performance of the modelled low-frequency oscillation damping controller. The benefit of the technique is that stability is ensured even when uncertainties of load and generation are on the rise.  more » « less
Award ID(s):
1810537
PAR ID:
10189311
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
IEEE Transactions on Smart Grid
ISSN:
1949-3053
Page Range / eLocation ID:
1 to 1
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper assesses the stability improvements that can be achieved through the coordinated wide-area control of power system stabilizers (PSSs), static VAr compensators (SVCs), and supplementary damping controllers (SDCs) for damping low frequency oscillations (LFOs) in a power system embedded with multiple high voltage DC (HVDC) lines. The improved damping is achieved by designing a coordinated widearea damping controller (CWADC) that employs partial state feedback. The design methodology uses a linear matrix inequality (LMI)-based mixed H2=H1 robust control for multiple operating scenarios. To reduce the high computational burden, an enhanced version of selective modal analysis (SMA) is employed that not only reduces the number of required wide-area feedback signals, but also identifies alternate feedback signals. Additionally, the impact of delays on the performance of the control design is investigated. The studies are performed on a 29 machine, 127 bus equivalent model of the Western Electricity Coordinating Council (WECC) system-embedded with three HVDC lines and two wind farms. 
    more » « less
  2. Suppressing spurious oscillations is crucial for designing reliable high-order numerical schemes for hyperbolic conservation laws, yet it has been a challenge actively investigated over the past several decades. This paper proposes a novel, robust, and efficient oscillation-eliminating discontinuous Galerkin (OEDG) method on general meshes, motivated by the damping technique (see J. Lu, Y. Liu, and C. W. Shu [SIAM J. Numer. Anal. 59 (2021), pp. 1299–1324]). The OEDG method incorporates an oscillation-eliminating (OE) procedure after each Runge–Kutta stage, and it is devised by alternately evolving the conventional semidiscrete discontinuous Galerkin (DG) scheme and a damping equation. A novel damping operator is carefully designed to possess bothscale-invariantandevolution-invariantproperties. We rigorously prove the optimal error estimates of the fully discrete OEDG method for smooth solutions of linear scalar conservation laws. This might be the first generic fully discrete error estimate fornonlinearDG schemes with an automatic oscillation control mechanism. The OEDG method exhibits many notable advantages. It effectively eliminates spurious oscillations for challenging problems spanning various scales and wave speeds, without necessitating problem-specific parameters for all the tested cases. It also obviates the need for characteristic decomposition in hyperbolic systems. Furthermore, it retains the key properties of the conventional DG method, such as local conservation, optimal convergence rates, and superconvergence. Moreover, the OEDG method maintains stability under the normal Courant–Friedrichs–Lewy (CFL) condition, even in the presence of strong shocks associated with highly stiff damping terms. The OE procedure isnonintrusive, facilitating seamless integration into existing DG codes as an independent module. Its implementation is straightforward and efficient, involving only simple multiplications of modal coefficients by scalars. The OEDG approach provides new insights into the damping mechanism for oscillation control.It reveals the role of the damping operator as a modal filter, establishing close relations between the damping technique and spectral viscosity techniques.Extensive numerical results validate the theoretical analysis and confirm the effectiveness and advantages of the OEDG method. 
    more » « less
  3. Connected automated vehicles (CAVs), built upon advanced vehicle control and communication technology, can improve traffic throughput, safety, and energy efficiency. Previous studies on CAVs control focus on instability and stability properties of CAV platoons; however, these analyses cannot reveal the damping platoon oscillation characteristics, which are important for enhancing CAV platoon reliability against variant continuous perturbations. To this end, this research seeks to characterize the damping oscillations of CAVs through exploiting the platoon's unforced oscillatory, i.e., damping behavior. Inspired by the mechanical vibration theory, the proposed approach is applied to a CAV platoon with linear car-following control formulated as Helly's model and the predecessor-following communication topology. The proposed approach is applied to a CAV platoon with the linear car-following control formulated as Helly's model and the predecessor-following communication topology. Numerical analysis results show that a periodic perturbation with the resonance frequency of the CAV platoon will amplify the oscillation and lead to the severest oscillatory traffic. Our analysis highlights the importance of preventing platoon oscillations from resonance in ensuring CAV platooning reliability. 
    more » « less
  4. Wide Area Measurement Systems (WAMS) use an underlying communication network to collect and analyze data from devices in the power grid, aimed to improve grid operations. For WAMS to be effective, the communication network needs to support low packet latency and low packet losses. Internet Protocol (IP), the pervasive technology used in today’s communication networks uses loop-free best-paths for data forwarding, which increases the load on these paths causing delays and losses in delivery. Information-Centric Networking (ICN), a new networking paradigm, designed to enable a data-centric information sharing, natively supports the concurrent use of multiple transmission interfaces, in-networking caching, as well as per-packet security and can provide better application support. In this paper, we present , an ICN-based network architecture for wide area smart grid communications. We demonstrate through simulations that achieves low latency and 100% data delivery even during network congestion by leveraging multiple available paths; thus significantly improving communication resiliency in comparison to an IP-based approach. can be used immediately on today’s Internet as an overlay. 
    more » « less
  5. In recent years, the frequency of forced oscillation events due to control system malfunctions or improper parameter settings has increased. Tuning the parameters of exciters and governor models is crucial for maintaining power system stability. Traditional simulation studies typically involve small transient disturbances or step changes to find optimal parameter sets, but existing optimization algorithms often fall short in fine-tuning for forced oscillations. Identifying the sensitive parameters within these control models is essential for ensuring stability during large, sustained disturbances. This study focuses on identifying these critical exciter and governor model parameters by analyzing their influence on sustained forced oscillations. Using Kundur’s two-area system, we analyze common exciter models such as SCRX, ESST1A, and AC7B, along with governor models like GAST, HYGOV, and GGOV1, utilizing PSS®E software version 34. Sustained forced oscillations are injected at generator-1 of area-1, with individual parameter changes dynamically simulated. By considering a local oscillation frequency of 1.4 Hz and an inter-area oscillation mode of 0.25 Hz, we analyze the impact of each parameter change on the magnitude and frequency of forced oscillations as well as on active and reactive power outputs. This novel approach highlights the most influential parameters of each tested model—such as exciter, governor, and turbine gains, as well as time constant parameters—on the impact of forced oscillations. Based on our findings, the sensitive parameters of each tested model are ranked. These would provide valuable insights for industry operators to fine-tune control settings during oscillation events, ultimately enhancing system stability. 
    more » « less