skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on December 12, 2025

Title: QLSTM-Based Microgrid Daily Operation with Renewable Uncertainty
Microgrid is a small-scale grid where generation is close to the demand allowing more penetration of renewables, like photovoltaic (PV). However, the intermittent nature of PV power generation poses a significant challenge in microgrid operation, especially on days with highly variable weather conditions. In this paper, a deep reinforcement Q-learning long short-term memory (QLSTM) model is developed to predict the operation strategy of a microgrid for the next day at a 15-minute time interval. To address the uncertainty of PV power and demand, the previous three days’ PV and load data are added as inputs to the model since weather conditions on consecutive days may depend on similar atmospheric conditions. Also, to address the effect of propagation of error in the long forecasting horizon with multiple steps, a moving window training method is implemented. The moving window will be shifted by 15 minutes at each step once the actual PV and load data are available till the end of the day. The model is tested in a microgrid consisting of combined cooling, heating and power, heat pump, PV, battery, and heating and cooling energy storage systems. Results show that our model outperforms gated recurrent unit, LSTM, and Q-learning for testing data from different months. Also, it shows better performance than MATLAB 2023 Optimization Toolbox (the branch-and-bound method) which uses forecasted data, especially on a day with highly variable weather conditions.  more » « less
Award ID(s):
2340095
PAR ID:
10610247
Author(s) / Creator(s):
; ;
Publisher / Repository:
IEEE
Date Published:
ISBN:
979-8-3315-1849-3
Page Range / eLocation ID:
1 to 6
Subject(s) / Keyword(s):
Microgrid operation PV QLSTM uncertainty
Format(s):
Medium: X
Location:
Dubai, United Arab Emirates
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    High transportation costs make energy and food expensive in remote communities worldwide, especially in high-latitude Arctic climates. Past attempts to grow food indoors in these remote areas have proven uneconomical due to the need for expensive imported diesel for heating and electricity. This study aims to determine whether solar photovoltaic (PV) electricity can be used affordably to power container farms integrated with a remote Arctic community microgrid. A mixed-integer linear optimization model (FEWMORE: Food–Energy–Water Microgrid Optimization with Renewable Energy) has been developed to minimize the capital and maintenance costs of installing solar photovoltaics (PV) plus electricity storage and the operational costs of purchasing electricity from the community microgrid to power a container farm. FEWMORE expands upon previous models by simulating demand-side management of container farm loads. Its results are compared with those of another model (HOMER) for a test case. FEWMORE determined that 17 kW of solar PV was optimal to power the farm loads, resulting in a total annual cost decline of ~14% compared with a container farm currently operating in the Yukon. Managing specific loads appropriately can reduce total costs by ~18%. Thus, even in an Arctic climate, where the solar PV system supplies only ~7% of total load during the winter and ~25% of the load during the entire year, investing in solar PV reduces costs. 
    more » « less
  2. null (Ed.)
    With more and more renewable energy resources integrated into the power grid, the system is losing inertia because power electronics-based generators do not provide natural inertia. The low inertia will cause the microgrid to be more sensitive to disturbance and thus a small load change may result in a severe deviation in frequency. Based on the basic VSG algorithm, which is to mimic the characteristic of the traditional synchronous generator, the frequency can be controlled to a stable value faster and more smoothly when there is a fluctuation in the PV power generation and/or load change. However, characteristic of the VSG depends on the system structure in consideration of multiple generations, such as Synchronous Generator (SG), PV and Battery Energy Storage System (BESS), which greatly increases the complexity of applying VSG in practical power system. Furthermore, with BESS-VSG, Maximum Power Point (MPP) operation of PV is guaranteed. In addition, an adaptive VSG method is developed for a microgrid system, and the corresponding simulation in Matlab/Simulink shows the effectiveness of the adaptive VSG method. 
    more » « less
  3. Barambones, Oscar (Ed.)
    Accurate quantification of uncertainty in solar photovoltaic (PV) generation forecasts is imperative for the efficient and reliable operation of the power grid. In this paper, a data-driven non-parametric probabilistic method based on the Naïve Bayes (NB) classification algorithm and Dempster–Shafer theory (DST) of evidence is proposed for day-ahead probabilistic PV power forecasting. This NB-DST method extends traditional deterministic solar PV forecasting methods by quantifying the uncertainty of their forecasts by estimating the cumulative distribution functions (CDFs) of their forecast errors and forecast variables. The statistical performance of this method is compared with the analog ensemble method and the persistence ensemble method under three different weather conditions using real-world data. The study results reveal that the proposed NB-DST method coupled with an artificial neural network model outperforms the other methods in that its estimated CDFs have lower spread, higher reliability, and sharper probabilistic forecasts with better accuracy. 
    more » « less
  4. In this paper, a microgrid scenario composed by a PV generator, a battery system and residential loads in a power Hardware-in-the-Loop (HIL) platform is developed and tested. The electrical structure of the system, the component software modelling and hardware implementation are described. This paper proposes an EMS for microgrid power balance and execution of Time of Use (TOU) and load shedding Demand Response (DR) functions. Experimental results of each component of the scenario are shown. 
    more » « less
  5. Abstract The ability to withstand and recover from disruptions is essential for seaport energy systems, and in light of the growing push for decarbonization, incorporating clean energy sources has become increasingly imperative to ensure resilience. This paper proposes a resilience enhancement planning strategy for a seaport multi‐energy system that integrates various energy modalities and sources, including heating, cooling, hydrogen, solar, and wind power. The planning strategy aims to ensure the reliable operation of the system during contingency events, such as power outages, equipment failures, or extreme weather incidents. The proposed optimization model is designed as a mixed‐integer nonlinear programming formulation, in which McCormick inequalities and other linearization techniques are utilized to tackle the model nonlinearities. The model allocates fuel cell electric trucks (FCETs), renewable energy sources, hydrogen refueling stations, and remote control switches such that the system resilience is enhanced while incorporating natural‐gas‐powered combined cooling, heating, and power system to minimize the operation and unserved demand costs. The model considers various factors such as the availability of renewable energy sources, the demand for heating, cooling, electricity, and hydrogen, the operation of remote control switches to help system reconfiguration, the travel behaviour of FCETs, and the power output of FCETs via vehicle‐to‐grid interface. The numerical results demonstrate that the proposed strategy can significantly improve the resilience of the seaport multi‐energy system and reduce the risk of service disruptions during contingency scenarios. 
    more » « less