skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 10:00 PM to 12:00 PM ET on Tuesday, March 25 due to maintenance. We apologize for the inconvenience.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Cost-Optimized Microgrid Coalitions Using Bayesian Reinforcement Learning
Microgrids are empowered by the advances in renewable energy generation, which enable the microgrids to generate the required energy for supplying their loads and trade the surplus energy to other microgrids or the macrogrid. Microgrids need to optimize the scheduling of their demands and energy levels while trading their surplus with others to minimize the overall cost. This can be affected by various factors such as variations in demand, energy generation, and competition among microgrids due to their dynamic nature. Thus, reaching optimal scheduling is challenging due to the uncertainty caused by the generation/consumption of renewable energy and the complexity of interconnected microgrids and their interplay. Previous works mainly rely on modeling-based approaches and the availability of precise information on microgrid dynamics. This paper addresses the energy trading problem among microgrids by minimizing the cost while uncertainty exists in microgrid generation and demand. To this end, a Bayesian coalitional reinforcement learning-based model is introduced to minimize the energy trading cost among microgrids by forming stable coalitions. The results show that the proposed model can minimize the cost up to 23% with respect to the coalitional game theory model.  more » « less
Award ID(s):
1915756
PAR ID:
10317936
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Energies
Volume:
14
Issue:
22
ISSN:
1996-1073
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Energies)
    null (Ed.)
    Peer-to-peer energy trading within microgrid (MG) communities emerges as a key enabler of the future transactive distribution system and the transactive electricity market. Energy trading within MGs refers to the idea that the surplus energy of one MG can be used to satisfy the demand of another MG or a group of MGs that form an MG community. These communities can be dynamically established through time, based on the variations of demand and supply of the interconnected MGs. In many modern MGs, Electric Vehicles (EVs) have been considered as a viable storage option due to their ease of use (plug-and-play) and their growing adoption rates by drivers. On the other hand, the dynamic nature of EVs escalates the uncertainty in the transactive distribution system. In this paper, we study the problem of energy trading among MGs and EVs with the aim of power loss minimization where there is uncertainty. We propose a novel Bayesian Coalition Game (BCG) based algorithm, which allows the MGs and EVs to reduce the overall power loss by allowing them to form coalitions intelligently. The proposed scheme is compared with a conventional coalitional game theory-based approach and a Q-learning based approach. Our results show significant improvement over other compared techniques. 
    more » « less
  2. ; ; ; ; ; (, IEEE Journal on Selected Areas in Communications)
    As distributed energy resources (DERs) are widely deployed, DC packetized power microgrids have been considered as a promising solution to incorporate DERs effectively and steadily. In this paper, we consider a DC packetized power microgrid, where the energy is dispatched in the form of power packets with the assist of a power router. However, the benefits of the microgrid can only be realized when energy subscribers (ESs) equipped with DERs actively participate in the energy market. Therefore, peer-to-peer (P2P) energy trading is necessary in the DC packetized power microgrid to encourage the usage of DERs. Different from P2P energy trading in AC microgrids, the dispatching capability of the router needs to be considered in DC microgrids, which will complicate the trading problem. To tackle this challenge, we formulate the P2P trading problem as an auction game, in which the demander ESs submit bids to compete for power packets, and a controller decides the energy allocation and power packet scheduling. Analysis of the proposed scheme is provided, and its effectiveness is validated through simulation. 
    more » « less
  3. ; ; (, Journal of cleaner production)
    null (Ed.)
    A variety of methods have been proposed to assist the integration of microgrid in flow shop systems with the goal of attaining eco-friendly operations. There is still a lack of integrated planning models in which renewable portfolio, microgrid capacity and production plan are jointly optimized under power demand and generation uncertainty. This paper aims to develop a two-stage, mixed-integer programming model to minimize the levelized cost of energy of a flow shop powered by onsite renewables. The first stage minimizes the annual energy use subject to a job throughput requirement. The second stage aims at sizing wind turbine, solar panels and battery units to meet the hourly electricity needs during a year. Climate analytics are employed to characterize the stochastic wind and solar capacity factor on an hourly basis. The model is tested in four locations with a wide range of climate conditions. Three managerial insights are derived from the numerical experiments. First, time-of-use tariff significantly stimulates the wind penetration in locations with medium or low wind speed. Second, regardless of the climate conditions, large-scale battery storage units are preferred under time-of-use rate but it is not the case under a net metering policy. Third, wind- and solar-based microgrid is scalable and capable of meeting short-term demand variation and long-term load growth with a stable energy cost rate. 
    more » « less
  4. ; ; (, Proceedings of the 2021 Institute of Industrial and Systems Engineers (IISE) Conference)
    Ghate, A.; Krishnaiyer, K.; Paynabar, K. (Ed.)
    This study presents a two-stage stochastic aggregate production planning model to determine the optimal renewable generation capacity, production plan, workforce levels, and machine hours that minimize a production system’s operational cost. The model considers various uncertainties, including demand for final products, machine and labor hours available, and renewable power supply. The goal is to evaluate the feasibility of decarbonizing the manufacturing, transportation, and warehousing operations by adopting onsite wind turbines and solar photovoltaics coupled with battery systems assuming the facilities are energy prosumers. First-stage decisions are the siting and sizing of wind and solar generation, battery capacity, production quantities, hours of labor to keep, hire, or layoff, and regular, overtime, and idle machine hours to allocate over the planning horizon. Second-stage recourse actions include storing products in inventory, subcontracting or backorder, purchasing or selling energy to the main grid, and daily charging or discharging energy in the batteries in response to variable generation. Climate analytics performed in San Francisco and Phoenix permit to derive capacity factors for the renewable energy technologies and test their implementation feasibility. Numerical experiments are presented for three instances: island microgrid without batteries, island microgrid with batteries, and grid-tied microgrid for energy prosumer. Results show favorable levelized costs of energy that are equal to USD48.37/MWh, USD64.91/MWh, and USD36.40/MWh, respectively. The model is relevant to manufacturing companies because it can accelerate the transition towards eco-friendly operations through distributed generation. 
    more » « less
  5. ; ; ; ; (, Energies)
    null (Ed.)
    Stability and reliability are of the most important concern for isolated microgrid systems that have no support from the utility grid. Interval predictions are often applied to ensure the system stability of isolated microgrids as they cover more uncertainties and robust control can be achieved based on more sufficient information. In this paper, we propose a probabilistic microgrid energy exchange method based on the Model Predictive Control (MPC) approach to make better use of the prediction intervals so that the system stability and cost efficiency of isolated microgrids are improved simultaneously. Appropriate scenarios are selected from the predictions according to the evaluation of future trends and system capacity. In the meantime, a two-stage adaptive reserve strategy is adopted to further utilize the potential of interval predictions and maintain the system security adaptively. Reserves are determined at the optimization stage to prepare some extra capacity for the fluctuations in the renewable generation and load demand at the operation stage based on the aggressive and conservative level of the system, which is automatically updated at each step. The optimal dispatch problem is finally formulated using the mixed-integer linear programming model and the MPC is formulated as an optimization problem with a discount factor introduced to adjust the weights. Case studies show that the proposed method could effectively guarantee the stability of the system and improve economic performance. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email