skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Cost-Optimized Microgrid Coalitions Using Bayesian Reinforcement Learning
Microgrids are empowered by the advances in renewable energy generation, which enable the microgrids to generate the required energy for supplying their loads and trade the surplus energy to other microgrids or the macrogrid. Microgrids need to optimize the scheduling of their demands and energy levels while trading their surplus with others to minimize the overall cost. This can be affected by various factors such as variations in demand, energy generation, and competition among microgrids due to their dynamic nature. Thus, reaching optimal scheduling is challenging due to the uncertainty caused by the generation/consumption of renewable energy and the complexity of interconnected microgrids and their interplay. Previous works mainly rely on modeling-based approaches and the availability of precise information on microgrid dynamics. This paper addresses the energy trading problem among microgrids by minimizing the cost while uncertainty exists in microgrid generation and demand. To this end, a Bayesian coalitional reinforcement learning-based model is introduced to minimize the energy trading cost among microgrids by forming stable coalitions. The results show that the proposed model can minimize the cost up to 23% with respect to the coalitional game theory model.  more » « less
Award ID(s):
1915756
PAR ID:
10317936
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Energies
Volume:
14
Issue:
22
ISSN:
1996-1073
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Energies)
    null (Ed.)
    Peer-to-peer energy trading within microgrid (MG) communities emerges as a key enabler of the future transactive distribution system and the transactive electricity market. Energy trading within MGs refers to the idea that the surplus energy of one MG can be used to satisfy the demand of another MG or a group of MGs that form an MG community. These communities can be dynamically established through time, based on the variations of demand and supply of the interconnected MGs. In many modern MGs, Electric Vehicles (EVs) have been considered as a viable storage option due to their ease of use (plug-and-play) and their growing adoption rates by drivers. On the other hand, the dynamic nature of EVs escalates the uncertainty in the transactive distribution system. In this paper, we study the problem of energy trading among MGs and EVs with the aim of power loss minimization where there is uncertainty. We propose a novel Bayesian Coalition Game (BCG) based algorithm, which allows the MGs and EVs to reduce the overall power loss by allowing them to form coalitions intelligently. The proposed scheme is compared with a conventional coalitional game theory-based approach and a Q-learning based approach. Our results show significant improvement over other compared techniques. 
    more » « less
  2. ; ; ; ; ; (, IEEE Journal on Selected Areas in Communications)
    As distributed energy resources (DERs) are widely deployed, DC packetized power microgrids have been considered as a promising solution to incorporate DERs effectively and steadily. In this paper, we consider a DC packetized power microgrid, where the energy is dispatched in the form of power packets with the assist of a power router. However, the benefits of the microgrid can only be realized when energy subscribers (ESs) equipped with DERs actively participate in the energy market. Therefore, peer-to-peer (P2P) energy trading is necessary in the DC packetized power microgrid to encourage the usage of DERs. Different from P2P energy trading in AC microgrids, the dispatching capability of the router needs to be considered in DC microgrids, which will complicate the trading problem. To tackle this challenge, we formulate the P2P trading problem as an auction game, in which the demander ESs submit bids to compete for power packets, and a controller decides the energy allocation and power packet scheduling. Analysis of the proposed scheme is provided, and its effectiveness is validated through simulation. 
    more » « less
  3. ; ; (, Journal of cleaner production)
    null (Ed.)
    A variety of methods have been proposed to assist the integration of microgrid in flow shop systems with the goal of attaining eco-friendly operations. There is still a lack of integrated planning models in which renewable portfolio, microgrid capacity and production plan are jointly optimized under power demand and generation uncertainty. This paper aims to develop a two-stage, mixed-integer programming model to minimize the levelized cost of energy of a flow shop powered by onsite renewables. The first stage minimizes the annual energy use subject to a job throughput requirement. The second stage aims at sizing wind turbine, solar panels and battery units to meet the hourly electricity needs during a year. Climate analytics are employed to characterize the stochastic wind and solar capacity factor on an hourly basis. The model is tested in four locations with a wide range of climate conditions. Three managerial insights are derived from the numerical experiments. First, time-of-use tariff significantly stimulates the wind penetration in locations with medium or low wind speed. Second, regardless of the climate conditions, large-scale battery storage units are preferred under time-of-use rate but it is not the case under a net metering policy. Third, wind- and solar-based microgrid is scalable and capable of meeting short-term demand variation and long-term load growth with a stable energy cost rate. 
    more » « less
  4. ; (, IEEE Access)
    This article studies the design, modeling, and control of microgrid systems with the inclusion of internal electro-thermal dynamics. Microgrids play a vital role in integrating renewable energy and enabling distributed energy systems. However, their complexity arising from diverse and dynamic components necessitates advanced control strategies. While existing works often utilize model-based controllers, the focus is primarily on electrical dynamics, with limited attention to the thermal behavior of components. The intricate interplay between electrical and thermal power terms heavily impacts component behavior, exemplified by the dependency of photovoltaic (PV) module electricity production on temperature. This article addresses the limited studies on electro-thermal microgrid dynamics through three contributions. First, a candidate microgrid design is developed to utilize electro-thermal knowledge, incorporating active cooling for PVs. Second, a graph-based modeling methodology is expanded to represent microgrid component- and system-level dynamics. Third, a hierarchical control framework is developed to define controllers for microgrids using the graphical model. Controllers produced from the framework enable management of electro-thermal behavior while adhering to battery charge limits. Case studies utilizing realistic environmental data are explored to evaluate the performance of the proposed system. Results indicate design and model-based control that integrate electro-thermal dynamics provide improvements to energy generation and performance even under nonideal conditions. 
    more » « less
  5. ; ; (, Proceedings of the 2021 Institute of Industrial and Systems Engineers (IISE) Conference)
    Ghate, A.; Krishnaiyer, K.; Paynabar, K. (Ed.)
    This study presents a two-stage stochastic aggregate production planning model to determine the optimal renewable generation capacity, production plan, workforce levels, and machine hours that minimize a production system’s operational cost. The model considers various uncertainties, including demand for final products, machine and labor hours available, and renewable power supply. The goal is to evaluate the feasibility of decarbonizing the manufacturing, transportation, and warehousing operations by adopting onsite wind turbines and solar photovoltaics coupled with battery systems assuming the facilities are energy prosumers. First-stage decisions are the siting and sizing of wind and solar generation, battery capacity, production quantities, hours of labor to keep, hire, or layoff, and regular, overtime, and idle machine hours to allocate over the planning horizon. Second-stage recourse actions include storing products in inventory, subcontracting or backorder, purchasing or selling energy to the main grid, and daily charging or discharging energy in the batteries in response to variable generation. Climate analytics performed in San Francisco and Phoenix permit to derive capacity factors for the renewable energy technologies and test their implementation feasibility. Numerical experiments are presented for three instances: island microgrid without batteries, island microgrid with batteries, and grid-tied microgrid for energy prosumer. Results show favorable levelized costs of energy that are equal to USD48.37/MWh, USD64.91/MWh, and USD36.40/MWh, respectively. The model is relevant to manufacturing companies because it can accelerate the transition towards eco-friendly operations through distributed generation. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email