An official website of the United States government
Prosumers with generation and storage capabilities can supply en- ergy back to the grid, or trade their surplus with other prosumers for their mutual benefit. A prosumer aggregation that facilitates such trades will price the energy being traded to achieve an objective such as profit maximization, social welfare, or market equilibrium. We propose the use of reinforcement learning to design a trans- active controller to price energy in a prosumer aggregation. This has an advantage over other decentralized pricing mechanisms as it does not rely on iterative price settlement or load estimation by prosumers, and estimates the price in a day ahead manner. We present numerical case studies to evaluate our controller, and dis- cuss extensions to implement this in real prosumer aggregations.
more »
« less
A Market Mechanism for Truthful Bidding with Energy Storage
This paper proposes a market mechanism for multi-interval electricity markets with generator and storage participants. Drawing ideas from supply function bidding, we introduce a novel bid structure for storage participation that allows storage units to communicate their cost to the market using energy cycling functions that map prices to cycle depths. The resulting market-clearing process--implemented via convex programming--yields corresponding schedules and payments based on traditional energy prices for power supply and per-cycle prices for storage utilization. We illustrate the benefits of our solution by comparing the competitive equilibrium of the resulting mechanism to that of an alternative solution that uses prosumer-based bids. Our solution shows several advantages over the prosumer-based approach. It does not require a priori price estimation. It also incentivizes participants to reveal their truthful costs, thus leading to an efficient, competitive equilibrium. Numerical experiments using New York Independent System Operator (NYISO) data validate our findings.
more »
« less
- PAR ID:
- 10350305
- Date Published:
- Journal Name:
- Power Systems Computation Conference (PSCC)
- Page Range / eLocation ID:
- 1-9
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This paper develops competitive bidding strategies for an online linear optimization problem with inventory management constraints in both cost minimization and profit maximization settings. In the minimization problem, a decision maker should satisfy its time-varying demand by either purchasing units of an asset from the market or producing them from a local inventory with limited capacity. In the maximization problem, a decision maker has a time-varying supply of an asset that may be sold to the market or stored in the inventory to be sold later. In both settings, the market price is unknown in each timeslot and the decision maker can submit a finite number of bids to buy/sell the asset. Once all bids have been submitted, the market price clears and the amount bought/sold is determined based on the clearing price and submitted bids. From this setup, the decision maker must minimize/maximize their cost/profit in the market, while also devising a bidding strategy in the face of an unknown clearing price. We propose DEMBID and SUPBID, two competitive bidding strategies for these online linear optimization problems with inventory management constraints for the minimization and maximization setting respectively. We then analyze the competitive ratios of the proposed algorithms and show that the performance of our algorithms approaches the best possible competitive ratio as the maximum number of bids increases. As a case study, we use energy data traces from Akamai data centers, renewable outputs from NREL, and energy prices from NYISO to show the effectiveness of our bidding strategies in the context of energy storage management for a large energy customer participating in a real-time electricity market.more » « less
-
Abstract Prosumers adopt distributed energy resources (DER) to cover part of their own consumption and to sell surplus energy. Although individual prosumers are too dispersed to exert operational market power, they may collectively hold a strategic advantage over conventional generation in selecting DER capacity via aggregators. We devise a bilevel model to examine DER capacity sizing by a collective prosumer as a Stackelberg leader in an electricity industry where conventional generation may exert market power in operations. At the upper level, the prosumer chooses DER capacity in anticipation of lower-level operations by conventional generation and DER output. We demonstrate that exertion of market power in operations by conventional generation and the marginal cost of conventional generation affect DER investment by the prosumer in a nonmonotonic manner. Intuitively, in an industry where conventional generation exerts market power in operations similar to a monopoly (MO), the prosumer invests in more DER capacity than under perfectly competitive operations (PC) to take advantage of a high market-clearing price. However, if the marginal cost of conventional generation is high enough, then this intuitive result is reversed as the prosumer adopts more DER capacity under PC than under MO. This is because the high marginal cost of conventional generation prevents the market-clearing price from decreasing, thereby allowing for higher prosumer revenues. Moreover, competition relieves the chokehold on consumption under MO, which further incentivises the prosumer to expand DER capacity to capture market share. We prove the existence of a critical threshold for the marginal cost of conventional generation that leads to this counterintuitive result. Finally, we propose a countervailing regulatory mechanism that yields welfare-enhancing DER investment even in deregulated electricity industries.more » « less
-
Utilizing distributed renewable and energy storage resources via peer-to-peer (P2P) energy trading has long been touted as a solution to improve energy system’s resilience and sustainability. Consumers and prosumers (those who have energy generation resources), however, do not have expertise to engage in repeated P2P trading, and the zero-marginal costs of renewables present challenges in determining fair market prices. To address these issues, we propose a multi-agent reinforcement learning (MARL) framework to help automate consumers’ bidding and management of their solar PV and energy storage resources, under a specific P2P clearing mechanism that utilizes the so-called supply-demand ratio. In addition, we show how the MARL framework can integrate physical network constraints to realize decentralized voltage control, hence ensuring physical feasibility of the P2P energy trading and paving ways for real-world implementations.more » « less
-
Under the ruling of FERC Order 2222, prosumers who own distributed energy resources are expected to play an essential role that can significantly affect the market outcomes. This paper assesses the market power potential of a risk-averse prosumer by designating it as a Stackelberg leader in the market. We formulate the problem as a mathematical program with equilibrium constraints with a distributionally robust chance-constrained framework to account for the renewable generation uncertainty. The numerical results demonstrate that the prosumer’s strategy depends on the magnitude of renewable generation uncertainty and the degree of risk aversion, which jointly affect the perceived quantity of its renewable resources. The risk-averse Stackelberg case always yields a higher payoff for the prosumer compared to the Cournot and perfect competition cases. Moreover, it is more potent for the prosumer to exercise buyer’s market power rather than seller’s market power. The situation worsens when the prosumer is less risk averse. This highlights the importance of understanding the role of the prosumer acting either as a consumer or as a producer and the risk faced by the prosumer when evaluating its interaction with the wholesale market.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
