As distributed energy resources (DERs) are widely deployed, DC packetized power microgrids have been considered as a promising solution to incorporate DERs effectively and steadily. In this paper, we consider a DC packetized power microgrid, where the energy is dispatched in the form of power packets with the assist of a power router. However, the benefits of the microgrid can only be realized when energy subscribers (ESs) equipped with DERs actively participate in the energy market. Therefore, peer-to-peer (P2P) energy trading is necessary in the DC packetized power microgrid to encourage the usage of DERs. Different from P2P energy trading in AC microgrids, the dispatching capability of the router needs to be considered in DC microgrids, which will complicate the trading problem. To tackle this challenge, we formulate the P2P trading problem as an auction game, in which the demander ESs submit bids to compete for power packets, and a controller decides the energy allocation and power packet scheduling. Analysis of the proposed scheme is provided, and its effectiveness is validated through simulation. 
                        more » 
                        « less   
                    
                            
                            Decentralized Voltage Control with Peer-to-peer Energy Trading in a Distribution Network
                        
                    
    
            Utilizing distributed renewable and energy storage resources via peer-to-peer (P2P) energy trading has long been touted as a solution to improve energy system’s resilience and sustainability. Consumers and prosumers (those who have energy generation resources), however, do not have expertise to engage in repeated P2P trading, and the zero-marginal costs of renewables present challenges in determining fair market prices. To address these issues, we propose a multi-agent reinforcement learning (MARL) framework to help automate consumers’ bidding and management of their solar PV and energy storage resources, under a specific P2P clearing mechanism that utilizes the so-called supply-demand ratio. In addition, we show how the MARL framework can integrate physical network constraints to realize decentralized voltage control, hence ensuring physical feasibility of the P2P energy trading and paving ways for real-world implementations. 
        more » 
        « less   
        
    
                            - Award ID(s):
- 2129631
- PAR ID:
- 10552102
- Publisher / Repository:
- Proceedings of the 56th Hawaii International Conference on System Sciences
- Date Published:
- Subject(s) / Keyword(s):
- Distributed, Renewable, and Mobile Resources, multi-agent reinforcement learning, peer-to-peer trading, voltage control
- Format(s):
- Medium: X
- Location:
- 2023-01-03
- Sponsoring Org:
- National Science Foundation
More Like this
- 
            
- 
            null (Ed.)In comparison with conventional content delivery networks, peer-to-peer (p2p) content delivery is promising to save cost and handle high peak-demand, and can also complement the decentralized storage networks such as Filecoin. However, reliable p2p delivery requires proper enforcement of delivery fairness, i.e., the deliverers should be rewarded according to their in-time delivery. Unfortunately, most existing studies on delivery fairness are based on non-cooperative game-theoretic assumptions that are arguably unrealistic in the ad-hoc p2p setting. We for the first time put forth an expressive yet still minimalist security notion for desired fair p2p content delivery, and give two efficient solutions 𝖥𝖺𝗂𝗋𝖣𝗈𝗐𝗇𝗅𝗈𝖺𝖽 and 𝖥𝖺𝗂𝗋𝖲𝗍𝗋𝖾𝖺𝗆 via the blockchain for p2p downloading and p2p streaming scenarios, respectively. Our designs not only guarantee delivery fairness to ensure deliverers be paid (nearly) proportional to their in-time delivery but also ensure the content consumers and content providers are fairly treated. The fairness of each party can be guaranteed when the other two parties collude to arbitrarily misbehave. Moreover, the systems are efficient in the sense of attaining nearly asymptotically optimal on-chain costs and deliverer communication. We implement the protocols and build the prototype systems atop the Ethereum Ropsten network. Extensive experiments done in LAN and WAN settings showcase their high practicality.more » « less
- 
            The rise of peer-to-peer (P2P) marketplace paradigms has transformed existing marketplace models, but the extent to which this approach can be applied to the energy marketplace has yet to be considered. In this paper, we examine existing approaches taken in the application of a P2P paradigm to the energy marketplace, further presenting an approach towards facilitating an online P2P energy marketplace, implementing a prototype P2P web application named SolTrade. Furthermore, we submit initial statistics based on simulated transactions facilitated through the platform, which illustrate the physical impact of marketplace transactions on the energy grid. In particular, these results show that, as the number of users rises, the chance of overloading the grid rises, but the chance of the grid being unable to sustain itself without an external source of energy falls.more » « less
- 
            Peer-to-peer (P2P) energy trading is a decentralized energy market where local energy prosumers act as peers, trading energy among each other. Existing works in this area largely overlook the importance of user behavioral modeling, assume users’ sustained active participation, and full compliance in the decision-making process. To overcome these unrealistic assumptions, and their deleterious consequences, in this paper we propose an automated P2P energy trading framework that specifically considers the users’ perception by exploiting prospect theory . We formalize an optimization problem that maximizes the buyers’ perceived utility while matching energy production and demand. We prove that the problem is NP-hard and we propose a Differential Evolution-based Algorithm for Trading Energy ( DEbATE ) heuristic. Additionally, we propose two automated pricing solutions to improve the sellers’ profit based on reinforcement learning. The first solution, named Pricing mechanism with Q-learning and Risk-sensitivity ( PQR ), is based on Q-learning. Additionally, the given scalability issues of PQR , we propose a Deep Q-Network-based algorithm called ProDQN that exploits deep learning and a novel loss function rooted in prospect theory. Results based on real traces of energy consumption and production, as well as realistic prospect theory functions, show that our approaches achieve \(26\% \) higher perceived value for buyers and generate \(7\% \) more reward for sellers, compared to recent state-of-the-art approaches.more » « less
- 
            Tran, Duc; Thai, My; Krishnamachari, Bhaskar (Ed.)The security and performance of blockchain systems such as Bitcoin critically rely on the P2P network. This paper aims to investigate blockchain P2P networks. We explore the topologies, peer discovery, and data forwarding and examine the security and performance of the P2P network. Further, we formulate an optimization problem to study the theoretical limit of the performance and provide a solution to achieve optimal performance in a blockchain P2P network.more » « less
 An official website of the United States government
An official website of the United States government 
				
			 
					 
					
 
                                    