Peer-to-peer (P2P) energy trading is a decentralized energy market where local energy prosumers act as peers, trading energy among each other. Existing works in this area largely overlook the importance of user behavioral modeling, assume users’ sustained active participation, and full compliance in the decision-making process. To overcome these unrealistic assumptions, and their deleterious consequences, in this paper we propose an automated P2P energy trading framework that specifically considers the users’ perception by exploiting prospect theory . We formalize an optimization problem that maximizes the buyers’ perceived utility while matching energy production and demand. We prove that the problem is NP-hard and we propose a Differential Evolution-based Algorithm for Trading Energy ( DEbATE ) heuristic. Additionally, we propose two automated pricing solutions to improve the sellers’ profit based on reinforcement learning. The first solution, named Pricing mechanism with Q-learning and Risk-sensitivity ( PQR ), is based on Q-learning. Additionally, the given scalability issues of PQR , we propose a Deep Q-Network-based algorithm called ProDQN that exploits deep learning and a novel loss function rooted in prospect theory. Results based on real traces of energy consumption and production, as well as realistic prospect theory functions, show that our approaches achieve \(26\% \) higher perceived value for buyers and generate \(7\% \) more reward for sellers, compared to recent state-of-the-art approaches.
more »
« less
Prosumer-Centric Self-Sustained Smart Grid Systems
Modern smart grid systems exploit a two-way interaction paradigm between the utility and the electricity user and promote the role of prosumer, as a new user type, able to generate and sell energy, or consume energy. Within such a setting, the prosumers and their interactions with the microgrid system become of high significance for its efficient operation. In this article, to model the corresponding interactions, we introduce a labor economics-based framework by exploiting the principles of contract theory, that jointly achieves the satisfaction of the various interacting system entities, i.e., the microgrid operator (MGO) and the prosumers. The MGO offers personalized rewards to the sellers and buyers, to incentivize them to sell and purchase energy, respectively. To provide a stable and efficient operation point, while aiming at jointly satisfying the profit and requirements of the involved competing parties, optimal personalized contracts, i.e., rewards and amount of sold/purchased energy, are determined, by formulating and solving contract-theoretic optimization problems between the MGO and the sellers or buyers. The analysis is provided for both cases of complete and incomplete information availability regarding the prosumers’ types. Detailed numerical results are presented to demonstrate the operation characteristics of the proposed framework under diverse scenarios.
more »
« less
- Award ID(s):
- 1757207
- NSF-PAR ID:
- 10321107
- Date Published:
- Journal Name:
- IEEE Systems Journal
- ISSN:
- 1932-8184
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Ambitious climate packages promote the integration of variable renewable energy (VRE) and electrification of the economy. For the power sector, such a transformation means the emergence of so-called prosumers, i.e., agents that both consume and produce electricity. Due to their inflexible VRE output and flexible demand, prosumers will potentially add endogenous net sales with seasonal patterns to the power system. With its vast hydro reservoirs and ample transmission capacity, the Nordic region is seemingly well positioned to cope with such intermittent VRE output. However, the increased requirement for flexibility may be leveraged by incumbent producers to manipulate prices. Via a Nash-Cournot model with a representation of the Nordic region’s spatio-temporal features and reservoir volumes, we examine how hydro producers’ ability to manipulate electricity prices through temporal arbitrage is affected by (i) VRE-enabled prosumers and (ii) the latter plus a high CO
$$_2$$ $$_2$$ -
Addressing the increasing demand for data exchange has led to the development of data markets that facilitate transactional interactions between data buyers and data sellers. Still, cost-effective and distribution-aware query answering is a substantial challenge in these environments. In this paper, while differentiating different types of data markets, we take the initial steps towards addressing this challenge. In particular, we envision a unified query answering framework and discuss its functionalities. Our framework enables integrating data from different sources in a data market into a dataset that meets user-provided schema and distribution requirements cost-effectively. In order to facilitate consumers' query answering, our system discovers data views in the form of join-paths on relevant data sources, defines a get-next operation to query views, and estimates the cost of get-next on each view. The query answering engine then selects the next views to sample sequentially to collect the output data. Depending on the knowledge of the system from the underlying data sources, the view selection problem can be modeled as an instance of a multi-arm bandit or coupon collector's problem.more » « less
-
null (Ed.)Recent technological advances in the use of Unmanned Aerial Vehicles (UAVs) and Wireless Powered Communications (WPC) have enabled the energy efficient operation of the Public Safety Networks (PSN) during disaster scenarios. In this paper, an energy efficient information flow and energy harvesting framework capturing users' risk-aware characteristics is introduced based on the principles of Contract Theory. To better support the operational effectiveness of the proposed framework, users are clustered in rescue groups following a socio-physical-aware group formation mechanism, while rescue leaders for each group are selected. A reinforcement learning approach is applied to enable the optimal matching between the UAVs and the rescue leaders in a distributed and efficient manner. The proposed contract-theoretic framework models the UAVs-victims relation based on a labor market setting via offering rewards to the users (incentives) in order to compensate them for their invested labor (reporting information). Detailed numerical results demonstrate the benefits and superiority of the proposed framework under different settings.more » « less
-
null (Ed.)Given the substantial penetration of social networks in citizens' everyday life activities, the success of a public safety system depends on the citizens' incentivization by the Emergency Control Center (ECC), and their effective effort contribution in the overall disaster management operation. In this paper, we introduce a formal method based on the principles of Contract Theory, to identify the optimal rewards to the citizens from the ECC's perspective, and the optimal invested effort from the citizens' side, referred to as contract pairs. The identification of these contract pairs (i.e., rewards and respective efforts) between the ECC and each citizen, depend on each citizen's social and communication characteristics that are used to define their specific type and profile, while they are properly reflected in the corresponding designed utility functions to be optimized. The problem under consideration is treated for both cases of complete (ideal) and incomplete (realistic) information availability, with respect to the level of knowledge of the ECC about the exact type of each citizen. The overall framework was evaluated via modeling and simulation, in terms of its efficiency and effectiveness, by studying multiple operation approaches and scenarios.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1109/JSYST.2022.3156877
