skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A Survey of Multi-Agent Systems for Smartgrids
This paper provides a survey of the literature on the application of Multi-agent Systems (MAS) technology for Smartgrids. Smartgrids represent the next generation electric network, as communities are developing self-sufficient and environmentally friendly energy production. As a cyber-physical system, the development of the vision of Smartgrids requires the resolution of major technical problems; this has fed over a decade of research. Due to the stochastic, intermittent nature of renewable energy resources and the heterogeneity of the agents involved in a Smartgrid, demand and supply management, energy trade and control of grid elements constitute great challenges for stable operation. In addition, in order to offer resilience against faults and attacks, Smartgrids should also have restoration, self-recovery and security capabilities. Multi-agent systems (MAS) technology has been a popular approach to deal with these challenges in Smartgrids, due to their ability to support reasoning in a distributed context. This survey reviews the literature concerning the use of MAS models in each of the relevant research areas related to Smartgrids. The survey explores how researchers have utilized agent-based tools and methods to solve the main problems of Smartgrids. The survey also discusses the challenges in the advancement of Smartgrid technology and identifies the open problems for research from the view of multi-agent systems.  more » « less
Award ID(s):
1914635
PAR ID:
10633129
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
MDPI
Date Published:
Journal Name:
Energies
Volume:
17
Issue:
15
ISSN:
1996-1073
Page Range / eLocation ID:
3620
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper proposes Multi-context System for Optimiza- tion Problems (MCS-OP) by introducing conditional cost- assignment bridge rules to Multi-context Systems (MCS). This novel feature facilitates the definition of a preorder among equilibria, based on the total incurred cost of ap- plied bridge rules. As an application of MCS-OP, the pa- per describes how MCS-OP can be used in modeling Dis- tributed Constraint Optimization Problems (DCOP), a promi- nent class of distributed optimization problems that is fre- quently employed in multi-agent system (MAS) research. The paper shows, by means of an example, that MCS-OP is more expressive than DCOP, and hence, could potentially be useful in modeling distributed optimization problems which cannot be easily dealt with using DCOPs. It also contains a complexity analysis of MCS-OP. 
    more » « less
  2. This paper proposes Multi-context System for Optimiza- tion Problems (MCS-OP) by introducing conditional cost- assignment bridge rules to Multi-context Systems (MCS). This novel feature facilitates the definition of a preorder among equilibria, based on the total incurred cost of ap- plied bridge rules. As an application of MCS-OP, the pa- per describes how MCS-OP can be used in modeling Dis- tributed Constraint Optimization Problems (DCOP), a promi- nent class of distributed optimization problems that is fre- quently employed in multi-agent system (MAS) research. The paper shows, by means of an example, that MCS-OP is more expressive than DCOP, and hence, could potentially be useful in modeling distributed optimization problems which cannot be easily dealt with using DCOPs. It also contains a complexity analysis of MCS-OP. 
    more » « less
  3. Abstract In many real‐world applications of AI, the set of actors and tasks are not constant, but instead change over time. Robots tasked with suppressing wildfires eventually run out of limited suppressant resources and need to temporarily disengage from the collaborative work in order to recharge, or they might become damaged and leave the environment permanently. In a large business organization, objectives and goals change with the market, requiring workers to adapt to perform different sets of tasks across time. We call these multiagent systems (MAS)open agent systems(OASYS), and theopennessof the sets of agents and tasks necessitates new capabilities and modeling for decision making compared to planning and learning inclosedenvironments. In this article, we discuss three notions of openness: agent openness, task openness, and type openness. We also review the past and current research on addressing the novel challenges brought about by openness in OASYS. We share lessons learned from these efforts and suggest directions for promising future work in this area. We also encourage the community to engage and participate in this area of MAS research to address critical real‐world problems in the application of AI to enhance our daily lives. 
    more » « less
  4. Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently, based on the development of using one LLM as a single planning or decision-making agent, LLM-based multi-agent systems have achieved considerable progress in complex problem-solving and world simulation. To provide the community with an overview of this dynamic field, we present this survey to offer an in-depth discussion on the essential aspects of multi-agent systems based on LLMs, as well as the challenges. Our goal is for readers to gain substantial insights on the following questions: What domains and environments do LLM-based multi-agents simulate? How are these agents profiled and how do they communicate? What mechanisms contribute to the growth of agents' capacities? For those interested in delving into this field of study, we also summarize the commonly used datasets or benchmarks for them to have convenient access. To keep researchers updated on the latest studies, we maintain an open-source GitHub repository, dedicated to outlining the research on LLM-based multi-agent systems. 
    more » « less
  5. In this paper, a distributed swarm control problem is studied for large-scale multi-agent systems (LS-MASs). Different than classical multi-agent systems, an LS-MAS brings new challenges to control design due to its large number of agents. It might be more difficult for developing the appropriate control to achieve complicated missions such as collective swarming. To address these challenges, a novel mixed game theory is developed with a hierarchical learning algorithm. In the mixed game, the LS-MAS is represented as a multi-group, large-scale leader–follower system. Then, a cooperative game is used to formulate the distributed swarm control for multi-group leaders, and a Stackelberg game is utilized to couple the leaders and their large-scale followers effectively. Using the interaction between leaders and followers, the mean field game is used to continue the collective swarm behavior from leaders to followers smoothly without raising the computational complexity or communication traffic. Moreover, a hierarchical learning algorithm is designed to learn the intelligent optimal distributed swarm control for multi-group leader–follower systems. Specifically, a multi-agent actor–critic algorithm is developed for obtaining the distributed optimal swarm control for multi-group leaders first. Furthermore, an actor–critic–mass method is designed to find the decentralized swarm control for large-scale followers. Eventually, a series of numerical simulations and a Lyapunov stability proof of the closed-loop system are conducted to demonstrate the performance of the developed scheme. 
    more » « less