As the demand for personalized products increases, manufacturing processes are becoming more complex due to greater variety and uncertainty in product requirements. Traditional manufacturing systems face challenges in adapting to product changes without manual interventions, leading to an increase in product delays and operational costs. Multi-agent manufacturing control systems, a decentralized framework consisting of collaborative agents, have been employed to enhance flexibility and adaptability in manufacturing. However, existing multi-agent system approaches are often initialized with predefined capabilities, limiting their ability to handle new requirements that were not modeled in advance. To address this challenge, this work proposes a large language model-enabled multi-agent framework that enables adaptive matching, translating new product requirements to manufacturing process control at runtime. A product agent, which is a decision-maker for a product, interprets unforeseen product requirements and matches with manufacturing capabilities by dynamically retrieving manufacturing knowledge during runtime. Communication strategies and a decision-making method are also introduced to facilitate adaptive task planning and coordination. The proposed framework was evaluated using an assembly task board testbed across three case studies of increasing complexity. Results demonstrate that the framework can process unforeseen product requirements into executable operations, dynamically discover manufacturing capabilities, and improve resource utilization.
more »
« less
Efficient Resource Distribution by Adaptive Inter-agent Spacing in Multi-agent Systems
In multi-agent systems, limited resources must be shared by individuals during missions to maximize the group utility of the system in the field. In this paper, we present a generalized adaptive self-organization process for multi-agent systems featuring fast and efficient distribution of a consumable and refillable on-board resource throughout the group. An adaptive inter-agent spacing (AIS) controller based on individual resource levels is proposed that spaces out high resource bearing agents throughout the group including the group boundary extrema, and allows low resource bearing agents to adaptively occupy the in-between spaces receiving resource from the high resource bearing agents without over-crowding. Experimental results for cases with and without the proposed AIS controller validate faster convergence of individual resource levels to the group mean resource level using the proposed AIS controller. The generalized approach of the self-organizing process allows flexibility in adapting the proposed AIS controller for various multi-agent applications.
more »
« less
- Award ID(s):
- 1846221
- PAR ID:
- 10132129
- Date Published:
- Journal Name:
- 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)
- Page Range / eLocation ID:
- 4381 - 4386
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)We consider the problem of enhanced security of multi-robot systems to prevent cyber-attackers from taking control of one or more robots in the group. We build upon a recently proposed solution that utilizes the physical measurement capabilities of the robots to perform introspection, i.e., detect the malicious actions of compromised agents using other members of the group. In particular, the proposed solution finds multi-agent paths on discrete spaces combined with a set of mutual observations at specific locations to detect robots with significant deviations from the preordained routes. In this paper, we develop a planner that works on continuous configuration spaces while also taking into account similar spatio-temporal constraints. In addition, the planner allows for more general tasks that can be formulated as arbitrary smooth cost functions to be specified. The combination of constraints and objectives considered in this paper are not easily handled by popular path planning algorithms (e.g., sampling-based methods), thus we propose a method based on the Alternating Direction Method of Multipliers (ADMM). ADMM is capable of finding locally optimal solutions to problems involving different kinds of objectives and non-convex temporal and spatial constraints, and allows for infeasible initialization. We benchmark our proposed method on multi-agent map exploration with minimum-uncertainty cost function, obstacles, and observation schedule constraints.more » « less
-
With the development of sensing and communica- tion technologies in networked cyber-physical systems (CPSs), multi-agent reinforcement learning (MARL)-based methodolo- gies are integrated into the control process of physical systems and demonstrate prominent performance in a wide array of CPS domains, such as connected autonomous vehicles (CAVs). However, it remains challenging to mathematically characterize the improvement of the performance of CAVs with commu- nication and cooperation capability. When each individual autonomous vehicle is originally self-interest, we can not assume that all agents would cooperate naturally during the training process. In this work, we propose to reallocate the system’s total reward efficiently to motivate stable cooperation among autonomous vehicles. We formally define and quantify how to reallocate the system’s total reward to each agent under the proposed transferable utility game, such that communication- based cooperation among multi-agents increases the system’s total reward. We prove that Shapley value-based reward reallocation of MARL locates in the core if the transferable utility game is a convex game. Hence, the cooperation is stable and efficient and the agents should stay in the coalition or the cooperating group. We then propose a cooperative policy learning algorithm with Shapley value reward reallocation. In experiments, compared with several literature algorithms, we show the improvement of the mean episode system reward of CAV systems using our proposed algorithm.more » « less
-
This paper introduces a trust-aware task allocation framework for adversarial multi-agent systems, leveraging quantum optimization to improve decision-making under uncertainty. The approach models agent reliability and adversarial behavior through a trust-aware utility function, enabling robust and adaptive task assignment in dynamic environments. By incorporating quantum-inspired optimization techniques, the framework efficiently explores complex solution spaces that are difficult for classical methods. Experimental results demonstrate improved resilience to adversarial agents, enhanced allocation efficiency, and overall system robustness compared to baseline approaches. The proposed framework contributes to secure and scalable coordination in distributed systems, with applications in cybersecurity, autonomous systems, and networked sensing environments.more » « less
-
A large amount of work has been done in Multi-Agent Systems (MAS) for modeling and solving problems with multiple interacting agents. However, most LLMs are pre-trained independently and not specifically optimized for coordination. For example, existing LLM fine-tuning frameworks rely on individual rewards, which require complex reward designs for each agent to encourage collaboration. To address this challenge, we model LLM collaboration as a cooperative Multi-Agent Reinforcement Learning (MARL) problem. We develop a multi-agent, multi-turn algorithm, MultiAgent Group Relative Policy Optimization (MAGRPO), to solve it, building on current RL approaches for LLMs as well as MARL techniques. Our experiments on LLM writing and coding collaboration demonstrate that fine-tuning multiple LLMs with MAGRPO enables agents to generate high-quality responses efficiently through effective cooperation. Our approach opens the door to using MARL methods for LLM collaboration and highlights the associated challenges. Our code is available at https://github.com/OpenMLRL/CoMLRL.more » « less
An official website of the United States government

