Saved in:
Bibliographic Details
Main Authors: Yao, Chenhao, Yuan, Zike, Liu, Xiaoxu, Zhu, Chi
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.16382
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908460819415040
author Yao, Chenhao
Yuan, Zike
Liu, Xiaoxu
Zhu, Chi
author_facet Yao, Chenhao
Yuan, Zike
Liu, Xiaoxu
Zhu, Chi
contents Multi-Agent Systems (MAS) excel at accomplishing complex objectives through the collaborative efforts of individual agents. Among the methodologies employed in MAS, Multi-Agent Reinforcement Learning (MARL) stands out as one of the most efficacious algorithms. However, when confronted with the complex objective of Formation Control with Collision Avoidance (FCCA): designing an effective reward function that facilitates swift convergence of the policy network to an optimal solution. In this paper, we introduce a novel framework that aims to overcome this challenge. By giving large language models (LLMs) on the prioritization of tasks and the observable information available to each agent, our framework generates reward functions that can be dynamically adjusted online based on evaluation outcomes by employing more advanced evaluation metrics rather than the rewards themselves. This mechanism enables the MAS to simultaneously achieve formation control and obstacle avoidance in dynamic environments with enhanced efficiency, requiring fewer iterations to reach superior performance levels. Our empirical studies, conducted in both simulation and real-world settings, validate the practicality and effectiveness of our proposed approach.
format Preprint
id arxiv_https___arxiv_org_abs_2507_16382
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Application of LLM Guided Reinforcement Learning in Formation Control with Collision Avoidance
Yao, Chenhao
Yuan, Zike
Liu, Xiaoxu
Zhu, Chi
Robotics
Artificial Intelligence
Multi-Agent Systems (MAS) excel at accomplishing complex objectives through the collaborative efforts of individual agents. Among the methodologies employed in MAS, Multi-Agent Reinforcement Learning (MARL) stands out as one of the most efficacious algorithms. However, when confronted with the complex objective of Formation Control with Collision Avoidance (FCCA): designing an effective reward function that facilitates swift convergence of the policy network to an optimal solution. In this paper, we introduce a novel framework that aims to overcome this challenge. By giving large language models (LLMs) on the prioritization of tasks and the observable information available to each agent, our framework generates reward functions that can be dynamically adjusted online based on evaluation outcomes by employing more advanced evaluation metrics rather than the rewards themselves. This mechanism enables the MAS to simultaneously achieve formation control and obstacle avoidance in dynamic environments with enhanced efficiency, requiring fewer iterations to reach superior performance levels. Our empirical studies, conducted in both simulation and real-world settings, validate the practicality and effectiveness of our proposed approach.
title Application of LLM Guided Reinforcement Learning in Formation Control with Collision Avoidance
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2507.16382