Privacy-Enhancing Paradigms within Federated Multi-Agent Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shi, Zitong, Wan, Guancheng, Huang, Wenke, Zhang, Guibin, Shao, Jiawei, Ye, Mang, Yang, Carl
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909533954113536
author Shi, Zitong
Wan, Guancheng
Huang, Wenke
Zhang, Guibin
Shao, Jiawei
Ye, Mang
Yang, Carl
author_facet Shi, Zitong
Wan, Guancheng
Huang, Wenke
Zhang, Guibin
Shao, Jiawei
Ye, Mang
Yang, Carl
contents LLM-based Multi-Agent Systems (MAS) have proven highly effective in solving complex problems by integrating multiple agents, each performing different roles. However, in sensitive domains, they face emerging privacy protection challenges. In this paper, we introduce the concept of Federated MAS, highlighting the fundamental differences between Federated MAS and traditional FL. We then identify key challenges in developing Federated MAS, including: 1) heterogeneous privacy protocols among agents, 2) structural differences in multi-party conversations, and 3) dynamic conversational network structures. To address these challenges, we propose Embedded Privacy-Enhancing Agents (EPEAgent), an innovative solution that integrates seamlessly into the Retrieval-Augmented Generation (RAG) phase and the context retrieval stage. This solution minimizes data flows, ensuring that only task-relevant, agent-specific information is shared. Additionally, we design and generate a comprehensive dataset to evaluate the proposed paradigm. Extensive experiments demonstrate that EPEAgent effectively enhances privacy protection while maintaining strong system performance. The code will be availiable at https://github.com/ZitongShi/EPEAgent
format Preprint
id arxiv_https___arxiv_org_abs_2503_08175
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Privacy-Enhancing Paradigms within Federated Multi-Agent Systems
Shi, Zitong
Wan, Guancheng
Huang, Wenke
Zhang, Guibin
Shao, Jiawei
Ye, Mang
Yang, Carl
Artificial Intelligence
LLM-based Multi-Agent Systems (MAS) have proven highly effective in solving complex problems by integrating multiple agents, each performing different roles. However, in sensitive domains, they face emerging privacy protection challenges. In this paper, we introduce the concept of Federated MAS, highlighting the fundamental differences between Federated MAS and traditional FL. We then identify key challenges in developing Federated MAS, including: 1) heterogeneous privacy protocols among agents, 2) structural differences in multi-party conversations, and 3) dynamic conversational network structures. To address these challenges, we propose Embedded Privacy-Enhancing Agents (EPEAgent), an innovative solution that integrates seamlessly into the Retrieval-Augmented Generation (RAG) phase and the context retrieval stage. This solution minimizes data flows, ensuring that only task-relevant, agent-specific information is shared. Additionally, we design and generate a comprehensive dataset to evaluate the proposed paradigm. Extensive experiments demonstrate that EPEAgent effectively enhances privacy protection while maintaining strong system performance. The code will be availiable at https://github.com/ZitongShi/EPEAgent
title Privacy-Enhancing Paradigms within Federated Multi-Agent Systems
topic Artificial Intelligence
url https://arxiv.org/abs/2503.08175