Saved in:
Bibliographic Details
Main Authors: Mao, Yihuan, Kang, Yipeng, Li, Peilun, Zhang, Ning, Xu, Wei, Zhang, Chongjie
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.16237
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916449379942400
author Mao, Yihuan
Kang, Yipeng
Li, Peilun
Zhang, Ning
Xu, Wei
Zhang, Chongjie
author_facet Mao, Yihuan
Kang, Yipeng
Li, Peilun
Zhang, Ning
Xu, Wei
Zhang, Chongjie
contents As large language model (LLM) agents increasingly integrate into our infrastructure, their robust coordination and message synchronization become vital. The Byzantine Generals Problem (BGP) is a critical model for constructing resilient multi-agent systems (MAS) under adversarial attacks. It describes a scenario where malicious agents with unknown identities exist in the system-situations that, in our context, could result from LLM agents' hallucinations or external attacks. In BGP, the objective of the entire system is to reach a consensus on the action to be taken. Traditional BGP requires global consensus among all agents; however, in practical scenarios, global consensus is not always necessary and can even be inefficient. Therefore, there is a pressing need to explore a refined version of BGP that aligns with the local coordination patterns observed in MAS. We refer to this refined version as Imperfect BGP (IBGP) in our research, aiming to address this discrepancy. To tackle this issue, we propose a framework that leverages consensus protocols within general MAS settings, providing provable resilience against communication attacks and adaptability to changing environments, as validated by empirical results. Additionally, we present a case study in a sensor network environment to illustrate the practical application of our protocol.
format Preprint
id arxiv_https___arxiv_org_abs_2410_16237
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle IBGP: Imperfect Byzantine Generals Problem for Zero-Shot Robustness in Communicative Multi-Agent Systems
Mao, Yihuan
Kang, Yipeng
Li, Peilun
Zhang, Ning
Xu, Wei
Zhang, Chongjie
Multiagent Systems
As large language model (LLM) agents increasingly integrate into our infrastructure, their robust coordination and message synchronization become vital. The Byzantine Generals Problem (BGP) is a critical model for constructing resilient multi-agent systems (MAS) under adversarial attacks. It describes a scenario where malicious agents with unknown identities exist in the system-situations that, in our context, could result from LLM agents' hallucinations or external attacks. In BGP, the objective of the entire system is to reach a consensus on the action to be taken. Traditional BGP requires global consensus among all agents; however, in practical scenarios, global consensus is not always necessary and can even be inefficient. Therefore, there is a pressing need to explore a refined version of BGP that aligns with the local coordination patterns observed in MAS. We refer to this refined version as Imperfect BGP (IBGP) in our research, aiming to address this discrepancy. To tackle this issue, we propose a framework that leverages consensus protocols within general MAS settings, providing provable resilience against communication attacks and adaptability to changing environments, as validated by empirical results. Additionally, we present a case study in a sensor network environment to illustrate the practical application of our protocol.
title IBGP: Imperfect Byzantine Generals Problem for Zero-Shot Robustness in Communicative Multi-Agent Systems
topic Multiagent Systems
url https://arxiv.org/abs/2410.16237