CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhou, Zhenhong, Li, Zherui, Zhang, Jie, Zhang, Yuanhe, Wang, Kun, Liu, Yang, Guo, Qing
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909502977081344
author Zhou, Zhenhong
Li, Zherui
Zhang, Jie
Zhang, Yuanhe
Wang, Kun
Liu, Yang
Guo, Qing
author_facet Zhou, Zhenhong
Li, Zherui
Zhang, Jie
Zhang, Yuanhe
Wang, Kun
Liu, Yang
Guo, Qing
contents Large Language Model-based Multi-Agent Systems (LLM-MASs) have demonstrated remarkable real-world capabilities, effectively collaborating to complete complex tasks. While these systems are designed with safety mechanisms, such as rejecting harmful instructions through alignment, their security remains largely unexplored. This gap leaves LLM-MASs vulnerable to targeted disruptions. In this paper, we introduce Contagious Recursive Blocking Attacks (Corba), a novel and simple yet highly effective attack that disrupts interactions between agents within an LLM-MAS. Corba leverages two key properties: its contagious nature allows it to propagate across arbitrary network topologies, while its recursive property enables sustained depletion of computational resources. Notably, these blocking attacks often involve seemingly benign instructions, making them particularly challenging to mitigate using conventional alignment methods. We evaluate Corba on two widely-used LLM-MASs, namely, AutoGen and Camel across various topologies and commercial models. Additionally, we conduct more extensive experiments in open-ended interactive LLM-MASs, demonstrating the effectiveness of Corba in complex topology structures and open-source models. Our code is available at: https://github.com/zhrli324/Corba.
format Preprint
id arxiv_https___arxiv_org_abs_2502_14529
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models
Zhou, Zhenhong
Li, Zherui
Zhang, Jie
Zhang, Yuanhe
Wang, Kun
Liu, Yang
Guo, Qing
Computation and Language
Artificial Intelligence
Large Language Model-based Multi-Agent Systems (LLM-MASs) have demonstrated remarkable real-world capabilities, effectively collaborating to complete complex tasks. While these systems are designed with safety mechanisms, such as rejecting harmful instructions through alignment, their security remains largely unexplored. This gap leaves LLM-MASs vulnerable to targeted disruptions. In this paper, we introduce Contagious Recursive Blocking Attacks (Corba), a novel and simple yet highly effective attack that disrupts interactions between agents within an LLM-MAS. Corba leverages two key properties: its contagious nature allows it to propagate across arbitrary network topologies, while its recursive property enables sustained depletion of computational resources. Notably, these blocking attacks often involve seemingly benign instructions, making them particularly challenging to mitigate using conventional alignment methods. We evaluate Corba on two widely-used LLM-MASs, namely, AutoGen and Camel across various topologies and commercial models. Additionally, we conduct more extensive experiments in open-ended interactive LLM-MASs, demonstrating the effectiveness of Corba in complex topology structures and open-source models. Our code is available at: https://github.com/zhrli324/Corba.
title CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2502.14529