Exposing Weak Links in Multi-Agent Systems under Adversarial Prompting

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Arora, Nirmit, Joel, Sathvik, Kavathekar, Ishan, Palak, Gandhi, Rohan, Pandya, Yash, Ganu, Tanuja, Kanade, Aditya, Nambi, Akshay
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909901812400128
author Arora, Nirmit
Joel, Sathvik
Kavathekar, Ishan
Palak
Gandhi, Rohan
Pandya, Yash
Ganu, Tanuja
Kanade, Aditya
Nambi, Akshay
author_facet Arora, Nirmit
Joel, Sathvik
Kavathekar, Ishan
Palak
Gandhi, Rohan
Pandya, Yash
Ganu, Tanuja
Kanade, Aditya
Nambi, Akshay
contents LLM-based agents are increasingly deployed in multi-agent systems (MAS). As these systems move toward real-world applications, their security becomes paramount. Existing research largely evaluates single-agent security, leaving a critical gap in understanding the vulnerabilities introduced by multi-agent design. However, existing systems fall short due to lack of unified frameworks and metrics focusing on unique rejection modes in MAS. We present SafeAgents, a unified and extensible framework for fine-grained security assessment of MAS. SafeAgents systematically exposes how design choices such as plan construction strategies, inter-agent context sharing, and fallback behaviors affect susceptibility to adversarial prompting. We introduce Dharma, a diagnostic measure that helps identify weak links within multi-agent pipelines. Using SafeAgents, we conduct a comprehensive study across five widely adopted multi-agent architectures (centralized, decentralized, and hybrid variants) on four datasets spanning web tasks, tool use, and code generation. Our findings reveal that common design patterns carry significant vulnerabilities. For example, centralized systems that delegate only atomic instructions to sub-agents obscure harmful objectives, reducing robustness. Our results highlight the need for security-aware design in MAS. Link to code is https://github.com/microsoft/SafeAgents
format Preprint
id arxiv_https___arxiv_org_abs_2511_10949
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exposing Weak Links in Multi-Agent Systems under Adversarial Prompting
Arora, Nirmit
Joel, Sathvik
Kavathekar, Ishan
Palak
Gandhi, Rohan
Pandya, Yash
Ganu, Tanuja
Kanade, Aditya
Nambi, Akshay
Multiagent Systems
Artificial Intelligence
LLM-based agents are increasingly deployed in multi-agent systems (MAS). As these systems move toward real-world applications, their security becomes paramount. Existing research largely evaluates single-agent security, leaving a critical gap in understanding the vulnerabilities introduced by multi-agent design. However, existing systems fall short due to lack of unified frameworks and metrics focusing on unique rejection modes in MAS. We present SafeAgents, a unified and extensible framework for fine-grained security assessment of MAS. SafeAgents systematically exposes how design choices such as plan construction strategies, inter-agent context sharing, and fallback behaviors affect susceptibility to adversarial prompting. We introduce Dharma, a diagnostic measure that helps identify weak links within multi-agent pipelines. Using SafeAgents, we conduct a comprehensive study across five widely adopted multi-agent architectures (centralized, decentralized, and hybrid variants) on four datasets spanning web tasks, tool use, and code generation. Our findings reveal that common design patterns carry significant vulnerabilities. For example, centralized systems that delegate only atomic instructions to sub-agents obscure harmful objectives, reducing robustness. Our results highlight the need for security-aware design in MAS. Link to code is https://github.com/microsoft/SafeAgents
title Exposing Weak Links in Multi-Agent Systems under Adversarial Prompting
topic Multiagent Systems
Artificial Intelligence
url https://arxiv.org/abs/2511.10949