Single-agent or Multi-agent Systems? Why Not Both?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gao, Mingyan, Li, Yanzi, Liu, Banruo, Yu, Yifan, Wang, Phillip, Lin, Ching-Yu, Lai, Fan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910966560587776
author Gao, Mingyan
Li, Yanzi
Liu, Banruo
Yu, Yifan
Wang, Phillip
Lin, Ching-Yu
Lai, Fan
author_facet Gao, Mingyan
Li, Yanzi
Liu, Banruo
Yu, Yifan
Wang, Phillip
Lin, Ching-Yu
Lai, Fan
contents Multi-agent systems (MAS) decompose complex tasks and delegate subtasks to different large language model (LLM) agents and tools. Prior studies have reported the superior accuracy performance of MAS across diverse domains, enabled by long-horizon context tracking and error correction through role-specific agents. However, the design and deployment of MAS incur higher complexity and runtime cost compared to single-agent systems (SAS). Meanwhile, frontier LLMs, such as OpenAI-o3 and Gemini-2.5-Pro, have rapidly advanced in long-context reasoning, memory retention, and tool usage, mitigating many limitations that originally motivated MAS designs. In this paper, we conduct an extensive empirical study comparing MAS and SAS across various popular agentic applications. We find that the benefits of MAS over SAS diminish as LLM capabilities improve, and we propose efficient mechanisms to pinpoint the error-prone agent in MAS. Furthermore, the performance discrepancy between MAS and SAS motivates our design of a hybrid agentic paradigm, request cascading between MAS and SAS, to improve both efficiency and capability. Our design improves accuracy by 1.1-12% while reducing deployment costs by up to 20% across various agentic applications.
format Preprint
id arxiv_https___arxiv_org_abs_2505_18286
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Single-agent or Multi-agent Systems? Why Not Both?
Gao, Mingyan
Li, Yanzi
Liu, Banruo
Yu, Yifan
Wang, Phillip
Lin, Ching-Yu
Lai, Fan
Multiagent Systems
Artificial Intelligence
Machine Learning
Multi-agent systems (MAS) decompose complex tasks and delegate subtasks to different large language model (LLM) agents and tools. Prior studies have reported the superior accuracy performance of MAS across diverse domains, enabled by long-horizon context tracking and error correction through role-specific agents. However, the design and deployment of MAS incur higher complexity and runtime cost compared to single-agent systems (SAS). Meanwhile, frontier LLMs, such as OpenAI-o3 and Gemini-2.5-Pro, have rapidly advanced in long-context reasoning, memory retention, and tool usage, mitigating many limitations that originally motivated MAS designs. In this paper, we conduct an extensive empirical study comparing MAS and SAS across various popular agentic applications. We find that the benefits of MAS over SAS diminish as LLM capabilities improve, and we propose efficient mechanisms to pinpoint the error-prone agent in MAS. Furthermore, the performance discrepancy between MAS and SAS motivates our design of a hybrid agentic paradigm, request cascading between MAS and SAS, to improve both efficiency and capability. Our design improves accuracy by 1.1-12% while reducing deployment costs by up to 20% across various agentic applications.
title Single-agent or Multi-agent Systems? Why Not Both?
topic Multiagent Systems
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2505.18286