Benefits and Limitations of Communication in Multi-Agent Reasoning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Rizvi-Martel, Michael, Bhattamishra, Satwik, Rathi, Neil, Rabusseau, Guillaume, Hahn, Michael
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917018312114176
author Rizvi-Martel, Michael
Bhattamishra, Satwik
Rathi, Neil
Rabusseau, Guillaume
Hahn, Michael
author_facet Rizvi-Martel, Michael
Bhattamishra, Satwik
Rathi, Neil
Rabusseau, Guillaume
Hahn, Michael
contents Chain-of-thought prompting has popularized step-by-step reasoning in large language models, yet model performance still degrades as problem complexity and context length grow. By decomposing difficult tasks with long contexts into shorter, manageable ones, recent multi-agent paradigms offer a promising near-term solution to this problem. However, the fundamental capacities of such systems are poorly understood. In this work, we propose a theoretical framework to analyze the expressivity of multi-agent systems. We apply our framework to three algorithmic families: state tracking, recall, and $k$-hop reasoning. We derive bounds on (i) the number of agents required to solve the task exactly, (ii) the quantity and structure of inter-agent communication, and (iii) the achievable speedups as problem size and context scale. Our results identify regimes where communication is provably beneficial, delineate tradeoffs between agent count and bandwidth, and expose intrinsic limitations when either resource is constrained. We complement our theoretical analysis with a set of experiments on pretrained LLMs using controlled synthetic benchmarks. Empirical outcomes confirm the tradeoffs between key quantities predicted by our theory. Collectively, our analysis offers principled guidance for designing scalable multi-agent reasoning systems.
format Preprint
id arxiv_https___arxiv_org_abs_2510_13903
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Benefits and Limitations of Communication in Multi-Agent Reasoning
Rizvi-Martel, Michael
Bhattamishra, Satwik
Rathi, Neil
Rabusseau, Guillaume
Hahn, Michael
Multiagent Systems
Artificial Intelligence
Machine Learning
I.2.7; I.2.6
Chain-of-thought prompting has popularized step-by-step reasoning in large language models, yet model performance still degrades as problem complexity and context length grow. By decomposing difficult tasks with long contexts into shorter, manageable ones, recent multi-agent paradigms offer a promising near-term solution to this problem. However, the fundamental capacities of such systems are poorly understood. In this work, we propose a theoretical framework to analyze the expressivity of multi-agent systems. We apply our framework to three algorithmic families: state tracking, recall, and $k$-hop reasoning. We derive bounds on (i) the number of agents required to solve the task exactly, (ii) the quantity and structure of inter-agent communication, and (iii) the achievable speedups as problem size and context scale. Our results identify regimes where communication is provably beneficial, delineate tradeoffs between agent count and bandwidth, and expose intrinsic limitations when either resource is constrained. We complement our theoretical analysis with a set of experiments on pretrained LLMs using controlled synthetic benchmarks. Empirical outcomes confirm the tradeoffs between key quantities predicted by our theory. Collectively, our analysis offers principled guidance for designing scalable multi-agent reasoning systems.
title Benefits and Limitations of Communication in Multi-Agent Reasoning
topic Multiagent Systems
Artificial Intelligence
Machine Learning
I.2.7; I.2.6
url https://arxiv.org/abs/2510.13903