MOC: Multi-Order Communication in LLM-based Multi-Agent Systems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Guan, Yao, Wang, Lin, Lu, Zhihu, Wang, Ziyi, Yan, Wenzhu, Duan, Qiang
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916074938695680
author Guan, Yao
Wang, Lin
Lu, Zhihu
Wang, Ziyi
Yan, Wenzhu
Duan, Qiang
author_facet Guan, Yao
Wang, Lin
Lu, Zhihu
Wang, Ziyi
Yan, Wenzhu
Duan, Qiang
contents Despite the remarkable progress of Large Language Model (LLM) based Multi-Agent Systems, most research focuses on optimizing coordination topology while largely underexploring the equally critical problem: how to transmit and optimize messages among agents effectively? Current communication schemes typically rely on the direct concatenation of first-order neighbor responses, which induces a restricted evidence receptive field and leads to the dilution of crucial insights over multi-hop paths. To address these limitations, we propose the Multi-Order Communication (MOC) scheme, which reconstructs the inter-agent communication to capture multi-hop dependencies and incorporates a structural message consolidation strategy to ensure efficiency. Specifically, we formalize the communication mechanism to construct a structured multi-order evidence stream, and subsequently design a Semantic-Topological Merging algorithm to optimize semantic fidelity within token constraints. Extensive experiments across six diverse datasets and LLM backbones of varying parameter scales demonstrate that MOC consistently improves task performance and reduces communication costs. The code is available at https://github.com/yao-guan/MOC.
format Preprint
id arxiv_https___arxiv_org_abs_2606_02359
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MOC: Multi-Order Communication in LLM-based Multi-Agent Systems
Guan, Yao
Wang, Lin
Lu, Zhihu
Wang, Ziyi
Yan, Wenzhu
Duan, Qiang
Artificial Intelligence
Despite the remarkable progress of Large Language Model (LLM) based Multi-Agent Systems, most research focuses on optimizing coordination topology while largely underexploring the equally critical problem: how to transmit and optimize messages among agents effectively? Current communication schemes typically rely on the direct concatenation of first-order neighbor responses, which induces a restricted evidence receptive field and leads to the dilution of crucial insights over multi-hop paths. To address these limitations, we propose the Multi-Order Communication (MOC) scheme, which reconstructs the inter-agent communication to capture multi-hop dependencies and incorporates a structural message consolidation strategy to ensure efficiency. Specifically, we formalize the communication mechanism to construct a structured multi-order evidence stream, and subsequently design a Semantic-Topological Merging algorithm to optimize semantic fidelity within token constraints. Extensive experiments across six diverse datasets and LLM backbones of varying parameter scales demonstrate that MOC consistently improves task performance and reduces communication costs. The code is available at https://github.com/yao-guan/MOC.
title MOC: Multi-Order Communication in LLM-based Multi-Agent Systems
topic Artificial Intelligence
url https://arxiv.org/abs/2606.02359