Scaling Teams or Scaling Time? Memory Enabled Lifelong Learning in LLM Multi-Agent Systems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wu, Shanglin, Luo, Yuyang, Liang, Yueqing, Shi, Kaiwen, Ye, Yanfang, Payani, Ali, Shu, Kai
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911566917533696
author Wu, Shanglin
Luo, Yuyang
Liang, Yueqing
Shi, Kaiwen
Ye, Yanfang
Payani, Ali
Shu, Kai
author_facet Wu, Shanglin
Luo, Yuyang
Liang, Yueqing
Shi, Kaiwen
Ye, Yanfang
Payani, Ali
Shu, Kai
contents Large language model (LLM) multi-agent systems can scale along two distinct dimensions: by increasing the number of agents and by improving through accumulated experience over time. Although prior work has studied these dimensions separately, their interaction under realistic cost constraints remains unclear. In this paper, we introduce a conceptual scaling view of multi-agent systems that jointly considers team size and lifelong learning ability, and we study how memory design shares this landscape. To this end, we propose \textbf{LLMA-Mem}, a lifelong memory framework for LLM multi-agent systems under flexible memory topologies. We evaluate LLMA-Mem on \textsc{MultiAgentBench} across coding, research, and database environments. Empirically, LLMA-Mem consistently improves long-horizon performance over baselines while reducing cost. Our analysis further reveals a non-monotonic scaling landscape: larger teams do not always produce better long-term performance, and smaller teams can outperform larger ones when memory better supports the reuse of experience. These findings position memory design as a practical path for scaling multi-agent systems more effectively and more efficiently over time.
format Preprint
id arxiv_https___arxiv_org_abs_2604_03295
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Scaling Teams or Scaling Time? Memory Enabled Lifelong Learning in LLM Multi-Agent Systems
Wu, Shanglin
Luo, Yuyang
Liang, Yueqing
Shi, Kaiwen
Ye, Yanfang
Payani, Ali
Shu, Kai
Multiagent Systems
Artificial Intelligence
Large language model (LLM) multi-agent systems can scale along two distinct dimensions: by increasing the number of agents and by improving through accumulated experience over time. Although prior work has studied these dimensions separately, their interaction under realistic cost constraints remains unclear. In this paper, we introduce a conceptual scaling view of multi-agent systems that jointly considers team size and lifelong learning ability, and we study how memory design shares this landscape. To this end, we propose \textbf{LLMA-Mem}, a lifelong memory framework for LLM multi-agent systems under flexible memory topologies. We evaluate LLMA-Mem on \textsc{MultiAgentBench} across coding, research, and database environments. Empirically, LLMA-Mem consistently improves long-horizon performance over baselines while reducing cost. Our analysis further reveals a non-monotonic scaling landscape: larger teams do not always produce better long-term performance, and smaller teams can outperform larger ones when memory better supports the reuse of experience. These findings position memory design as a practical path for scaling multi-agent systems more effectively and more efficiently over time.
title Scaling Teams or Scaling Time? Memory Enabled Lifelong Learning in LLM Multi-Agent Systems
topic Multiagent Systems
Artificial Intelligence
url https://arxiv.org/abs/2604.03295