LatentMem: Customizing Latent Memory for Multi-Agent Systems

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Fu, Muxin, Xue, Xiangyuan, Li, Yafu, He, Zefeng, Huang, Siyuan, Qu, Xiaoye, Cheng, Yu, Yang, Yang
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911497951641600
author Fu, Muxin
Xue, Xiangyuan
Li, Yafu
He, Zefeng
Huang, Siyuan
Qu, Xiaoye
Cheng, Yu
Yang, Yang
author_facet Fu, Muxin
Xue, Xiangyuan
Li, Yafu
He, Zefeng
Huang, Siyuan
Qu, Xiaoye
Cheng, Yu
Yang, Yang
contents Large language model (LLM)-powered multi-agent systems (MAS) demonstrate remarkable collective intelligence, wherein multi-agent memory serves as a pivotal mechanism for continual adaptation. However, existing multi-agent memory designs remain constrained by two fundamental bottlenecks: (i) memory homogenization arising from the absence of role-aware customization, and (ii) information overload induced by excessively fine-grained memory entries. To address these limitations, we propose LatentMem, a learnable multi-agent memory framework designed to customize agent-specific memories in a token-efficient manner. Specifically, LatentMem comprises an experience bank that stores raw interaction trajectories in a lightweight form, and a memory composer that synthesizes compact latent memories conditioned on retrieved experience and agent-specific contexts. Further, we introduce Latent Memory Policy Optimization (LMPO), which propagates task-level optimization signals through latent memories to the composer, encouraging it to produce compact and high-utility representations. Extensive experiments across diverse benchmarks and mainstream MAS frameworks show that LatentMem achieves a performance gain of up to $19.36$% over vanilla settings and consistently outperforms existing memory architectures, without requiring any modifications to the underlying frameworks.
format Preprint
id arxiv_https___arxiv_org_abs_2602_03036
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LatentMem: Customizing Latent Memory for Multi-Agent Systems
Fu, Muxin
Xue, Xiangyuan
Li, Yafu
He, Zefeng
Huang, Siyuan
Qu, Xiaoye
Cheng, Yu
Yang, Yang
Computation and Language
Machine Learning
Multiagent Systems
Large language model (LLM)-powered multi-agent systems (MAS) demonstrate remarkable collective intelligence, wherein multi-agent memory serves as a pivotal mechanism for continual adaptation. However, existing multi-agent memory designs remain constrained by two fundamental bottlenecks: (i) memory homogenization arising from the absence of role-aware customization, and (ii) information overload induced by excessively fine-grained memory entries. To address these limitations, we propose LatentMem, a learnable multi-agent memory framework designed to customize agent-specific memories in a token-efficient manner. Specifically, LatentMem comprises an experience bank that stores raw interaction trajectories in a lightweight form, and a memory composer that synthesizes compact latent memories conditioned on retrieved experience and agent-specific contexts. Further, we introduce Latent Memory Policy Optimization (LMPO), which propagates task-level optimization signals through latent memories to the composer, encouraging it to produce compact and high-utility representations. Extensive experiments across diverse benchmarks and mainstream MAS frameworks show that LatentMem achieves a performance gain of up to $19.36$% over vanilla settings and consistently outperforms existing memory architectures, without requiring any modifications to the underlying frameworks.
title LatentMem: Customizing Latent Memory for Multi-Agent Systems
topic Computation and Language
Machine Learning
Multiagent Systems
url https://arxiv.org/abs/2602.03036