Mem$^2$Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cheng, Zihao, Liu, Zeming, Shan, Yingyu, Wang, Xinyi, Zhu, Xiangrong, Ma, Yunpu, Wang, Hongru, Guo, Yuhang, Lin, Wei, Wang, Yunhong
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910123153162240
author Cheng, Zihao
Liu, Zeming
Shan, Yingyu
Wang, Xinyi
Zhu, Xiangrong
Ma, Yunpu
Wang, Hongru
Guo, Yuhang
Lin, Wei
Wang, Yunhong
author_facet Cheng, Zihao
Liu, Zeming
Shan, Yingyu
Wang, Xinyi
Zhu, Xiangrong
Ma, Yunpu
Wang, Hongru
Guo, Yuhang
Lin, Wei
Wang, Yunhong
contents While large language model--powered agents can self-evolve by accumulating experience or by dynamically creating new assets (i.e., tools or expert agents), existing frameworks typically treat these two evolutionary processes in isolation. This separation overlooks their intrinsic interdependence: the former is inherently bounded by a manually predefined static toolset, while the latter generates new assets from scratch without experiential guidance, leading to limited capability growth and unstable evolution. To address this limitation, we introduce a novel paradigm of co-evolutionary Capability Expansion and Experience Distillation. Guided by this paradigm, we propose the \textbf{Mem$^{\textbf{2}}$Evolve}, which integrates two core components: \textbf{Experience Memory} and \textbf{Asset Memory}. Specifically, Mem$^{2}$Evolve leverages accumulated experience to guide the dynamic creation of assets, thereby expanding the agent's capability space while simultaneously acquiring new experience to achieve co-evolution. Extensive experiments across 6 task categories and 8 benchmarks demonstrate that Mem$^{2}$Evolve achieves improvement of 18.53\% over standard LLMs, 11.80\% over agents evolving solely through experience, and 6.46\% over those evolving solely through asset creation, establishing it as a substantially more effective and stable self-evolving agent framework. Code is available at: https://buaa-irip-llm.github.io/Mem2Evolve.
format Preprint
id arxiv_https___arxiv_org_abs_2604_10923
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Mem$^2$Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
Cheng, Zihao
Liu, Zeming
Shan, Yingyu
Wang, Xinyi
Zhu, Xiangrong
Ma, Yunpu
Wang, Hongru
Guo, Yuhang
Lin, Wei
Wang, Yunhong
Computation and Language
Artificial Intelligence
While large language model--powered agents can self-evolve by accumulating experience or by dynamically creating new assets (i.e., tools or expert agents), existing frameworks typically treat these two evolutionary processes in isolation. This separation overlooks their intrinsic interdependence: the former is inherently bounded by a manually predefined static toolset, while the latter generates new assets from scratch without experiential guidance, leading to limited capability growth and unstable evolution. To address this limitation, we introduce a novel paradigm of co-evolutionary Capability Expansion and Experience Distillation. Guided by this paradigm, we propose the \textbf{Mem$^{\textbf{2}}$Evolve}, which integrates two core components: \textbf{Experience Memory} and \textbf{Asset Memory}. Specifically, Mem$^{2}$Evolve leverages accumulated experience to guide the dynamic creation of assets, thereby expanding the agent's capability space while simultaneously acquiring new experience to achieve co-evolution. Extensive experiments across 6 task categories and 8 benchmarks demonstrate that Mem$^{2}$Evolve achieves improvement of 18.53\% over standard LLMs, 11.80\% over agents evolving solely through experience, and 6.46\% over those evolving solely through asset creation, establishing it as a substantially more effective and stable self-evolving agent framework. Code is available at: https://buaa-irip-llm.github.io/Mem2Evolve.
title Mem$^2$Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2604.10923