Live-Evo: Online Evolution of Agentic Memory from Continuous Feedback

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Yaolun, Wu, Yiran, Yu, Yijiong, Wu, Qingyun, Wang, Huazheng
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915768930664448
author Zhang, Yaolun
Wu, Yiran
Yu, Yijiong
Wu, Qingyun
Wang, Huazheng
author_facet Zhang, Yaolun
Wu, Yiran
Yu, Yijiong
Wu, Qingyun
Wang, Huazheng
contents Large language model (LLM) agents are increasingly equipped with memory, which are stored experience and reusable guidance that can improve task-solving performance. Recent \emph{self-evolving} systems update memory based on interaction outcomes, but most existing evolution pipelines are developed for static train/test splits and only approximate online learning by folding static benchmarks, making them brittle under true distribution shift and continuous feedback. We introduce \textsc{Live-Evo}, an online self-evolving memory system that learns from a stream of incoming data over time. \textsc{Live-Evo} decouples \emph{what happened} from \emph{how to use it} via an Experience Bank and a Meta-Guideline Bank, compiling task-adaptive guidelines from retrieved experiences for each task. To manage memory online, \textsc{Live-Evo} maintains experience weights and updates them from feedback: experiences that consistently help are reinforced and retrieved more often, while misleading or stale experiences are down-weighted and gradually forgotten, analogous to reinforcement and decay in human memory. On the live \textit{Prophet Arena} benchmark over a 10-week horizon, \textsc{Live-Evo} improves Brier score by 20.8\% and increases market returns by 12.9\%, while also transferring to deep-research benchmarks with consistent gains over strong baselines. Our code is available at https://github.com/ag2ai/Live-Evo.
format Preprint
id arxiv_https___arxiv_org_abs_2602_02369
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Live-Evo: Online Evolution of Agentic Memory from Continuous Feedback
Zhang, Yaolun
Wu, Yiran
Yu, Yijiong
Wu, Qingyun
Wang, Huazheng
Artificial Intelligence
Machine Learning
Large language model (LLM) agents are increasingly equipped with memory, which are stored experience and reusable guidance that can improve task-solving performance. Recent \emph{self-evolving} systems update memory based on interaction outcomes, but most existing evolution pipelines are developed for static train/test splits and only approximate online learning by folding static benchmarks, making them brittle under true distribution shift and continuous feedback. We introduce \textsc{Live-Evo}, an online self-evolving memory system that learns from a stream of incoming data over time. \textsc{Live-Evo} decouples \emph{what happened} from \emph{how to use it} via an Experience Bank and a Meta-Guideline Bank, compiling task-adaptive guidelines from retrieved experiences for each task. To manage memory online, \textsc{Live-Evo} maintains experience weights and updates them from feedback: experiences that consistently help are reinforced and retrieved more often, while misleading or stale experiences are down-weighted and gradually forgotten, analogous to reinforcement and decay in human memory. On the live \textit{Prophet Arena} benchmark over a 10-week horizon, \textsc{Live-Evo} improves Brier score by 20.8\% and increases market returns by 12.9\%, while also transferring to deep-research benchmarks with consistent gains over strong baselines. Our code is available at https://github.com/ag2ai/Live-Evo.
title Live-Evo: Online Evolution of Agentic Memory from Continuous Feedback
topic Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2602.02369