MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910025695363072 |
|---|---|
| author | He, Zexue Wang, Yu Zhi, Churan Hu, Yuanzhe Chen, Tzu-Ping Yin, Lang Chen, Ze Wu, Tong Arthur Ouyang, Siru Wang, Zihan Pei, Jiaxin McAuley, Julian Choi, Yejin Pentland, Alex |
| author_facet | He, Zexue Wang, Yu Zhi, Churan Hu, Yuanzhe Chen, Tzu-Ping Yin, Lang Chen, Ze Wu, Tong Arthur Ouyang, Siru Wang, Zihan Pei, Jiaxin McAuley, Julian Choi, Yejin Pentland, Alex |
| contents | Existing evaluations of agents with memory typically assess memorization and action in isolation. One class of benchmarks evaluates memorization by testing recall of past conversations or text but fails to capture how memory is used to guide future decisions. Another class focuses on agents acting in single-session tasks without the need for long-term memory. However, in realistic settings, memorization and action are tightly coupled: agents acquire memory while interacting with the environment, and subsequently rely on that memory to solve future tasks. To capture this setting, we introduce MemoryArena, a unified evaluation gym for benchmarking agent memory in multi-session Memory-Agent-Environment loops. The benchmark consists of human-crafted agentic tasks with explicitly interdependent subtasks, where agents must learn from earlier actions and feedback by distilling experiences into memory, and subsequently use that memory to guide later actions to solve the overall task. MemoryArena supports evaluation across web navigation, preference-constrained planning, progressive information search, and sequential formal reasoning, and reveals that agents with near-saturated performance on existing long-context memory benchmarks like LoCoMo perform poorly in our agentic setting, exposing a gap in current evaluations for agents with memory. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_16313 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks He, Zexue Wang, Yu Zhi, Churan Hu, Yuanzhe Chen, Tzu-Ping Yin, Lang Chen, Ze Wu, Tong Arthur Ouyang, Siru Wang, Zihan Pei, Jiaxin McAuley, Julian Choi, Yejin Pentland, Alex Computation and Language Existing evaluations of agents with memory typically assess memorization and action in isolation. One class of benchmarks evaluates memorization by testing recall of past conversations or text but fails to capture how memory is used to guide future decisions. Another class focuses on agents acting in single-session tasks without the need for long-term memory. However, in realistic settings, memorization and action are tightly coupled: agents acquire memory while interacting with the environment, and subsequently rely on that memory to solve future tasks. To capture this setting, we introduce MemoryArena, a unified evaluation gym for benchmarking agent memory in multi-session Memory-Agent-Environment loops. The benchmark consists of human-crafted agentic tasks with explicitly interdependent subtasks, where agents must learn from earlier actions and feedback by distilling experiences into memory, and subsequently use that memory to guide later actions to solve the overall task. MemoryArena supports evaluation across web navigation, preference-constrained planning, progressive information search, and sequential formal reasoning, and reveals that agents with near-saturated performance on existing long-context memory benchmarks like LoCoMo perform poorly in our agentic setting, exposing a gap in current evaluations for agents with memory. |
| title | MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2602.16313 |