ByteRover: Agent-Native Memory Through LLM-Curated Hierarchical Context

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Nguyen, Andy, Doan, Danh, Pham, Hoang, Ha, Bao, Pham, Dat, Nguyen, Linh, Nguyen, Hieu, Nguyen, Thien, Do, Cuong, Nguyen, Phat, Nguyen, Toan
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908933224923136
author Nguyen, Andy
Doan, Danh
Pham, Hoang
Ha, Bao
Pham, Dat
Nguyen, Linh
Nguyen, Hieu
Nguyen, Thien
Do, Cuong
Nguyen, Phat
Nguyen, Toan
author_facet Nguyen, Andy
Doan, Danh
Pham, Hoang
Ha, Bao
Pham, Dat
Nguyen, Linh
Nguyen, Hieu
Nguyen, Thien
Do, Cuong
Nguyen, Phat
Nguyen, Toan
contents Memory-Augmented Generation (MAG) extends large language models with external memory to support long-context reasoning, but existing approaches universally treat memory as an external service that agents call into, delegating storage to separate pipelines of chunking, embedding, and graph extraction. This architectural separation means the system that stores knowledge does not understand it, leading to semantic drift between what the agent intended to remember and what the pipeline actually captured, loss of coordination context across agents, and fragile recovery after failures. In this paper, we propose ByteRover, an agent-native memory architecture that inverts the memory pipeline: the same LLM that reasons about a task also curates, structures, and retrieves knowledge. ByteRover represents knowledge in a hierarchical Context Tree, a file-based knowledge graph organized as Domain, Topic, Subtopic, and Entry, where each entry carries explicit relations, provenance, and an Adaptive Knowledge Lifecycle (AKL) with importance scoring, maturity tiers, and recency decay. Retrieval uses a 5-tier progressive strategy that resolves most queries at sub-100 ms latency without LLM calls, escalating to agentic reasoning only for novel questions. Experiments on LoCoMo and LongMemEval demonstrate that ByteRover achieves state-of-the-art accuracy on LoCoMo and competitive results on LongMemEval while requiring zero external infrastructure, no vector database, no graph database, no embedding service, with all knowledge stored as human-readable markdown files on the local filesystem.
format Preprint
id arxiv_https___arxiv_org_abs_2604_01599
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ByteRover: Agent-Native Memory Through LLM-Curated Hierarchical Context
Nguyen, Andy
Doan, Danh
Pham, Hoang
Ha, Bao
Pham, Dat
Nguyen, Linh
Nguyen, Hieu
Nguyen, Thien
Do, Cuong
Nguyen, Phat
Nguyen, Toan
Artificial Intelligence
68T50
I.2.7; H.3.3
Memory-Augmented Generation (MAG) extends large language models with external memory to support long-context reasoning, but existing approaches universally treat memory as an external service that agents call into, delegating storage to separate pipelines of chunking, embedding, and graph extraction. This architectural separation means the system that stores knowledge does not understand it, leading to semantic drift between what the agent intended to remember and what the pipeline actually captured, loss of coordination context across agents, and fragile recovery after failures. In this paper, we propose ByteRover, an agent-native memory architecture that inverts the memory pipeline: the same LLM that reasons about a task also curates, structures, and retrieves knowledge. ByteRover represents knowledge in a hierarchical Context Tree, a file-based knowledge graph organized as Domain, Topic, Subtopic, and Entry, where each entry carries explicit relations, provenance, and an Adaptive Knowledge Lifecycle (AKL) with importance scoring, maturity tiers, and recency decay. Retrieval uses a 5-tier progressive strategy that resolves most queries at sub-100 ms latency without LLM calls, escalating to agentic reasoning only for novel questions. Experiments on LoCoMo and LongMemEval demonstrate that ByteRover achieves state-of-the-art accuracy on LoCoMo and competitive results on LongMemEval while requiring zero external infrastructure, no vector database, no graph database, no embedding service, with all knowledge stored as human-readable markdown files on the local filesystem.
title ByteRover: Agent-Native Memory Through LLM-Curated Hierarchical Context
topic Artificial Intelligence
68T50
I.2.7; H.3.3
url https://arxiv.org/abs/2604.01599