The AI Hippocampus: How Far are We From Human Memory?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jia, Zixia, Li, Jiaqi, Kang, Yipeng, Wang, Yuxuan, Wu, Tong, Wang, Quansen, Wang, Xiaobo, Zhang, Shuyi, Shen, Junzhe, Li, Qing, Qi, Siyuan, Liang, Yitao, He, Di, Zheng, Zilong, Zhu, Song-Chun
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909989896978432
author Jia, Zixia
Li, Jiaqi
Kang, Yipeng
Wang, Yuxuan
Wu, Tong
Wang, Quansen
Wang, Xiaobo
Zhang, Shuyi
Shen, Junzhe
Li, Qing
Qi, Siyuan
Liang, Yitao
He, Di
Zheng, Zilong
Zhu, Song-Chun
author_facet Jia, Zixia
Li, Jiaqi
Kang, Yipeng
Wang, Yuxuan
Wu, Tong
Wang, Quansen
Wang, Xiaobo
Zhang, Shuyi
Shen, Junzhe
Li, Qing
Qi, Siyuan
Liang, Yitao
He, Di
Zheng, Zilong
Zhu, Song-Chun
contents Memory plays a foundational role in augmenting the reasoning, adaptability, and contextual fidelity of modern Large Language Models and Multi-Modal LLMs. As these models transition from static predictors to interactive systems capable of continual learning and personalized inference, the incorporation of memory mechanisms has emerged as a central theme in their architectural and functional evolution. This survey presents a comprehensive and structured synthesis of memory in LLMs and MLLMs, organizing the literature into a cohesive taxonomy comprising implicit, explicit, and agentic memory paradigms. Specifically, the survey delineates three primary memory frameworks. Implicit memory refers to the knowledge embedded within the internal parameters of pre-trained transformers, encompassing their capacity for memorization, associative retrieval, and contextual reasoning. Recent work has explored methods to interpret, manipulate, and reconfigure this latent memory. Explicit memory involves external storage and retrieval components designed to augment model outputs with dynamic, queryable knowledge representations, such as textual corpora, dense vectors, and graph-based structures, thereby enabling scalable and updatable interaction with information sources. Agentic memory introduces persistent, temporally extended memory structures within autonomous agents, facilitating long-term planning, self-consistency, and collaborative behavior in multi-agent systems, with relevance to embodied and interactive AI. Extending beyond text, the survey examines the integration of memory within multi-modal settings, where coherence across vision, language, audio, and action modalities is essential. Key architectural advances, benchmark tasks, and open challenges are discussed, including issues related to memory capacity, alignment, factual consistency, and cross-system interoperability.
format Preprint
id arxiv_https___arxiv_org_abs_2601_09113
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle The AI Hippocampus: How Far are We From Human Memory?
Jia, Zixia
Li, Jiaqi
Kang, Yipeng
Wang, Yuxuan
Wu, Tong
Wang, Quansen
Wang, Xiaobo
Zhang, Shuyi
Shen, Junzhe
Li, Qing
Qi, Siyuan
Liang, Yitao
He, Di
Zheng, Zilong
Zhu, Song-Chun
Artificial Intelligence
Memory plays a foundational role in augmenting the reasoning, adaptability, and contextual fidelity of modern Large Language Models and Multi-Modal LLMs. As these models transition from static predictors to interactive systems capable of continual learning and personalized inference, the incorporation of memory mechanisms has emerged as a central theme in their architectural and functional evolution. This survey presents a comprehensive and structured synthesis of memory in LLMs and MLLMs, organizing the literature into a cohesive taxonomy comprising implicit, explicit, and agentic memory paradigms. Specifically, the survey delineates three primary memory frameworks. Implicit memory refers to the knowledge embedded within the internal parameters of pre-trained transformers, encompassing their capacity for memorization, associative retrieval, and contextual reasoning. Recent work has explored methods to interpret, manipulate, and reconfigure this latent memory. Explicit memory involves external storage and retrieval components designed to augment model outputs with dynamic, queryable knowledge representations, such as textual corpora, dense vectors, and graph-based structures, thereby enabling scalable and updatable interaction with information sources. Agentic memory introduces persistent, temporally extended memory structures within autonomous agents, facilitating long-term planning, self-consistency, and collaborative behavior in multi-agent systems, with relevance to embodied and interactive AI. Extending beyond text, the survey examines the integration of memory within multi-modal settings, where coherence across vision, language, audio, and action modalities is essential. Key architectural advances, benchmark tasks, and open challenges are discussed, including issues related to memory capacity, alignment, factual consistency, and cross-system interoperability.
title The AI Hippocampus: How Far are We From Human Memory?
topic Artificial Intelligence
url https://arxiv.org/abs/2601.09113