MemVerse: Multimodal Memory for Lifelong Learning Agents

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liu, Junming, Sun, Yifei, Cheng, Weihua, Lei, Haodong, Chen, Yirong, Wen, Licheng, Yang, Xuemeng, Fu, Daocheng, Cai, Pinlong, Deng, Nianchen, Yu, Yi, Hu, Shuyue, Shi, Botian, Wang, Ding
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914178676031488
author Liu, Junming
Sun, Yifei
Cheng, Weihua
Lei, Haodong
Chen, Yirong
Wen, Licheng
Yang, Xuemeng
Fu, Daocheng
Cai, Pinlong
Deng, Nianchen
Yu, Yi
Hu, Shuyue
Shi, Botian
Wang, Ding
author_facet Liu, Junming
Sun, Yifei
Cheng, Weihua
Lei, Haodong
Chen, Yirong
Wen, Licheng
Yang, Xuemeng
Fu, Daocheng
Cai, Pinlong
Deng, Nianchen
Yu, Yi
Hu, Shuyue
Shi, Botian
Wang, Ding
contents Despite rapid progress in large-scale language and vision models, AI agents still suffer from a fundamental limitation: they cannot remember. Without reliable memory, agents catastrophically forget past experiences, struggle with long-horizon reasoning, and fail to operate coherently in multimodal or interactive environments. We introduce MemVerse, a model-agnostic, plug-and-play memory framework that bridges fast parametric recall with hierarchical retrieval-based memory, enabling scalable and adaptive multimodal intelligence. MemVerse maintains short-term memory for recent context while transforming raw multimodal experiences into structured long-term memories organized as hierarchical knowledge graphs. This design supports continual consolidation, adaptive forgetting, and bounded memory growth. To handle real-time demands, MemVerse introduces a periodic distillation mechanism that compresses essential knowledge from long-term memory into the parametric model, allowing fast, differentiable recall while preserving interpretability. Extensive experiments demonstrate that MemVerse significantly improves multimodal reasoning and continual learning efficiency, empowering agents to remember, adapt, and reason coherently across extended interactions.
format Preprint
id arxiv_https___arxiv_org_abs_2512_03627
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MemVerse: Multimodal Memory for Lifelong Learning Agents
Liu, Junming
Sun, Yifei
Cheng, Weihua
Lei, Haodong
Chen, Yirong
Wen, Licheng
Yang, Xuemeng
Fu, Daocheng
Cai, Pinlong
Deng, Nianchen
Yu, Yi
Hu, Shuyue
Shi, Botian
Wang, Ding
Artificial Intelligence
Despite rapid progress in large-scale language and vision models, AI agents still suffer from a fundamental limitation: they cannot remember. Without reliable memory, agents catastrophically forget past experiences, struggle with long-horizon reasoning, and fail to operate coherently in multimodal or interactive environments. We introduce MemVerse, a model-agnostic, plug-and-play memory framework that bridges fast parametric recall with hierarchical retrieval-based memory, enabling scalable and adaptive multimodal intelligence. MemVerse maintains short-term memory for recent context while transforming raw multimodal experiences into structured long-term memories organized as hierarchical knowledge graphs. This design supports continual consolidation, adaptive forgetting, and bounded memory growth. To handle real-time demands, MemVerse introduces a periodic distillation mechanism that compresses essential knowledge from long-term memory into the parametric model, allowing fast, differentiable recall while preserving interpretability. Extensive experiments demonstrate that MemVerse significantly improves multimodal reasoning and continual learning efficiency, empowering agents to remember, adapt, and reason coherently across extended interactions.
title MemVerse: Multimodal Memory for Lifelong Learning Agents
topic Artificial Intelligence
url https://arxiv.org/abs/2512.03627