MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yu, Shuo, Cheng, Mingyue, Wang, Daoyu, Liu, Qi, Liu, Zirui, Guo, Ze, Tao, Xiaoyu
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914279381270528
author Yu, Shuo
Cheng, Mingyue
Wang, Daoyu
Liu, Qi
Liu, Zirui
Guo, Ze
Tao, Xiaoyu
author_facet Yu, Shuo
Cheng, Mingyue
Wang, Daoyu
Liu, Qi
Liu, Zirui
Guo, Ze
Tao, Xiaoyu
contents The primary form of user-internet engagement is shifting from leveraging implicit feedback signals, such as browsing and clicks, to harnessing the rich explicit feedback provided by textual interactive behaviors. This shift unlocks a rich source of user textual history, presenting a profound opportunity for a deeper form of personalization. However, prevailing approaches offer only a shallow form of personalization, as they treat user history as a flat list of texts for retrieval and fail to model the rich temporal and semantic structures reflecting dynamic nature of user interests. In this work, we propose \textbf{MemWeaver}, a framework that weaves the user's entire textual history into a hierarchical memory to power deeply personalized generation. The core innovation of our memory lies in its ability to capture both the temporal evolution of interests and the semantic relationships between different activities. To achieve this, MemWeaver builds two complementary memory components that both integrate temporal and semantic information, but at different levels of abstraction: behavioral memory, which captures specific user actions, and cognitive memory, which represents long-term preferences. This dual-component memory serves as a comprehensive representation of the user, allowing large language models (LLMs) to reason over both concrete behaviors and abstracted cognitive traits. This leads to content generation that is deeply aligned with their latent preferences. Experiments on the six datasets of the Language Model Personalization (LaMP) benchmark validate the efficacy of MemWeaver. Our code is available.
format Preprint
id arxiv_https___arxiv_org_abs_2510_07713
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generation
Yu, Shuo
Cheng, Mingyue
Wang, Daoyu
Liu, Qi
Liu, Zirui
Guo, Ze
Tao, Xiaoyu
Computation and Language
The primary form of user-internet engagement is shifting from leveraging implicit feedback signals, such as browsing and clicks, to harnessing the rich explicit feedback provided by textual interactive behaviors. This shift unlocks a rich source of user textual history, presenting a profound opportunity for a deeper form of personalization. However, prevailing approaches offer only a shallow form of personalization, as they treat user history as a flat list of texts for retrieval and fail to model the rich temporal and semantic structures reflecting dynamic nature of user interests. In this work, we propose \textbf{MemWeaver}, a framework that weaves the user's entire textual history into a hierarchical memory to power deeply personalized generation. The core innovation of our memory lies in its ability to capture both the temporal evolution of interests and the semantic relationships between different activities. To achieve this, MemWeaver builds two complementary memory components that both integrate temporal and semantic information, but at different levels of abstraction: behavioral memory, which captures specific user actions, and cognitive memory, which represents long-term preferences. This dual-component memory serves as a comprehensive representation of the user, allowing large language models (LLMs) to reason over both concrete behaviors and abstracted cognitive traits. This leads to content generation that is deeply aligned with their latent preferences. Experiments on the six datasets of the Language Model Personalization (LaMP) benchmark validate the efficacy of MemWeaver. Our code is available.
title MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generation
topic Computation and Language
url https://arxiv.org/abs/2510.07713