Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hu, Guoqing, Yang, Zhengyi, Cai, Zhibo, Zhang, An, Wang, Xiang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929553881956352
author Hu, Guoqing
Yang, Zhengyi
Cai, Zhibo
Zhang, An
Wang, Xiang
author_facet Hu, Guoqing
Yang, Zhengyi
Cai, Zhibo
Zhang, An
Wang, Xiang
contents Recent advancements in generative recommendation systems, particularly in the realm of sequential recommendation tasks, have shown promise in enhancing generalization to new items. Among these approaches, diffusion-based generative recommendation has emerged as an effective tool, leveraging its ability to capture data distributions and generate high-quality samples. Despite effectiveness, two primary challenges have been identified: 1) the lack of consistent modeling of data distribution for oracle items; and 2) the difficulty in scaling to more informative control signals beyond historical interactions. These issues stem from the uninformative nature of ID embeddings, which necessitate random initialization and limit the incorporation of additional control signals. To address these limitations, we propose iDreamRec to involve more concrete prior knowledge to establish item embeddings, particularly through detailed item text descriptions and advanced Text Embedding Models (TEM). More importantly, by converting item descriptions into embeddings aligned with TEM, we enable the integration of intention instructions as control signals to guide the generation of oracle items. Experimental results on four datasets demonstrate that iDreamRec not only outperforms existing diffusion-based generative recommenders but also facilitates the incorporation of intention instructions for more precise and effective recommendation generation.
format Preprint
id arxiv_https___arxiv_org_abs_2410_13428
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation
Hu, Guoqing
Yang, Zhengyi
Cai, Zhibo
Zhang, An
Wang, Xiang
Information Retrieval
Recent advancements in generative recommendation systems, particularly in the realm of sequential recommendation tasks, have shown promise in enhancing generalization to new items. Among these approaches, diffusion-based generative recommendation has emerged as an effective tool, leveraging its ability to capture data distributions and generate high-quality samples. Despite effectiveness, two primary challenges have been identified: 1) the lack of consistent modeling of data distribution for oracle items; and 2) the difficulty in scaling to more informative control signals beyond historical interactions. These issues stem from the uninformative nature of ID embeddings, which necessitate random initialization and limit the incorporation of additional control signals. To address these limitations, we propose iDreamRec to involve more concrete prior knowledge to establish item embeddings, particularly through detailed item text descriptions and advanced Text Embedding Models (TEM). More importantly, by converting item descriptions into embeddings aligned with TEM, we enable the integration of intention instructions as control signals to guide the generation of oracle items. Experimental results on four datasets demonstrate that iDreamRec not only outperforms existing diffusion-based generative recommenders but also facilitates the incorporation of intention instructions for more precise and effective recommendation generation.
title Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation
topic Information Retrieval
url https://arxiv.org/abs/2410.13428