LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Wangyu, Chen, Zhenhong, Zhang, Wenqiao, Qiu, Xianglin, Song, Siqi, Huang, Xiaowei, Ma, Fei, Xiao, Jimin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914354726699008
author Wu, Wangyu
Chen, Zhenhong
Zhang, Wenqiao
Qiu, Xianglin
Song, Siqi
Huang, Xiaowei
Ma, Fei
Xiao, Jimin
author_facet Wu, Wangyu
Chen, Zhenhong
Zhang, Wenqiao
Qiu, Xianglin
Song, Siqi
Huang, Xiaowei
Ma, Fei
Xiao, Jimin
contents Cross-Domain Sequential Recommendation (CDSR) predicts user behavior by leveraging historical interactions across multiple domains, focusing on modeling cross-domain preferences and capturing both intra- and inter-sequence item relationships. We propose LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendation (LLM-EMF), a novel and advanced approach that enhances textual information with Large Language Models (LLM) knowledge and significantly improves recommendation performance through the fusion of visual and textual data. Using the frozen CLIP model, we generate image and text embeddings, thereby enriching item representations with multimodal data. A multiple attention mechanism jointly learns both single-domain and cross-domain preferences, effectively capturing and understanding complex user interests across diverse domains. Evaluations conducted on four e-commerce datasets demonstrate that LLM-EMF consistently outperforms existing methods in modeling cross-domain user preferences, thereby highlighting the effectiveness of multimodal data integration and its advantages in enhancing sequential recommendation systems. Our source code will be released.
format Preprint
id arxiv_https___arxiv_org_abs_2506_17966
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendation
Wu, Wangyu
Chen, Zhenhong
Zhang, Wenqiao
Qiu, Xianglin
Song, Siqi
Huang, Xiaowei
Ma, Fei
Xiao, Jimin
Information Retrieval
Computer Vision and Pattern Recognition
Cross-Domain Sequential Recommendation (CDSR) predicts user behavior by leveraging historical interactions across multiple domains, focusing on modeling cross-domain preferences and capturing both intra- and inter-sequence item relationships. We propose LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendation (LLM-EMF), a novel and advanced approach that enhances textual information with Large Language Models (LLM) knowledge and significantly improves recommendation performance through the fusion of visual and textual data. Using the frozen CLIP model, we generate image and text embeddings, thereby enriching item representations with multimodal data. A multiple attention mechanism jointly learns both single-domain and cross-domain preferences, effectively capturing and understanding complex user interests across diverse domains. Evaluations conducted on four e-commerce datasets demonstrate that LLM-EMF consistently outperforms existing methods in modeling cross-domain user preferences, thereby highlighting the effectiveness of multimodal data integration and its advantages in enhancing sequential recommendation systems. Our source code will be released.
title LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendation
topic Information Retrieval
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.17966