Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wu, Wangyu, Chen, Xuhang, Chen, Zhenhong, Jiang, Jing-En, Tsang, Kim-Fung, Huang, Xiaowei, Ma, Fei, Xiao, Jimin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917026174337024
author Wu, Wangyu
Chen, Xuhang
Chen, Zhenhong
Jiang, Jing-En
Tsang, Kim-Fung
Huang, Xiaowei
Ma, Fei
Xiao, Jimin
author_facet Wu, Wangyu
Chen, Xuhang
Chen, Zhenhong
Jiang, Jing-En
Tsang, Kim-Fung
Huang, Xiaowei
Ma, Fei
Xiao, Jimin
contents Cross-Domain Sequential Recommendation (CDSR) plays a crucial role in modern consumer electronics and e-commerce platforms, where users interact with diverse services such as books, movies, and online retail products. These systems must accurately capture both domain-specific and cross-domain behavioral patterns to provide personalized and seamless consumer experiences. To address this challenge, we propose \textbf{TEMA-LLM} (\textit{Tag-Enriched Multi-Attention with Large Language Models}), a practical and effective framework that integrates \textit{Large Language Models (LLMs)} for semantic tag generation and enrichment. Specifically, TEMA-LLM employs LLMs to assign domain-aware prompts and generate descriptive tags from item titles and descriptions. The resulting tag embeddings are fused with item identifiers as well as textual and visual features to construct enhanced item representations. A \textit{Tag-Enriched Multi-Attention} mechanism is then introduced to jointly model user preferences within and across domains, enabling the system to capture complex and evolving consumer interests. Extensive experiments on four large-scale e-commerce datasets demonstrate that TEMA-LLM consistently outperforms state-of-the-art baselines, underscoring the benefits of LLM-based semantic tagging and multi-attention integration for consumer-facing recommendation systems. The proposed approach highlights the potential of LLMs to advance intelligent, user-centric services in the field of consumer electronics.
format Preprint
id arxiv_https___arxiv_org_abs_2510_09224
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendation
Wu, Wangyu
Chen, Xuhang
Chen, Zhenhong
Jiang, Jing-En
Tsang, Kim-Fung
Huang, Xiaowei
Ma, Fei
Xiao, Jimin
Computer Vision and Pattern Recognition
Cross-Domain Sequential Recommendation (CDSR) plays a crucial role in modern consumer electronics and e-commerce platforms, where users interact with diverse services such as books, movies, and online retail products. These systems must accurately capture both domain-specific and cross-domain behavioral patterns to provide personalized and seamless consumer experiences. To address this challenge, we propose \textbf{TEMA-LLM} (\textit{Tag-Enriched Multi-Attention with Large Language Models}), a practical and effective framework that integrates \textit{Large Language Models (LLMs)} for semantic tag generation and enrichment. Specifically, TEMA-LLM employs LLMs to assign domain-aware prompts and generate descriptive tags from item titles and descriptions. The resulting tag embeddings are fused with item identifiers as well as textual and visual features to construct enhanced item representations. A \textit{Tag-Enriched Multi-Attention} mechanism is then introduced to jointly model user preferences within and across domains, enabling the system to capture complex and evolving consumer interests. Extensive experiments on four large-scale e-commerce datasets demonstrate that TEMA-LLM consistently outperforms state-of-the-art baselines, underscoring the benefits of LLM-based semantic tagging and multi-attention integration for consumer-facing recommendation systems. The proposed approach highlights the potential of LLMs to advance intelligent, user-centric services in the field of consumer electronics.
title Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.09224