CausalRec: A CausalBoost Attention Model for Sequential Recommendation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Hou, Yunbo, Yang, Tianle, Li, Ruijie, He, Li, Wang, Liang, Li, Weiping, Zheng, Bo, Song, Guojie
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909867640356864
author Hou, Yunbo
Yang, Tianle
Li, Ruijie
He, Li
Wang, Liang
Li, Weiping
Zheng, Bo
Song, Guojie
author_facet Hou, Yunbo
Yang, Tianle
Li, Ruijie
He, Li
Wang, Liang
Li, Weiping
Zheng, Bo
Song, Guojie
contents Recent advances in correlation-based sequential recommendation systems have demonstrated substantial success. Specifically, the attention-based model outperforms other RNN-based and Markov chains-based models by capturing both short- and long-term dependencies more effectively. However, solely focusing on item co-occurrences overlooks the underlying motivations behind user behaviors, leading to spurious correlations and potentially inaccurate recommendations. To address this limitation, we present a novel framework that integrates causal attention for sequential recommendation, CausalRec. It incorporates a causal discovery block and a CausalBooster. The causal discovery block learns the causal graph in user behavior sequences, and we provide a theory to guarantee the identifiability of the learned causal graph. The CausalBooster utilizes the discovered causal graph to refine the attention mechanism, prioritizing behaviors with causal significance. Experimental evaluations on real-world datasets indicate that CausalRec outperforms several state-of-the-art methods, with average improvements of 7.21% in Hit Rate (HR) and 8.65% in Normalized Discounted Cumulative Gain (NDCG). To the best of our knowledge, this is the first model to incorporate causality through the attention mechanism in sequential recommendation, demonstrating the value of causality in generating more accurate and reliable recommendations.
format Preprint
id arxiv_https___arxiv_org_abs_2510_21333
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CausalRec: A CausalBoost Attention Model for Sequential Recommendation
Hou, Yunbo
Yang, Tianle
Li, Ruijie
He, Li
Wang, Liang
Li, Weiping
Zheng, Bo
Song, Guojie
Information Retrieval
Artificial Intelligence
Recent advances in correlation-based sequential recommendation systems have demonstrated substantial success. Specifically, the attention-based model outperforms other RNN-based and Markov chains-based models by capturing both short- and long-term dependencies more effectively. However, solely focusing on item co-occurrences overlooks the underlying motivations behind user behaviors, leading to spurious correlations and potentially inaccurate recommendations. To address this limitation, we present a novel framework that integrates causal attention for sequential recommendation, CausalRec. It incorporates a causal discovery block and a CausalBooster. The causal discovery block learns the causal graph in user behavior sequences, and we provide a theory to guarantee the identifiability of the learned causal graph. The CausalBooster utilizes the discovered causal graph to refine the attention mechanism, prioritizing behaviors with causal significance. Experimental evaluations on real-world datasets indicate that CausalRec outperforms several state-of-the-art methods, with average improvements of 7.21% in Hit Rate (HR) and 8.65% in Normalized Discounted Cumulative Gain (NDCG). To the best of our knowledge, this is the first model to incorporate causality through the attention mechanism in sequential recommendation, demonstrating the value of causality in generating more accurate and reliable recommendations.
title CausalRec: A CausalBoost Attention Model for Sequential Recommendation
topic Information Retrieval
Artificial Intelligence
url https://arxiv.org/abs/2510.21333