Large Language Model Enhanced Graph Invariant Contrastive Learning for Out-of-Distribution Recommendation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liang, Jiahao, Yang, Haoran, Zhao, Xiangyu, Yu, Zhiwen, Li, Mianjie, Shi, Chuan, Yang, Kaixiang
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912726110961664
author Liang, Jiahao
Yang, Haoran
Zhao, Xiangyu
Yu, Zhiwen
Li, Mianjie
Shi, Chuan
Yang, Kaixiang
author_facet Liang, Jiahao
Yang, Haoran
Zhao, Xiangyu
Yu, Zhiwen
Li, Mianjie
Shi, Chuan
Yang, Kaixiang
contents Out-of-distribution (OOD) generalization has emerged as a significant challenge in graph recommender systems. Traditional graph neural network algorithms often fail because they learn spurious environmental correlations instead of stable causal relationships, leading to substantial performance degradation under distribution shifts. While recent advancements in Large Language Models (LLMs) offer a promising avenue due to their vast world knowledge and reasoning capabilities, effectively integrating this knowledge with the fine-grained topology of specific graphs to solve the OOD problem remains a significant challenge. To address these issues, we propose {$\textbf{Inv}$ariant $\textbf{G}$raph $\textbf{C}$ontrastive Learning with $\textbf{LLM}$s for Out-of-Distribution Recommendation (InvGCLLM)}, an innovative causal learning framework that synergistically integrates the strengths of data-driven models and knowledge-driven LLMs. Our framework first employs a data-driven invariant learning model to generate causal confidence scores for each user-item interaction. These scores then guide an LLM to perform targeted graph refinement, leveraging its world knowledge to prune spurious connections and augment missing causal links. Finally, the structurally purified graphs provide robust supervision for a causality-guided contrastive learning objective, enabling the model to learn representations that are resilient to spurious correlations. Experiments conducted on four public datasets demonstrate that InvGCLLM achieves significant improvements in out-of-distribution recommendation, consistently outperforming state-of-the-art baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2511_18282
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Large Language Model Enhanced Graph Invariant Contrastive Learning for Out-of-Distribution Recommendation
Liang, Jiahao
Yang, Haoran
Zhao, Xiangyu
Yu, Zhiwen
Li, Mianjie
Shi, Chuan
Yang, Kaixiang
Information Retrieval
Out-of-distribution (OOD) generalization has emerged as a significant challenge in graph recommender systems. Traditional graph neural network algorithms often fail because they learn spurious environmental correlations instead of stable causal relationships, leading to substantial performance degradation under distribution shifts. While recent advancements in Large Language Models (LLMs) offer a promising avenue due to their vast world knowledge and reasoning capabilities, effectively integrating this knowledge with the fine-grained topology of specific graphs to solve the OOD problem remains a significant challenge. To address these issues, we propose {$\textbf{Inv}$ariant $\textbf{G}$raph $\textbf{C}$ontrastive Learning with $\textbf{LLM}$s for Out-of-Distribution Recommendation (InvGCLLM)}, an innovative causal learning framework that synergistically integrates the strengths of data-driven models and knowledge-driven LLMs. Our framework first employs a data-driven invariant learning model to generate causal confidence scores for each user-item interaction. These scores then guide an LLM to perform targeted graph refinement, leveraging its world knowledge to prune spurious connections and augment missing causal links. Finally, the structurally purified graphs provide robust supervision for a causality-guided contrastive learning objective, enabling the model to learn representations that are resilient to spurious correlations. Experiments conducted on four public datasets demonstrate that InvGCLLM achieves significant improvements in out-of-distribution recommendation, consistently outperforming state-of-the-art baselines.
title Large Language Model Enhanced Graph Invariant Contrastive Learning for Out-of-Distribution Recommendation
topic Information Retrieval
url https://arxiv.org/abs/2511.18282