Relative Contrastive Learning for Sequential Recommendation with Similarity-based Positive Pair Selection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Zhikai, Shen, Yanyan, Zhang, Zexi, He, Li, Li, Yichun, Gu, Hao, Zhang, Yinghua
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915910718062592
author Wang, Zhikai
Shen, Yanyan
Zhang, Zexi
He, Li
Li, Yichun
Gu, Hao
Zhang, Yinghua
author_facet Wang, Zhikai
Shen, Yanyan
Zhang, Zexi
He, Li
Li, Yichun
Gu, Hao
Zhang, Yinghua
contents Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote representation invariance. Some strategies such as item reordering and item substitution may inadvertently alter user intent. Supervised Contrastive Learning (SCL) based methods find an alternative to augmentation-based CL methods by selecting same-target sequences (interaction sequences with the same target item) to form positive samples. However, SCL-based methods suffer from the scarcity of same-target sequences and consequently lack enough signals for contrastive learning. In this work, we propose to use similar sequences (with different target items) as additional positive samples and introduce a Relative Contrastive Learning (RCL) framework for sequential recommendation. RCL comprises a dual-tiered positive sample selection module and a relative contrastive learning module. The former module selects same-target sequences as strong positive samples and selects similar sequences as weak positive samples. The latter module employs a weighted relative contrastive loss, ensuring that each sequence is represented closer to its strong positive samples than its weak positive samples. We apply RCL on two mainstream deep learning-based SR models, and our empirical results reveal that RCL can achieve 4.88% improvement averagely than the state-of-the-art SR methods on five public datasets and one private dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2504_19178
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Relative Contrastive Learning for Sequential Recommendation with Similarity-based Positive Pair Selection
Wang, Zhikai
Shen, Yanyan
Zhang, Zexi
He, Li
Li, Yichun
Gu, Hao
Zhang, Yinghua
Information Retrieval
Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote representation invariance. Some strategies such as item reordering and item substitution may inadvertently alter user intent. Supervised Contrastive Learning (SCL) based methods find an alternative to augmentation-based CL methods by selecting same-target sequences (interaction sequences with the same target item) to form positive samples. However, SCL-based methods suffer from the scarcity of same-target sequences and consequently lack enough signals for contrastive learning. In this work, we propose to use similar sequences (with different target items) as additional positive samples and introduce a Relative Contrastive Learning (RCL) framework for sequential recommendation. RCL comprises a dual-tiered positive sample selection module and a relative contrastive learning module. The former module selects same-target sequences as strong positive samples and selects similar sequences as weak positive samples. The latter module employs a weighted relative contrastive loss, ensuring that each sequence is represented closer to its strong positive samples than its weak positive samples. We apply RCL on two mainstream deep learning-based SR models, and our empirical results reveal that RCL can achieve 4.88% improvement averagely than the state-of-the-art SR methods on five public datasets and one private dataset.
title Relative Contrastive Learning for Sequential Recommendation with Similarity-based Positive Pair Selection
topic Information Retrieval
url https://arxiv.org/abs/2504.19178