Equivariant Contrastive Learning for Sequential Recommendation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Peilin, Gao, Jingqi, Xie, Yueqi, Ye, Qichen, Hua, Yining, Kim, Jae Boum, Wang, Shoujin, Kim, Sunghun
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909138593775616
author Zhou, Peilin
Gao, Jingqi
Xie, Yueqi
Ye, Qichen
Hua, Yining
Kim, Jae Boum
Wang, Shoujin
Kim, Sunghun
author_facet Zhou, Peilin
Gao, Jingqi
Xie, Yueqi
Ye, Qichen
Hua, Yining
Kim, Jae Boum
Wang, Shoujin
Kim, Sunghun
contents Contrastive learning (CL) benefits the training of sequential recommendation models with informative self-supervision signals. Existing solutions apply general sequential data augmentation strategies to generate positive pairs and encourage their representations to be invariant. However, due to the inherent properties of user behavior sequences, some augmentation strategies, such as item substitution, can lead to changes in user intent. Learning indiscriminately invariant representations for all augmentation strategies might be suboptimal. Therefore, we propose Equivariant Contrastive Learning for Sequential Recommendation (ECL-SR), which endows SR models with great discriminative power, making the learned user behavior representations sensitive to invasive augmentations (e.g., item substitution) and insensitive to mild augmentations (e.g., featurelevel dropout masking). In detail, we use the conditional discriminator to capture differences in behavior due to item substitution, which encourages the user behavior encoder to be equivariant to invasive augmentations. Comprehensive experiments on four benchmark datasets show that the proposed ECL-SR framework achieves competitive performance compared to state-of-the-art SR models. The source code is available at https://github.com/Tokkiu/ECL.
format Preprint
id arxiv_https___arxiv_org_abs_2211_05290
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Equivariant Contrastive Learning for Sequential Recommendation
Zhou, Peilin
Gao, Jingqi
Xie, Yueqi
Ye, Qichen
Hua, Yining
Kim, Jae Boum
Wang, Shoujin
Kim, Sunghun
Information Retrieval
Contrastive learning (CL) benefits the training of sequential recommendation models with informative self-supervision signals. Existing solutions apply general sequential data augmentation strategies to generate positive pairs and encourage their representations to be invariant. However, due to the inherent properties of user behavior sequences, some augmentation strategies, such as item substitution, can lead to changes in user intent. Learning indiscriminately invariant representations for all augmentation strategies might be suboptimal. Therefore, we propose Equivariant Contrastive Learning for Sequential Recommendation (ECL-SR), which endows SR models with great discriminative power, making the learned user behavior representations sensitive to invasive augmentations (e.g., item substitution) and insensitive to mild augmentations (e.g., featurelevel dropout masking). In detail, we use the conditional discriminator to capture differences in behavior due to item substitution, which encourages the user behavior encoder to be equivariant to invasive augmentations. Comprehensive experiments on four benchmark datasets show that the proposed ECL-SR framework achieves competitive performance compared to state-of-the-art SR models. The source code is available at https://github.com/Tokkiu/ECL.
title Equivariant Contrastive Learning for Sequential Recommendation
topic Information Retrieval
url https://arxiv.org/abs/2211.05290