Autoregressive Generation Strategies for Top-K Sequential Recommendations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Volodkevich, Anna, Gusak, Danil, Klenitskiy, Anton, Vasilev, Alexey
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908492397281280
author Volodkevich, Anna
Gusak, Danil
Klenitskiy, Anton
Vasilev, Alexey
author_facet Volodkevich, Anna
Gusak, Danil
Klenitskiy, Anton
Vasilev, Alexey
contents The goal of modern sequential recommender systems is often formulated in terms of next-item prediction. In this paper, we explore the applicability of generative transformer-based models for the Top-K sequential recommendation task, where the goal is to predict items a user is likely to interact with in the "near future". We explore commonly used autoregressive generation strategies, including greedy decoding, beam search, and temperature sampling, to evaluate their performance for the Top-K sequential recommendation task. In addition, we propose novel Reciprocal Rank Aggregation (RRA) and Relevance Aggregation (RA) generation strategies based on multi-sequence generation with temperature sampling and subsequent aggregation. Experiments on diverse datasets give valuable insights regarding commonly used strategies' applicability and show that suggested approaches improve performance on longer time horizons compared to widely-used Top-K prediction approach and single-sequence autoregressive generation strategies.
format Preprint
id arxiv_https___arxiv_org_abs_2409_17730
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Autoregressive Generation Strategies for Top-K Sequential Recommendations
Volodkevich, Anna
Gusak, Danil
Klenitskiy, Anton
Vasilev, Alexey
Information Retrieval
Machine Learning
The goal of modern sequential recommender systems is often formulated in terms of next-item prediction. In this paper, we explore the applicability of generative transformer-based models for the Top-K sequential recommendation task, where the goal is to predict items a user is likely to interact with in the "near future". We explore commonly used autoregressive generation strategies, including greedy decoding, beam search, and temperature sampling, to evaluate their performance for the Top-K sequential recommendation task. In addition, we propose novel Reciprocal Rank Aggregation (RRA) and Relevance Aggregation (RA) generation strategies based on multi-sequence generation with temperature sampling and subsequent aggregation. Experiments on diverse datasets give valuable insights regarding commonly used strategies' applicability and show that suggested approaches improve performance on longer time horizons compared to widely-used Top-K prediction approach and single-sequence autoregressive generation strategies.
title Autoregressive Generation Strategies for Top-K Sequential Recommendations
topic Information Retrieval
Machine Learning
url https://arxiv.org/abs/2409.17730