Spectral bandits for smooth graph functions with applications in recommender systems

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kocák, Tomáš, Valko, Michal, Munos, Rémi, Kveton, Branislav, Agrawal, Shipra
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911700121288704
author Kocák, Tomáš
Valko, Michal
Munos, Rémi
Kveton, Branislav
Agrawal, Shipra
author_facet Kocák, Tomáš
Valko, Michal
Munos, Rémi
Kveton, Branislav
Agrawal, Shipra
contents Smooth functions on graphs have wide applications in manifold and semi-supervised learning. In this paper, we study a bandit problem where the payoffs of arms are smooth on a graph. This framework is suitable for solving online learning problems that involve graphs, such as content-based recommendation. In this problem, each recommended item is a node and its expected rating is similar to its neighbors. The goal is to recommend items that have high expected ratings. We aim for the algorithms where the cumulative regret would not scale poorly with the number of nodes. In particular, we introduce the notion of an effective dimension, which is small in real-world graphs, and propose two algorithms for solving our problem that scale linearly in this dimension. Our experiments on real-world content recommendation problem show that a good estimator of user preferences for thousands of items can be learned from just tens nodes evaluations.
format Preprint
id arxiv_https___arxiv_org_abs_2605_20552
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Spectral bandits for smooth graph functions with applications in recommender systems
Kocák, Tomáš
Valko, Michal
Munos, Rémi
Kveton, Branislav
Agrawal, Shipra
Machine Learning
Smooth functions on graphs have wide applications in manifold and semi-supervised learning. In this paper, we study a bandit problem where the payoffs of arms are smooth on a graph. This framework is suitable for solving online learning problems that involve graphs, such as content-based recommendation. In this problem, each recommended item is a node and its expected rating is similar to its neighbors. The goal is to recommend items that have high expected ratings. We aim for the algorithms where the cumulative regret would not scale poorly with the number of nodes. In particular, we introduce the notion of an effective dimension, which is small in real-world graphs, and propose two algorithms for solving our problem that scale linearly in this dimension. Our experiments on real-world content recommendation problem show that a good estimator of user preferences for thousands of items can be learned from just tens nodes evaluations.
title Spectral bandits for smooth graph functions with applications in recommender systems
topic Machine Learning
url https://arxiv.org/abs/2605.20552