Online learning with noisy side observations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kocák, Tomáš, Neu, Gergely, Valko, Michal
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915938588164096
author Kocák, Tomáš
Neu, Gergely
Valko, Michal
author_facet Kocák, Tomáš
Neu, Gergely
Valko, Michal
contents We propose a new partial-observability model for online learning problems where the learner, besides its own loss, also observes some noisy feedback about the other actions, depending on the underlying structure of the problem. We represent this structure by a weighted directed graph, where the edge weights are related to the quality of the feedback shared by the connected nodes. Our main contribution is an efficient algorithm that guarantees a regret of $\widetilde{O}(\sqrt{α^* T})$ after $T$ rounds, where $α^*$ is a novel graph property that we call the effective independence number. Our algorithm is completely parameter-free and does not require knowledge (or even estimation) of $α^*$. For the special case of binary edge weights, our setting reduces to the partial-observability models of Mannor and Shamir (2011) and Alon et al. (2013) and our algorithm recovers the near-optimal regret bounds.
format Preprint
id arxiv_https___arxiv_org_abs_2604_13740
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Online learning with noisy side observations
Kocák, Tomáš
Neu, Gergely
Valko, Michal
Machine Learning
We propose a new partial-observability model for online learning problems where the learner, besides its own loss, also observes some noisy feedback about the other actions, depending on the underlying structure of the problem. We represent this structure by a weighted directed graph, where the edge weights are related to the quality of the feedback shared by the connected nodes. Our main contribution is an efficient algorithm that guarantees a regret of $\widetilde{O}(\sqrt{α^* T})$ after $T$ rounds, where $α^*$ is a novel graph property that we call the effective independence number. Our algorithm is completely parameter-free and does not require knowledge (or even estimation) of $α^*$. For the special case of binary edge weights, our setting reduces to the partial-observability models of Mannor and Shamir (2011) and Alon et al. (2013) and our algorithm recovers the near-optimal regret bounds.
title Online learning with noisy side observations
topic Machine Learning
url https://arxiv.org/abs/2604.13740