Non-stochastic Bandits With Evolving Observations

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Bar-On, Yogev, Mansour, Yishay
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929359646883840
author Bar-On, Yogev
Mansour, Yishay
author_facet Bar-On, Yogev
Mansour, Yishay
contents We introduce a novel online learning framework that unifies and generalizes pre-established models, such as delayed and corrupted feedback, to encompass adversarial environments where action feedback evolves over time. In this setting, the observed loss is arbitrary and may not correlate with the true loss incurred, with each round updating previous observations adversarially. We propose regret minimization algorithms for both the full-information and bandit settings, with regret bounds quantified by the average feedback accuracy relative to the true loss. Our algorithms match the known regret bounds across many special cases, while also introducing previously unknown bounds.
format Preprint
id arxiv_https___arxiv_org_abs_2405_16843
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Non-stochastic Bandits With Evolving Observations
Bar-On, Yogev
Mansour, Yishay
Machine Learning
We introduce a novel online learning framework that unifies and generalizes pre-established models, such as delayed and corrupted feedback, to encompass adversarial environments where action feedback evolves over time. In this setting, the observed loss is arbitrary and may not correlate with the true loss incurred, with each round updating previous observations adversarially. We propose regret minimization algorithms for both the full-information and bandit settings, with regret bounds quantified by the average feedback accuracy relative to the true loss. Our algorithms match the known regret bounds across many special cases, while also introducing previously unknown bounds.
title Non-stochastic Bandits With Evolving Observations
topic Machine Learning
url https://arxiv.org/abs/2405.16843