Diffusion Models Meet Contextual Bandits

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Aouali, Imad
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915580173352960
author Aouali, Imad
author_facet Aouali, Imad
contents Efficient online decision-making in contextual bandits is challenging, as methods without informative priors often suffer from computational or statistical inefficiencies. In this work, we leverage pre-trained diffusion models as expressive priors to capture complex action dependencies and develop a practical algorithm that efficiently approximates posteriors under such priors, enabling both fast updates and sampling. Empirical results demonstrate the effectiveness and versatility of our approach across diverse contextual bandit settings.
format Preprint
id arxiv_https___arxiv_org_abs_2402_10028
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Diffusion Models Meet Contextual Bandits
Aouali, Imad
Machine Learning
Artificial Intelligence
Efficient online decision-making in contextual bandits is challenging, as methods without informative priors often suffer from computational or statistical inefficiencies. In this work, we leverage pre-trained diffusion models as expressive priors to capture complex action dependencies and develop a practical algorithm that efficiently approximates posteriors under such priors, enabling both fast updates and sampling. Empirical results demonstrate the effectiveness and versatility of our approach across diverse contextual bandit settings.
title Diffusion Models Meet Contextual Bandits
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2402.10028