Stochastically Constrained Best Arm Identification with Thompson Sampling
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909450555621376 |
|---|---|
| author | Yang, Le Gao, Siyang Li, Cheng Wang, Yi |
| author_facet | Yang, Le Gao, Siyang Li, Cheng Wang, Yi |
| contents | We consider the problem of the best arm identification in the presence of stochastic constraints, where there is a finite number of arms associated with multiple performance measures. The goal is to identify the arm that optimizes the objective measure subject to constraints on the remaining measures. We will explore the popular idea of Thompson sampling (TS) as a means to solve it. To the best of our knowledge, it is the first attempt to extend TS to this problem. We will design a TS-based sampling algorithm, establish its asymptotic optimality in the rate of posterior convergence, and demonstrate its superior performance using numerical examples. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_03877 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Stochastically Constrained Best Arm Identification with Thompson Sampling Yang, Le Gao, Siyang Li, Cheng Wang, Yi Machine Learning We consider the problem of the best arm identification in the presence of stochastic constraints, where there is a finite number of arms associated with multiple performance measures. The goal is to identify the arm that optimizes the objective measure subject to constraints on the remaining measures. We will explore the popular idea of Thompson sampling (TS) as a means to solve it. To the best of our knowledge, it is the first attempt to extend TS to this problem. We will design a TS-based sampling algorithm, establish its asymptotic optimality in the rate of posterior convergence, and demonstrate its superior performance using numerical examples. |
| title | Stochastically Constrained Best Arm Identification with Thompson Sampling |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2501.03877 |