COBRA: Contextual Bandit Algorithm for Ensuring Truthful Strategic Agents
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909627489189888 |
|---|---|
| author | Verma, Arun Saha, Indrajit Yokoo, Makoto Low, Bryan Kian Hsiang |
| author_facet | Verma, Arun Saha, Indrajit Yokoo, Makoto Low, Bryan Kian Hsiang |
| contents | This paper considers a contextual bandit problem involving multiple agents, where a learner sequentially observes the contexts and the agent's reported arms, and then selects the arm that maximizes the system's overall reward. Existing work in contextual bandits assumes that agents truthfully report their arms, which is unrealistic in many real-life applications. For instance, consider an online platform with multiple sellers; some sellers may misrepresent product quality to gain an advantage, such as having the platform preferentially recommend their products to online users. To address this challenge, we propose an algorithm, COBRA, for contextual bandit problems involving strategic agents that disincentivize their strategic behavior without using any monetary incentives, while having incentive compatibility and a sub-linear regret guarantee. Our experimental results also validate the different performance aspects of our proposed algorithm. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_23720 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | COBRA: Contextual Bandit Algorithm for Ensuring Truthful Strategic Agents Verma, Arun Saha, Indrajit Yokoo, Makoto Low, Bryan Kian Hsiang Machine Learning Artificial Intelligence This paper considers a contextual bandit problem involving multiple agents, where a learner sequentially observes the contexts and the agent's reported arms, and then selects the arm that maximizes the system's overall reward. Existing work in contextual bandits assumes that agents truthfully report their arms, which is unrealistic in many real-life applications. For instance, consider an online platform with multiple sellers; some sellers may misrepresent product quality to gain an advantage, such as having the platform preferentially recommend their products to online users. To address this challenge, we propose an algorithm, COBRA, for contextual bandit problems involving strategic agents that disincentivize their strategic behavior without using any monetary incentives, while having incentive compatibility and a sub-linear regret guarantee. Our experimental results also validate the different performance aspects of our proposed algorithm. |
| title | COBRA: Contextual Bandit Algorithm for Ensuring Truthful Strategic Agents |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2505.23720 |