Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributions
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909118235672576 |
|---|---|
| author | Park, Sungwoo Kwon, Junyeop Kim, Byeongnoh Chae, Suhyun Lee, Jeeyong Lee, Dabeen |
| author_facet | Park, Sungwoo Kwon, Junyeop Kim, Byeongnoh Chae, Suhyun Lee, Jeeyong Lee, Dabeen |
| contents | This paper studies performative risk minimization, a formulation of stochastic optimization under decision-dependent distributions. We consider the general case where the performative risk can be non-convex, for which we develop efficient parameter-free optimistic optimization-based methods. Our algorithms significantly improve upon the existing Lipschitz bandit-based method in many aspects. In particular, our framework does not require knowledge about the sensitivity parameter of the distribution map and the Lipshitz constant of the loss function. This makes our framework practically favorable, together with the efficient optimistic optimization-based tree-search mechanism. We provide experimental results that demonstrate the numerical superiority of our algorithms over the existing method and other black-box optimistic optimization methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_15188 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributions Park, Sungwoo Kwon, Junyeop Kim, Byeongnoh Chae, Suhyun Lee, Jeeyong Lee, Dabeen Machine Learning Optimization and Control This paper studies performative risk minimization, a formulation of stochastic optimization under decision-dependent distributions. We consider the general case where the performative risk can be non-convex, for which we develop efficient parameter-free optimistic optimization-based methods. Our algorithms significantly improve upon the existing Lipschitz bandit-based method in many aspects. In particular, our framework does not require knowledge about the sensitivity parameter of the distribution map and the Lipshitz constant of the loss function. This makes our framework practically favorable, together with the efficient optimistic optimization-based tree-search mechanism. We provide experimental results that demonstrate the numerical superiority of our algorithms over the existing method and other black-box optimistic optimization methods. |
| title | Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributions |
| topic | Machine Learning Optimization and Control |
| url | https://arxiv.org/abs/2402.15188 |