BIG Hype: Best Intervention in Games via Distributed Hypergradient Descent
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909153218265088 |
|---|---|
| author | Grontas, Panagiotis D. Belgioioso, Giuseppe Cenedese, Carlo Fochesato, Marta Lygeros, John Dörfler, Florian |
| author_facet | Grontas, Panagiotis D. Belgioioso, Giuseppe Cenedese, Carlo Fochesato, Marta Lygeros, John Dörfler, Florian |
| contents | Hierarchical decision making problems, such as bilevel programs and Stackelberg games, are attracting increasing interest in both the engineering and machine learning communities. Yet, existing solution methods lack either convergence guarantees or computational efficiency, due to the absence of smoothness and convexity. In this work, we bridge this gap by designing a first-order hypergradient-based algorithm for Stackelberg games and mathematically establishing its convergence using tools from nonsmooth analysis. To evaluate the \textit{hypergradient}, namely, the gradient of the upper-level objective, we develop an online scheme that simultaneously computes the lower-level equilibrium and its Jacobian. Crucially, this scheme exploits and preserves the original hierarchical and distributed structure of the problem, which renders it scalable and privacy-preserving. We numerically verify the computational efficiency and scalability of our algorithm on a large-scale hierarchical demand-response model. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2303_01101 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | BIG Hype: Best Intervention in Games via Distributed Hypergradient Descent Grontas, Panagiotis D. Belgioioso, Giuseppe Cenedese, Carlo Fochesato, Marta Lygeros, John Dörfler, Florian Optimization and Control Hierarchical decision making problems, such as bilevel programs and Stackelberg games, are attracting increasing interest in both the engineering and machine learning communities. Yet, existing solution methods lack either convergence guarantees or computational efficiency, due to the absence of smoothness and convexity. In this work, we bridge this gap by designing a first-order hypergradient-based algorithm for Stackelberg games and mathematically establishing its convergence using tools from nonsmooth analysis. To evaluate the \textit{hypergradient}, namely, the gradient of the upper-level objective, we develop an online scheme that simultaneously computes the lower-level equilibrium and its Jacobian. Crucially, this scheme exploits and preserves the original hierarchical and distributed structure of the problem, which renders it scalable and privacy-preserving. We numerically verify the computational efficiency and scalability of our algorithm on a large-scale hierarchical demand-response model. |
| title | BIG Hype: Best Intervention in Games via Distributed Hypergradient Descent |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2303.01101 |