Efficient Learning and Computation of Linear Correlated Equilibrium in General Convex Games

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Daskalakis, Constantinos, Farina, Gabriele, Fishelson, Maxwell, Pipis, Charilaos, Schneider, Jon
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916545247051776
author Daskalakis, Constantinos
Farina, Gabriele
Fishelson, Maxwell
Pipis, Charilaos
Schneider, Jon
author_facet Daskalakis, Constantinos
Farina, Gabriele
Fishelson, Maxwell
Pipis, Charilaos
Schneider, Jon
contents We propose efficient no-regret learning dynamics and ellipsoid-based methods for computing linear correlated equilibria$\unicode{x2014}$a relaxation of correlated equilibria and a strengthening of coarse correlated equilibria$\unicode{x2014}$in general convex games. These are games where the number of pure strategies is potentially exponential in the natural representation of the game, such as extensive-form games. Our work identifies linear correlated equilibria as the tightest known notion of equilibrium that is computable in polynomial time and is efficiently learnable for general convex games. Our results are enabled by a generalization of the seminal framework of of Gordon et al. [2008] for $Φ$-regret minimization, providing extensions to this framework that can be used even when the set of deviations $Φ$ is intractable to separate/optimize over. Our polynomial-time algorithms are similarly enabled by extending the Ellipsoid-Against-Hope approach of Papadimitriou and Roughgarden [2008] and its generalization to games of non-polynomial type proposed by Farina and Pipis [2024a]. We provide an extension to these approaches when we do not have access to the separation oracles required by these works for the dual player.
format Preprint
id arxiv_https___arxiv_org_abs_2412_20291
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Efficient Learning and Computation of Linear Correlated Equilibrium in General Convex Games
Daskalakis, Constantinos
Farina, Gabriele
Fishelson, Maxwell
Pipis, Charilaos
Schneider, Jon
Computer Science and Game Theory
We propose efficient no-regret learning dynamics and ellipsoid-based methods for computing linear correlated equilibria$\unicode{x2014}$a relaxation of correlated equilibria and a strengthening of coarse correlated equilibria$\unicode{x2014}$in general convex games. These are games where the number of pure strategies is potentially exponential in the natural representation of the game, such as extensive-form games. Our work identifies linear correlated equilibria as the tightest known notion of equilibrium that is computable in polynomial time and is efficiently learnable for general convex games. Our results are enabled by a generalization of the seminal framework of of Gordon et al. [2008] for $Φ$-regret minimization, providing extensions to this framework that can be used even when the set of deviations $Φ$ is intractable to separate/optimize over. Our polynomial-time algorithms are similarly enabled by extending the Ellipsoid-Against-Hope approach of Papadimitriou and Roughgarden [2008] and its generalization to games of non-polynomial type proposed by Farina and Pipis [2024a]. We provide an extension to these approaches when we do not have access to the separation oracles required by these works for the dual player.
title Efficient Learning and Computation of Linear Correlated Equilibrium in General Convex Games
topic Computer Science and Game Theory
url https://arxiv.org/abs/2412.20291