A Machine Learning Method for Stackelberg Mean Field Games

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dayanikli, Gokce, Lauriere, Mathieu
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929324208160768
author Dayanikli, Gokce
Lauriere, Mathieu
author_facet Dayanikli, Gokce
Lauriere, Mathieu
contents We propose a single-level numerical approach to solve Stackelberg mean field game (MFG) problems. In Stackelberg MFG, an infinite population of agents play a non-cooperative game and choose their controls to optimize their individual objectives while interacting with the principal and other agents through the population distribution. The principal can influence the mean field Nash equilibrium at the population level through policies, and she optimizes her own objective, which depends on the population distribution. This leads to a bi-level problem between the principal and mean field of agents that cannot be solved using traditional methods for MFGs. We propose a reformulation of this problem as a single-level mean field optimal control problem through a penalization approach. We prove convergence of the reformulated problem to the original problem. We propose a machine learning method based on (feed-forward and recurrent) neural networks and illustrate it on several examples from the literature.
format Preprint
id arxiv_https___arxiv_org_abs_2302_10440
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A Machine Learning Method for Stackelberg Mean Field Games
Dayanikli, Gokce
Lauriere, Mathieu
Optimization and Control
49N90, 91A13, 91A15, 62M45
We propose a single-level numerical approach to solve Stackelberg mean field game (MFG) problems. In Stackelberg MFG, an infinite population of agents play a non-cooperative game and choose their controls to optimize their individual objectives while interacting with the principal and other agents through the population distribution. The principal can influence the mean field Nash equilibrium at the population level through policies, and she optimizes her own objective, which depends on the population distribution. This leads to a bi-level problem between the principal and mean field of agents that cannot be solved using traditional methods for MFGs. We propose a reformulation of this problem as a single-level mean field optimal control problem through a penalization approach. We prove convergence of the reformulated problem to the original problem. We propose a machine learning method based on (feed-forward and recurrent) neural networks and illustrate it on several examples from the literature.
title A Machine Learning Method for Stackelberg Mean Field Games
topic Optimization and Control
49N90, 91A13, 91A15, 62M45
url https://arxiv.org/abs/2302.10440