Optimal Strategy Revision in Population Games: A Mean Field Game Theory Perspective

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Barreiro-Gomez, Julian, Park, Shinkyu
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914143001378816
author Barreiro-Gomez, Julian
Park, Shinkyu
author_facet Barreiro-Gomez, Julian
Park, Shinkyu
contents This paper investigates the design of optimal strategy revision in Population Games (PG) by establishing its connection to finite-state Mean Field Games (MFG). Specifically, by linking Evolutionary Dynamics (ED) -- which models agent decision-making in PG -- to the MFG framework, we demonstrate that optimal strategy revision can be derived by solving the forward Fokker-Planck (FP) equation and the backward Hamilton-Jacobi (HJ) equation, both central components of the MFG framework. Furthermore, we show that the resulting optimal strategy revision, which maximizes each agent's payoffs over a finite time horizon, satisfies two key properties: positive correlation and Nash stationarity, which are essential for ensuring convergence to the Nash equilibrium. This convergence is then rigorously analyzed and established. Additionally, we discuss how different design objectives for the optimal strategy revision can recover existing ED models previously reported in the PG literature. Numerical examples are provided to illustrate the effectiveness and improved convergence properties of the optimal strategy revision design.
format Preprint
id arxiv_https___arxiv_org_abs_2501_01389
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Optimal Strategy Revision in Population Games: A Mean Field Game Theory Perspective
Barreiro-Gomez, Julian
Park, Shinkyu
Multiagent Systems
Computer Science and Game Theory
This paper investigates the design of optimal strategy revision in Population Games (PG) by establishing its connection to finite-state Mean Field Games (MFG). Specifically, by linking Evolutionary Dynamics (ED) -- which models agent decision-making in PG -- to the MFG framework, we demonstrate that optimal strategy revision can be derived by solving the forward Fokker-Planck (FP) equation and the backward Hamilton-Jacobi (HJ) equation, both central components of the MFG framework. Furthermore, we show that the resulting optimal strategy revision, which maximizes each agent's payoffs over a finite time horizon, satisfies two key properties: positive correlation and Nash stationarity, which are essential for ensuring convergence to the Nash equilibrium. This convergence is then rigorously analyzed and established. Additionally, we discuss how different design objectives for the optimal strategy revision can recover existing ED models previously reported in the PG literature. Numerical examples are provided to illustrate the effectiveness and improved convergence properties of the optimal strategy revision design.
title Optimal Strategy Revision in Population Games: A Mean Field Game Theory Perspective
topic Multiagent Systems
Computer Science and Game Theory
url https://arxiv.org/abs/2501.01389