Convergence of Payoff-Based Higher-Order Replicator Dynamics in Contractive Games

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Abdelraouf, Hassan, Gupta, Vijay, Shamma, Jeff S.
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908899965140992
author Abdelraouf, Hassan
Gupta, Vijay
Shamma, Jeff S.
author_facet Abdelraouf, Hassan
Gupta, Vijay
Shamma, Jeff S.
contents We study the convergence properties of a payoff-based higher-order version of replicator dynamics, a widely studied model in evolutionary dynamics and game-theoretic learning, in contractive games. Recent work has introduced a control-theoretic perspective for analyzing the convergence of learning dynamics through passivity theory, leading to a classification of learning dynamics based on the passivity notion they satisfy, such as \textdelta-passivity, equilibrium-independent passivity, and incremental passivity. We leverage this framework for the study of higher-order replicator dynamics for contractive games, which form the complement of passive learning dynamics. Standard replicator dynamics can be represented as a cascade interconnection between an integrator and the softmax mapping. Payoff-based higher-order replicator dynamics include a linear time-invariant (LTI) system in parallel with the existing integrator. First, we show that if this added system is strictly passive and asymptotically stable, then the resulting learning dynamics converge locally to the Nash equilibrium in contractive games. Second, we establish global convergence properties using incremental stability analysis for the special case of symmetric matrix contractive games.
format Preprint
id arxiv_https___arxiv_org_abs_2603_18219
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Convergence of Payoff-Based Higher-Order Replicator Dynamics in Contractive Games
Abdelraouf, Hassan
Gupta, Vijay
Shamma, Jeff S.
Systems and Control
We study the convergence properties of a payoff-based higher-order version of replicator dynamics, a widely studied model in evolutionary dynamics and game-theoretic learning, in contractive games. Recent work has introduced a control-theoretic perspective for analyzing the convergence of learning dynamics through passivity theory, leading to a classification of learning dynamics based on the passivity notion they satisfy, such as \textdelta-passivity, equilibrium-independent passivity, and incremental passivity. We leverage this framework for the study of higher-order replicator dynamics for contractive games, which form the complement of passive learning dynamics. Standard replicator dynamics can be represented as a cascade interconnection between an integrator and the softmax mapping. Payoff-based higher-order replicator dynamics include a linear time-invariant (LTI) system in parallel with the existing integrator. First, we show that if this added system is strictly passive and asymptotically stable, then the resulting learning dynamics converge locally to the Nash equilibrium in contractive games. Second, we establish global convergence properties using incremental stability analysis for the special case of symmetric matrix contractive games.
title Convergence of Payoff-Based Higher-Order Replicator Dynamics in Contractive Games
topic Systems and Control
url https://arxiv.org/abs/2603.18219