Passivity Tools for Hybrid Learning Rules in Large Populations

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Certorio, Jair, Chang, Kevin, Martins, Nuno C., Nuzzo, Pierluigi, Shoukry, Yasser
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913610375102464
author Certorio, Jair
Chang, Kevin
Martins, Nuno C.
Nuzzo, Pierluigi
Shoukry, Yasser
author_facet Certorio, Jair
Chang, Kevin
Martins, Nuno C.
Nuzzo, Pierluigi
Shoukry, Yasser
contents Recent work has pioneered the use of system-theoretic passivity to study equilibrium stability for the dynamics of noncooperative strategic interactions in large populations of learning agents. In this and related works, the stability analysis leverages knowledge that certain ``canonical'' classes of learning rules used to model the agents' strategic behaviors satisfy a passivity condition known as $δ$-passivity. In this paper, we consider that agents exhibit learning behaviors that do not align with a canonical class. Specifically, we focus on characterizing $δ$-passivity for hybrid learning rules that combine elements from canonical classes. Our analysis also introduces and uses a more general version of $δ$-passivity, which, for the first time, can handle discontinuous learning rules, including those showing best-response behaviors. We state and prove theorems establishing $δ$-passivity for two broad convex cones of hybrid learning rules. These cones can merge into a larger one preserving $δ$-passivity in scenarios limited to two strategies. In our proofs, we establish intermediate facts that are significant on their own and could potentially be used to further generalize our work. We illustrate the applicability of our results through numerical examples.
format Preprint
id arxiv_https___arxiv_org_abs_2407_02083
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Passivity Tools for Hybrid Learning Rules in Large Populations
Certorio, Jair
Chang, Kevin
Martins, Nuno C.
Nuzzo, Pierluigi
Shoukry, Yasser
Dynamical Systems
Systems and Control
Optimization and Control
92D10, 92D25
Recent work has pioneered the use of system-theoretic passivity to study equilibrium stability for the dynamics of noncooperative strategic interactions in large populations of learning agents. In this and related works, the stability analysis leverages knowledge that certain ``canonical'' classes of learning rules used to model the agents' strategic behaviors satisfy a passivity condition known as $δ$-passivity. In this paper, we consider that agents exhibit learning behaviors that do not align with a canonical class. Specifically, we focus on characterizing $δ$-passivity for hybrid learning rules that combine elements from canonical classes. Our analysis also introduces and uses a more general version of $δ$-passivity, which, for the first time, can handle discontinuous learning rules, including those showing best-response behaviors. We state and prove theorems establishing $δ$-passivity for two broad convex cones of hybrid learning rules. These cones can merge into a larger one preserving $δ$-passivity in scenarios limited to two strategies. In our proofs, we establish intermediate facts that are significant on their own and could potentially be used to further generalize our work. We illustrate the applicability of our results through numerical examples.
title Passivity Tools for Hybrid Learning Rules in Large Populations
topic Dynamical Systems
Systems and Control
Optimization and Control
92D10, 92D25
url https://arxiv.org/abs/2407.02083