Counterclockwise Dissipativity, Potential Games and Evolutionary Nash Equilibrium Learning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913455384035328 |
|---|---|
| author | Martins, Nuno C. Certório, Jair Hankins, Matthew S. |
| author_facet | Martins, Nuno C. Certório, Jair Hankins, Matthew S. |
| contents | We use system-theoretic passivity methods to study evolutionary Nash equilibria learning in large populations of agents engaged in strategic, non-cooperative interactions. The agents follow learning rules (rules for short) that capture their strategic preferences and a payoff mechanism ascribes payoffs to the available strategies. The population's aggregate strategic profile is the state of an associated evolutionary dynamical system. Evolutionary Nash equilibrium learning refers to the convergence of this state to the Nash equilibria set of the payoff mechanism. Most approaches consider memoryless payoff mechanisms, such as potential games. Recently, methods using $δ$-passivity and equilibrium independent passivity (EIP) have introduced dynamic payoff mechanisms. However, $δ$-passivity does not hold when agents follow rules exhibiting ``imitation" behavior, such as in replicator dynamics. Conversely, EIP applies to the replicator dynamics but not to $δ$-passive rules. We address this gap using counterclockwise dissipativity (CCW). First, we prove that continuous memoryless payoff mechanisms are CCW if and only if they are potential games. Subsequently, under (possibly dynamic) CCW payoff mechanisms, we establish evolutionary Nash equilibrium learning for any rule within a convex cone spanned by imitation rules and continuous $δ$-passive rules. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_00647 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Counterclockwise Dissipativity, Potential Games and Evolutionary Nash Equilibrium Learning Martins, Nuno C. Certório, Jair Hankins, Matthew S. Computer Science and Game Theory Systems and Control Dynamical Systems Optimization and Control 92D10, 92D25 We use system-theoretic passivity methods to study evolutionary Nash equilibria learning in large populations of agents engaged in strategic, non-cooperative interactions. The agents follow learning rules (rules for short) that capture their strategic preferences and a payoff mechanism ascribes payoffs to the available strategies. The population's aggregate strategic profile is the state of an associated evolutionary dynamical system. Evolutionary Nash equilibrium learning refers to the convergence of this state to the Nash equilibria set of the payoff mechanism. Most approaches consider memoryless payoff mechanisms, such as potential games. Recently, methods using $δ$-passivity and equilibrium independent passivity (EIP) have introduced dynamic payoff mechanisms. However, $δ$-passivity does not hold when agents follow rules exhibiting ``imitation" behavior, such as in replicator dynamics. Conversely, EIP applies to the replicator dynamics but not to $δ$-passive rules. We address this gap using counterclockwise dissipativity (CCW). First, we prove that continuous memoryless payoff mechanisms are CCW if and only if they are potential games. Subsequently, under (possibly dynamic) CCW payoff mechanisms, we establish evolutionary Nash equilibrium learning for any rule within a convex cone spanned by imitation rules and continuous $δ$-passive rules. |
| title | Counterclockwise Dissipativity, Potential Games and Evolutionary Nash Equilibrium Learning |
| topic | Computer Science and Game Theory Systems and Control Dynamical Systems Optimization and Control 92D10, 92D25 |
| url | https://arxiv.org/abs/2408.00647 |