Choose Your Battles: Distributed Learning Over Multiple Tug of War Games

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chandak, Siddharth, Bistritz, Ilai, Bambos, Nicholas
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911585806581760
author Chandak, Siddharth
Bistritz, Ilai
Bambos, Nicholas
author_facet Chandak, Siddharth
Bistritz, Ilai
Bambos, Nicholas
contents Consider $N$ players and $K$ games taking place simultaneously. Each of these games is modeled as a Tug-of-War (ToW) game where increasing the action of one player decreases the reward for all other players. Each player participates in only one game at any given time. At each time step, a player decides the game in which they wish to participate in and the action they take in that game. Their reward depends on the actions of all players that are in the same game. This system of $K$ games is termed a 'Meta Tug-of-War' (Meta-ToW) game. These games can model scenarios such as power control, distributed task allocation, and activation in sensor networks. We propose the Meta Tug-of-Peace algorithm, a distributed algorithm where the action updates are done using a simple stochastic approximation algorithm, and the decision to switch games is made using an infrequent 1-bit communication between the players. We prove that in Meta-ToW games, our algorithm converges to an equilibrium that satisfies a target Quality of Service reward vector for the players. We then demonstrate the efficacy of our algorithm through simulations for the scenarios mentioned above.
format Preprint
id arxiv_https___arxiv_org_abs_2509_20147
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Choose Your Battles: Distributed Learning Over Multiple Tug of War Games
Chandak, Siddharth
Bistritz, Ilai
Bambos, Nicholas
Computer Science and Game Theory
Machine Learning
Multiagent Systems
Systems and Control
Consider $N$ players and $K$ games taking place simultaneously. Each of these games is modeled as a Tug-of-War (ToW) game where increasing the action of one player decreases the reward for all other players. Each player participates in only one game at any given time. At each time step, a player decides the game in which they wish to participate in and the action they take in that game. Their reward depends on the actions of all players that are in the same game. This system of $K$ games is termed a 'Meta Tug-of-War' (Meta-ToW) game. These games can model scenarios such as power control, distributed task allocation, and activation in sensor networks. We propose the Meta Tug-of-Peace algorithm, a distributed algorithm where the action updates are done using a simple stochastic approximation algorithm, and the decision to switch games is made using an infrequent 1-bit communication between the players. We prove that in Meta-ToW games, our algorithm converges to an equilibrium that satisfies a target Quality of Service reward vector for the players. We then demonstrate the efficacy of our algorithm through simulations for the scenarios mentioned above.
title Choose Your Battles: Distributed Learning Over Multiple Tug of War Games
topic Computer Science and Game Theory
Machine Learning
Multiagent Systems
Systems and Control
url https://arxiv.org/abs/2509.20147