Online Multi-Agent Control with Adversarial Disturbances

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Barakat, Anas, Lazarsfeld, John, Piliouras, Georgios, Varvitsiotis, Antonios
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911177473261568
author Barakat, Anas
Lazarsfeld, John
Piliouras, Georgios
Varvitsiotis, Antonios
author_facet Barakat, Anas
Lazarsfeld, John
Piliouras, Georgios
Varvitsiotis, Antonios
contents Online multi-agent control problems, where many agents pursue competing and time-varying objectives, are widespread in domains such as autonomous robotics, economics, and energy systems. In these settings, robustness to adversarial disturbances is critical. In this paper, we study online control in multi-agent linear dynamical systems subject to such disturbances. In contrast to most prior work in multi-agent control, which typically assumes noiseless or stochastically perturbed dynamics, we consider an online setting where disturbances can be adversarial, and where each agent seeks to minimize its own sequence of convex losses. Under two feedback models, we analyze online gradient-based controllers with local policy updates. We prove per-agent regret bounds that are sublinear and near-optimal in the time horizon and that highlight different scalings with the number of agents. When agents' objectives are aligned, we further show that the multi-agent control problem induces a time-varying potential game for which we derive equilibrium tracking guarantees. Together, our results take a first step in bridging online control with online learning in games, establishing robust individual and collective performance guarantees in dynamic continuous-state environments.
format Preprint
id arxiv_https___arxiv_org_abs_2506_18814
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Online Multi-Agent Control with Adversarial Disturbances
Barakat, Anas
Lazarsfeld, John
Piliouras, Georgios
Varvitsiotis, Antonios
Machine Learning
Computer Science and Game Theory
Optimization and Control
Online multi-agent control problems, where many agents pursue competing and time-varying objectives, are widespread in domains such as autonomous robotics, economics, and energy systems. In these settings, robustness to adversarial disturbances is critical. In this paper, we study online control in multi-agent linear dynamical systems subject to such disturbances. In contrast to most prior work in multi-agent control, which typically assumes noiseless or stochastically perturbed dynamics, we consider an online setting where disturbances can be adversarial, and where each agent seeks to minimize its own sequence of convex losses. Under two feedback models, we analyze online gradient-based controllers with local policy updates. We prove per-agent regret bounds that are sublinear and near-optimal in the time horizon and that highlight different scalings with the number of agents. When agents' objectives are aligned, we further show that the multi-agent control problem induces a time-varying potential game for which we derive equilibrium tracking guarantees. Together, our results take a first step in bridging online control with online learning in games, establishing robust individual and collective performance guarantees in dynamic continuous-state environments.
title Online Multi-Agent Control with Adversarial Disturbances
topic Machine Learning
Computer Science and Game Theory
Optimization and Control
url https://arxiv.org/abs/2506.18814