Distributed Differentiable Dynamic Game for Multi-robot Coordination

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Yizhi, Jin, Wanxin, Wang, Xuan
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929509975982080
author Zhou, Yizhi
Jin, Wanxin
Wang, Xuan
author_facet Zhou, Yizhi
Jin, Wanxin
Wang, Xuan
contents This paper develops a Distributed Differentiable Dynamic Game (D3G) framework, which can efficiently solve the forward and inverse problems in multi-robot coordination. We formulate multi-robot coordination as a dynamic game, where the behavior of a robot is dictated by its own dynamics and objective that also depends on others' behavior. In the forward problem, D3G enables all robots collaboratively to seek the Nash equilibrium of the game in a distributed manner, by developing a distributed shooting-based Nash solver. In the inverse problem, where each robot aims to find (learn) its objective (and dynamics) parameters to mimic given coordination demonstrations, D3G proposes a differentiation solver based on Differential Pontryagin's Maximum Principle, which allows each robot to update its parameters in a distributed and coordinated manner. We test the D3G in simulation with two types of robots given different task configurations. The results demonstrate the effectiveness of D3G for solving both forward and inverse problems in comparison with existing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2207_08892
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Distributed Differentiable Dynamic Game for Multi-robot Coordination
Zhou, Yizhi
Jin, Wanxin
Wang, Xuan
Robotics
Machine Learning
Multiagent Systems
Systems and Control
This paper develops a Distributed Differentiable Dynamic Game (D3G) framework, which can efficiently solve the forward and inverse problems in multi-robot coordination. We formulate multi-robot coordination as a dynamic game, where the behavior of a robot is dictated by its own dynamics and objective that also depends on others' behavior. In the forward problem, D3G enables all robots collaboratively to seek the Nash equilibrium of the game in a distributed manner, by developing a distributed shooting-based Nash solver. In the inverse problem, where each robot aims to find (learn) its objective (and dynamics) parameters to mimic given coordination demonstrations, D3G proposes a differentiation solver based on Differential Pontryagin's Maximum Principle, which allows each robot to update its parameters in a distributed and coordinated manner. We test the D3G in simulation with two types of robots given different task configurations. The results demonstrate the effectiveness of D3G for solving both forward and inverse problems in comparison with existing methods.
title Distributed Differentiable Dynamic Game for Multi-robot Coordination
topic Robotics
Machine Learning
Multiagent Systems
Systems and Control
url https://arxiv.org/abs/2207.08892