MADR: MPC-guided Adversarial DeepReach

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Teoh, Ryan, Tonkens, Sander, Sharpless, William, Yang, Aijia, Feng, Zeyuan, Bansal, Somil, Herbert, Sylvia
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918165138636800
author Teoh, Ryan
Tonkens, Sander
Sharpless, William
Yang, Aijia
Feng, Zeyuan
Bansal, Somil
Herbert, Sylvia
author_facet Teoh, Ryan
Tonkens, Sander
Sharpless, William
Yang, Aijia
Feng, Zeyuan
Bansal, Somil
Herbert, Sylvia
contents Hamilton-Jacobi (HJ) Reachability offers a framework for generating safe value functions and policies in the face of adversarial disturbance, but is limited by the curse of dimensionality. Physics-informed deep learning is able to overcome this infeasibility, but itself suffers from slow and inaccurate convergence, primarily due to weak PDE gradients and the complexity of self-supervised learning. A few works, recently, have demonstrated that enriching the self-supervision process with regular supervision (based on the nature of the optimal control problem), greatly accelerates convergence and solution quality, however, these have been limited to single player problems and simple games. In this work, we introduce MADR: MPC-guided Adversarial DeepReach, a general framework to robustly approximate the two-player, zero-sum differential game value function. In doing so, MADR yields the corresponding optimal strategies for both players in zero-sum games as well as safe policies for worst-case robustness. We test MADR on a multitude of high-dimensional simulated and real robotic agents with varying dynamics and games, finding that our approach significantly out-performs state-of-the-art baselines in simulation and produces impressive results in hardware.
format Preprint
id arxiv_https___arxiv_org_abs_2510_18845
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MADR: MPC-guided Adversarial DeepReach
Teoh, Ryan
Tonkens, Sander
Sharpless, William
Yang, Aijia
Feng, Zeyuan
Bansal, Somil
Herbert, Sylvia
Robotics
Systems and Control
Hamilton-Jacobi (HJ) Reachability offers a framework for generating safe value functions and policies in the face of adversarial disturbance, but is limited by the curse of dimensionality. Physics-informed deep learning is able to overcome this infeasibility, but itself suffers from slow and inaccurate convergence, primarily due to weak PDE gradients and the complexity of self-supervised learning. A few works, recently, have demonstrated that enriching the self-supervision process with regular supervision (based on the nature of the optimal control problem), greatly accelerates convergence and solution quality, however, these have been limited to single player problems and simple games. In this work, we introduce MADR: MPC-guided Adversarial DeepReach, a general framework to robustly approximate the two-player, zero-sum differential game value function. In doing so, MADR yields the corresponding optimal strategies for both players in zero-sum games as well as safe policies for worst-case robustness. We test MADR on a multitude of high-dimensional simulated and real robotic agents with varying dynamics and games, finding that our approach significantly out-performs state-of-the-art baselines in simulation and produces impressive results in hardware.
title MADR: MPC-guided Adversarial DeepReach
topic Robotics
Systems and Control
url https://arxiv.org/abs/2510.18845