Saved in:
Bibliographic Details
Main Authors: Wang, Haoyi, Luo, Licheng, Kantaros, Yiannis, Sinopoli, Bruno, Cai, Mingyu
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.22685
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914208815251456
author Wang, Haoyi
Luo, Licheng
Kantaros, Yiannis
Sinopoli, Bruno
Cai, Mingyu
author_facet Wang, Haoyi
Luo, Licheng
Kantaros, Yiannis
Sinopoli, Bruno
Cai, Mingyu
contents Multi-robot navigation in cluttered environments presents fundamental challenges in balancing reactive collision avoidance with long-range goal achievement. When navigating through narrow passages or confined spaces, deadlocks frequently emerge that prevent agents from reaching their destinations, particularly when Reinforcement Learning (RL) control policies encounter novel configurations out of learning distribution. Existing RL-based approaches suffer from limited generalization capability in unseen environments. We propose a hybrid framework that seamlessly integrates RL-based reactive navigation with on-demand Multi-Agent Path Finding (MAPF) to explicitly resolve topological deadlocks. Our approach integrates a safety layer that monitors agent progress to detect deadlocks and, when detected, triggers a coordination controller for affected agents. The framework constructs globally feasible trajectories via MAPF and regulates waypoint progression to reduce inter-agent conflicts during navigation. Extensive evaluation on dense multi-agent benchmarks shows that our method boosts task completion from marginal to near-universal success, markedly reducing deadlocks and collisions. When integrated with hierarchical task planning, it enables coordinated navigation for heterogeneous robots, demonstrating that coupling reactive RL navigation with selective MAPF intervention yields a robust, zero-shot performance.
format Preprint
id arxiv_https___arxiv_org_abs_2511_22685
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Deadlock-Free Hybrid RL-MAPF Framework for Zero-Shot Multi-Robot Navigation
Wang, Haoyi
Luo, Licheng
Kantaros, Yiannis
Sinopoli, Bruno
Cai, Mingyu
Robotics
Multi-robot navigation in cluttered environments presents fundamental challenges in balancing reactive collision avoidance with long-range goal achievement. When navigating through narrow passages or confined spaces, deadlocks frequently emerge that prevent agents from reaching their destinations, particularly when Reinforcement Learning (RL) control policies encounter novel configurations out of learning distribution. Existing RL-based approaches suffer from limited generalization capability in unseen environments. We propose a hybrid framework that seamlessly integrates RL-based reactive navigation with on-demand Multi-Agent Path Finding (MAPF) to explicitly resolve topological deadlocks. Our approach integrates a safety layer that monitors agent progress to detect deadlocks and, when detected, triggers a coordination controller for affected agents. The framework constructs globally feasible trajectories via MAPF and regulates waypoint progression to reduce inter-agent conflicts during navigation. Extensive evaluation on dense multi-agent benchmarks shows that our method boosts task completion from marginal to near-universal success, markedly reducing deadlocks and collisions. When integrated with hierarchical task planning, it enables coordinated navigation for heterogeneous robots, demonstrating that coupling reactive RL navigation with selective MAPF intervention yields a robust, zero-shot performance.
title Deadlock-Free Hybrid RL-MAPF Framework for Zero-Shot Multi-Robot Navigation
topic Robotics
url https://arxiv.org/abs/2511.22685