Online Hierarchical Policy Learning using Physics Priors for Robot Navigation in Unknown Environments

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Wei Han, Liu, Yuchen, Buynitsky, Alexiy, Qureshi, Ahmed H.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912622636433408
author Chen, Wei Han
Liu, Yuchen
Buynitsky, Alexiy
Qureshi, Ahmed H.
author_facet Chen, Wei Han
Liu, Yuchen
Buynitsky, Alexiy
Qureshi, Ahmed H.
contents Robot navigation in large, complex, and unknown indoor environments is a challenging problem. The existing approaches, such as traditional sampling-based methods, struggle with resolution control and scalability, while imitation learning-based methods require a large amount of demonstration data. Active Neural Time Fields (ANTFields) have recently emerged as a promising solution by using local observations to learn cost-to-go functions without relying on demonstrations. Despite their potential, these methods are hampered by challenges such as spectral bias and catastrophic forgetting, which diminish their effectiveness in complex scenarios. To address these issues, our approach decomposes the planning problem into a hierarchical structure. At the high level, a sparse graph captures the environment's global connectivity, while at the low level, a planner based on neural fields navigates local obstacles by solving the Eikonal PDE. This physics-informed strategy overcomes common pitfalls like spectral bias and neural field fitting difficulties, resulting in a smooth and precise representation of the cost landscape. We validate our framework in large-scale environments, demonstrating its enhanced adaptability and precision compared to previous methods, and highlighting its potential for online exploration, mapping, and real-world navigation.
format Preprint
id arxiv_https___arxiv_org_abs_2510_01519
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Online Hierarchical Policy Learning using Physics Priors for Robot Navigation in Unknown Environments
Chen, Wei Han
Liu, Yuchen
Buynitsky, Alexiy
Qureshi, Ahmed H.
Robotics
Robot navigation in large, complex, and unknown indoor environments is a challenging problem. The existing approaches, such as traditional sampling-based methods, struggle with resolution control and scalability, while imitation learning-based methods require a large amount of demonstration data. Active Neural Time Fields (ANTFields) have recently emerged as a promising solution by using local observations to learn cost-to-go functions without relying on demonstrations. Despite their potential, these methods are hampered by challenges such as spectral bias and catastrophic forgetting, which diminish their effectiveness in complex scenarios. To address these issues, our approach decomposes the planning problem into a hierarchical structure. At the high level, a sparse graph captures the environment's global connectivity, while at the low level, a planner based on neural fields navigates local obstacles by solving the Eikonal PDE. This physics-informed strategy overcomes common pitfalls like spectral bias and neural field fitting difficulties, resulting in a smooth and precise representation of the cost landscape. We validate our framework in large-scale environments, demonstrating its enhanced adaptability and precision compared to previous methods, and highlighting its potential for online exploration, mapping, and real-world navigation.
title Online Hierarchical Policy Learning using Physics Priors for Robot Navigation in Unknown Environments
topic Robotics
url https://arxiv.org/abs/2510.01519