Learning from Demonstration with Failure Awareness for Safe Robot Navigation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Xianghui, Cheng, Siwei, Wang, Shanze, Zhang, Xinming, Zhang, Dan, Zhang, Wei
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914507612225536
author Wang, Xianghui
Cheng, Siwei
Wang, Shanze
Zhang, Xinming
Zhang, Dan
Zhang, Wei
author_facet Wang, Xianghui
Cheng, Siwei
Wang, Shanze
Zhang, Xinming
Zhang, Dan
Zhang, Wei
contents Learning from demonstration is widely used for robot navigation, yet it suffers from a fundamental limitation: demonstrations consist predominantly of successful behaviors and provide limited coverage of unsafe states. This limitation leads to poor safety when the robot encounters scenarios beyond the demonstration distribution. Failure experiences, such as collisions, contain essential information about unsafe regions, but remain underutilized. The key difficulty lies in the fact that failure data do not provide valid guidance for action imitation, and their naive incorporation into policy learning often degrades performance. We address this challenge by proposing a failure-aware learning framework that explicitly decouples the roles of success and failure data. In this framework, failure experiences are used to shape value estimation in hazardous regions, while policy learning is restricted to successful demonstrations. This separation enables the effective use of failure data without corrupting policy behavior. We implement this design within an offline reinforcement learning (RL) setting and evaluate it in both simulation and real-world environments. The results show that our framework consistently reduces collision rates while preserving the task success rate, and demonstrate strong generalization across different environments and robot platforms.
format Preprint
id arxiv_https___arxiv_org_abs_2604_23360
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Learning from Demonstration with Failure Awareness for Safe Robot Navigation
Wang, Xianghui
Cheng, Siwei
Wang, Shanze
Zhang, Xinming
Zhang, Dan
Zhang, Wei
Robotics
Learning from demonstration is widely used for robot navigation, yet it suffers from a fundamental limitation: demonstrations consist predominantly of successful behaviors and provide limited coverage of unsafe states. This limitation leads to poor safety when the robot encounters scenarios beyond the demonstration distribution. Failure experiences, such as collisions, contain essential information about unsafe regions, but remain underutilized. The key difficulty lies in the fact that failure data do not provide valid guidance for action imitation, and their naive incorporation into policy learning often degrades performance. We address this challenge by proposing a failure-aware learning framework that explicitly decouples the roles of success and failure data. In this framework, failure experiences are used to shape value estimation in hazardous regions, while policy learning is restricted to successful demonstrations. This separation enables the effective use of failure data without corrupting policy behavior. We implement this design within an offline reinforcement learning (RL) setting and evaluate it in both simulation and real-world environments. The results show that our framework consistently reduces collision rates while preserving the task success rate, and demonstrate strong generalization across different environments and robot platforms.
title Learning from Demonstration with Failure Awareness for Safe Robot Navigation
topic Robotics
url https://arxiv.org/abs/2604.23360