Deep Reactive Policy: Learning Reactive Manipulator Motion Planning for Dynamic Environments

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Jiahui, Liu, Jason Jingzhou, Li, Yulong, Khaky, Youssef, Shaw, Kenneth, Pathak, Deepak
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915484389081088
author Yang, Jiahui
Liu, Jason Jingzhou
Li, Yulong
Khaky, Youssef
Shaw, Kenneth
Pathak, Deepak
author_facet Yang, Jiahui
Liu, Jason Jingzhou
Li, Yulong
Khaky, Youssef
Shaw, Kenneth
Pathak, Deepak
contents Generating collision-free motion in dynamic, partially observable environments is a fundamental challenge for robotic manipulators. Classical motion planners can compute globally optimal trajectories but require full environment knowledge and are typically too slow for dynamic scenes. Neural motion policies offer a promising alternative by operating in closed-loop directly on raw sensory inputs but often struggle to generalize in complex or dynamic settings. We propose Deep Reactive Policy (DRP), a visuo-motor neural motion policy designed for reactive motion generation in diverse dynamic environments, operating directly on point cloud sensory input. At its core is IMPACT, a transformer-based neural motion policy pretrained on 10 million generated expert trajectories across diverse simulation scenarios. We further improve IMPACT's static obstacle avoidance through iterative student-teacher finetuning. We additionally enhance the policy's dynamic obstacle avoidance at inference time using DCP-RMP, a locally reactive goal-proposal module. We evaluate DRP on challenging tasks featuring cluttered scenes, dynamic moving obstacles, and goal obstructions. DRP achieves strong generalization, outperforming prior classical and neural methods in success rate across both simulated and real-world settings. Video results and code available at https://deep-reactive-policy.com
format Preprint
id arxiv_https___arxiv_org_abs_2509_06953
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Deep Reactive Policy: Learning Reactive Manipulator Motion Planning for Dynamic Environments
Yang, Jiahui
Liu, Jason Jingzhou
Li, Yulong
Khaky, Youssef
Shaw, Kenneth
Pathak, Deepak
Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Systems and Control
Generating collision-free motion in dynamic, partially observable environments is a fundamental challenge for robotic manipulators. Classical motion planners can compute globally optimal trajectories but require full environment knowledge and are typically too slow for dynamic scenes. Neural motion policies offer a promising alternative by operating in closed-loop directly on raw sensory inputs but often struggle to generalize in complex or dynamic settings. We propose Deep Reactive Policy (DRP), a visuo-motor neural motion policy designed for reactive motion generation in diverse dynamic environments, operating directly on point cloud sensory input. At its core is IMPACT, a transformer-based neural motion policy pretrained on 10 million generated expert trajectories across diverse simulation scenarios. We further improve IMPACT's static obstacle avoidance through iterative student-teacher finetuning. We additionally enhance the policy's dynamic obstacle avoidance at inference time using DCP-RMP, a locally reactive goal-proposal module. We evaluate DRP on challenging tasks featuring cluttered scenes, dynamic moving obstacles, and goal obstructions. DRP achieves strong generalization, outperforming prior classical and neural methods in success rate across both simulated and real-world settings. Video results and code available at https://deep-reactive-policy.com
title Deep Reactive Policy: Learning Reactive Manipulator Motion Planning for Dynamic Environments
topic Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Systems and Control
url https://arxiv.org/abs/2509.06953