iKap: Kinematics-aware Planning with Imperative Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Qihang, Chen, Zhuoqun, Zheng, Haoze, He, Haonan, Zhan, Zitong, Su, Shaoshu, Geng, Junyi, Wang, Chen
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912681835888640
author Li, Qihang
Chen, Zhuoqun
Zheng, Haoze
He, Haonan
Zhan, Zitong
Su, Shaoshu
Geng, Junyi
Wang, Chen
author_facet Li, Qihang
Chen, Zhuoqun
Zheng, Haoze
He, Haonan
Zhan, Zitong
Su, Shaoshu
Geng, Junyi
Wang, Chen
contents Trajectory planning in robotics aims to generate collision-free pose sequences that can be reliably executed. Recently, vision-to-planning systems have gained increasing attention for their efficiency and ability to interpret and adapt to surrounding environments. However, traditional modular systems suffer from increased latency and error propagation, while purely data-driven approaches often overlook the robot's kinematic constraints. This oversight leads to discrepancies between planned trajectories and those that are executable. To address these challenges, we propose iKap, a novel vision-to-planning system that integrates the robot's kinematic model directly into the learning pipeline. iKap employs a self-supervised learning approach and incorporates the state transition model within a differentiable bi-level optimization framework. This integration ensures the network learns collision-free waypoints while satisfying kinematic constraints, enabling gradient back-propagation for end-to-end training. Our experimental results demonstrate that iKap achieves higher success rates and reduced latency compared to the state-of-the-art methods. Besides the complete system, iKap offers a visual-to-planning network that seamlessly works with various controllers, providing a robust solution for robots navigating complex environments.
format Preprint
id arxiv_https___arxiv_org_abs_2412_09496
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle iKap: Kinematics-aware Planning with Imperative Learning
Li, Qihang
Chen, Zhuoqun
Zheng, Haoze
He, Haonan
Zhan, Zitong
Su, Shaoshu
Geng, Junyi
Wang, Chen
Robotics
Trajectory planning in robotics aims to generate collision-free pose sequences that can be reliably executed. Recently, vision-to-planning systems have gained increasing attention for their efficiency and ability to interpret and adapt to surrounding environments. However, traditional modular systems suffer from increased latency and error propagation, while purely data-driven approaches often overlook the robot's kinematic constraints. This oversight leads to discrepancies between planned trajectories and those that are executable. To address these challenges, we propose iKap, a novel vision-to-planning system that integrates the robot's kinematic model directly into the learning pipeline. iKap employs a self-supervised learning approach and incorporates the state transition model within a differentiable bi-level optimization framework. This integration ensures the network learns collision-free waypoints while satisfying kinematic constraints, enabling gradient back-propagation for end-to-end training. Our experimental results demonstrate that iKap achieves higher success rates and reduced latency compared to the state-of-the-art methods. Besides the complete system, iKap offers a visual-to-planning network that seamlessly works with various controllers, providing a robust solution for robots navigating complex environments.
title iKap: Kinematics-aware Planning with Imperative Learning
topic Robotics
url https://arxiv.org/abs/2412.09496