Keypoint-based Diffusion for Robotic Motion Planning on the NICOL Robot

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Clasmeier, Lennart, Habekost, Jan-Gerrit, Gäde, Connor, Allgeuer, Philipp, Wermter, Stefan
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912589534986240
author Clasmeier, Lennart
Habekost, Jan-Gerrit
Gäde, Connor
Allgeuer, Philipp
Wermter, Stefan
author_facet Clasmeier, Lennart
Habekost, Jan-Gerrit
Gäde, Connor
Allgeuer, Philipp
Wermter, Stefan
contents We propose a novel diffusion-based action model for robotic motion planning. Commonly, established numerical planning approaches are used to solve general motion planning problems, but have significant runtime requirements. By leveraging the power of deep learning, we are able to achieve good results in a much smaller runtime by learning from a dataset generated by these planners. While our initial model uses point cloud embeddings in the input to predict keypoint-based joint sequences in its output, we observed in our ablation study that it remained challenging to condition the network on the point cloud embeddings. We identified some biases in our dataset and refined it, which improved the model's performance. Our model, even without the use of the point cloud encodings, outperforms numerical models by an order of magnitude regarding the runtime, while reaching a success rate of up to 90% of collision free solutions on the test set.
format Preprint
id arxiv_https___arxiv_org_abs_2509_04076
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Keypoint-based Diffusion for Robotic Motion Planning on the NICOL Robot
Clasmeier, Lennart
Habekost, Jan-Gerrit
Gäde, Connor
Allgeuer, Philipp
Wermter, Stefan
Robotics
Artificial Intelligence
We propose a novel diffusion-based action model for robotic motion planning. Commonly, established numerical planning approaches are used to solve general motion planning problems, but have significant runtime requirements. By leveraging the power of deep learning, we are able to achieve good results in a much smaller runtime by learning from a dataset generated by these planners. While our initial model uses point cloud embeddings in the input to predict keypoint-based joint sequences in its output, we observed in our ablation study that it remained challenging to condition the network on the point cloud embeddings. We identified some biases in our dataset and refined it, which improved the model's performance. Our model, even without the use of the point cloud encodings, outperforms numerical models by an order of magnitude regarding the runtime, while reaching a success rate of up to 90% of collision free solutions on the test set.
title Keypoint-based Diffusion for Robotic Motion Planning on the NICOL Robot
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2509.04076