Guided Decoding for Robot On-line Motion Generation and Adaption

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Nutan, Cseke, Botond, Aljalbout, Elie, Paraschos, Alexandros, Alles, Marvin, van der Smagt, Patrick
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909345152761856
author Chen, Nutan
Cseke, Botond
Aljalbout, Elie
Paraschos, Alexandros
Alles, Marvin
van der Smagt, Patrick
author_facet Chen, Nutan
Cseke, Botond
Aljalbout, Elie
Paraschos, Alexandros
Alles, Marvin
van der Smagt, Patrick
contents We present a novel motion generation approach for robot arms, with high degrees of freedom, in complex settings that can adapt online to obstacles or new via points. Learning from Demonstration facilitates rapid adaptation to new tasks and optimizes the utilization of accumulated expertise by allowing robots to learn and generalize from demonstrated trajectories. We train a transformer architecture, based on conditional variational autoencoder, on a large dataset of simulated trajectories used as demonstrations. Our architecture learns essential motion generation skills from these demonstrations and is able to adapt them to meet auxiliary tasks. Additionally, our approach implements auto-regressive motion generation to enable real-time adaptations, as, for example, introducing or changing via-points, and velocity and acceleration constraints. Using beam search, we present a method for further adaption of our motion generator to avoid obstacles. We show that our model successfully generates motion from different initial and target points and that is capable of generating trajectories that navigate complex tasks across different robotic platforms.
format Preprint
id arxiv_https___arxiv_org_abs_2403_15239
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Guided Decoding for Robot On-line Motion Generation and Adaption
Chen, Nutan
Cseke, Botond
Aljalbout, Elie
Paraschos, Alexandros
Alles, Marvin
van der Smagt, Patrick
Robotics
Machine Learning
We present a novel motion generation approach for robot arms, with high degrees of freedom, in complex settings that can adapt online to obstacles or new via points. Learning from Demonstration facilitates rapid adaptation to new tasks and optimizes the utilization of accumulated expertise by allowing robots to learn and generalize from demonstrated trajectories. We train a transformer architecture, based on conditional variational autoencoder, on a large dataset of simulated trajectories used as demonstrations. Our architecture learns essential motion generation skills from these demonstrations and is able to adapt them to meet auxiliary tasks. Additionally, our approach implements auto-regressive motion generation to enable real-time adaptations, as, for example, introducing or changing via-points, and velocity and acceleration constraints. Using beam search, we present a method for further adaption of our motion generator to avoid obstacles. We show that our model successfully generates motion from different initial and target points and that is capable of generating trajectories that navigate complex tasks across different robotic platforms.
title Guided Decoding for Robot On-line Motion Generation and Adaption
topic Robotics
Machine Learning
url https://arxiv.org/abs/2403.15239