DynaMimicGen: A Data Generation Framework for Robot Learning of Dynamic Tasks

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Pomponi, Vincenzo, Franceschi, Paolo, Baraldo, Stefano, Roveda, Loris, Avram, Oliver, Gambardella, Luca Maria, Valente, Anna
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912720772661248
author Pomponi, Vincenzo
Franceschi, Paolo
Baraldo, Stefano
Roveda, Loris
Avram, Oliver
Gambardella, Luca Maria
Valente, Anna
author_facet Pomponi, Vincenzo
Franceschi, Paolo
Baraldo, Stefano
Roveda, Loris
Avram, Oliver
Gambardella, Luca Maria
Valente, Anna
contents Learning robust manipulation policies typically requires large and diverse datasets, the collection of which is time-consuming, labor-intensive, and often impractical for dynamic environments. In this work, we introduce DynaMimicGen (D-MG), a scalable dataset generation framework that enables policy training from minimal human supervision while uniquely supporting dynamic task settings. Given only a few human demonstrations, D-MG first segments the demonstrations into meaningful sub-tasks, then leverages Dynamic Movement Primitives (DMPs) to adapt and generalize the demonstrated behaviors to novel and dynamically changing environments. Improving prior methods that rely on static assumptions or simplistic trajectory interpolation, D-MG produces smooth, realistic, and task-consistent Cartesian trajectories that adapt in real time to changes in object poses, robot states, or scene geometry during task execution. Our method supports different scenarios - including scene layouts, object instances, and robot configurations - making it suitable for both static and highly dynamic manipulation tasks. We show that robot agents trained via imitation learning on D-MG-generated data achieve strong performance across long-horizon and contact-rich benchmarks, including tasks like cube stacking and placing mugs in drawers, even under unpredictable environment changes. By eliminating the need for extensive human demonstrations and enabling generalization in dynamic settings, D-MG offers a powerful and efficient alternative to manual data collection, paving the way toward scalable, autonomous robot learning.
format Preprint
id arxiv_https___arxiv_org_abs_2511_16223
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DynaMimicGen: A Data Generation Framework for Robot Learning of Dynamic Tasks
Pomponi, Vincenzo
Franceschi, Paolo
Baraldo, Stefano
Roveda, Loris
Avram, Oliver
Gambardella, Luca Maria
Valente, Anna
Robotics
Learning robust manipulation policies typically requires large and diverse datasets, the collection of which is time-consuming, labor-intensive, and often impractical for dynamic environments. In this work, we introduce DynaMimicGen (D-MG), a scalable dataset generation framework that enables policy training from minimal human supervision while uniquely supporting dynamic task settings. Given only a few human demonstrations, D-MG first segments the demonstrations into meaningful sub-tasks, then leverages Dynamic Movement Primitives (DMPs) to adapt and generalize the demonstrated behaviors to novel and dynamically changing environments. Improving prior methods that rely on static assumptions or simplistic trajectory interpolation, D-MG produces smooth, realistic, and task-consistent Cartesian trajectories that adapt in real time to changes in object poses, robot states, or scene geometry during task execution. Our method supports different scenarios - including scene layouts, object instances, and robot configurations - making it suitable for both static and highly dynamic manipulation tasks. We show that robot agents trained via imitation learning on D-MG-generated data achieve strong performance across long-horizon and contact-rich benchmarks, including tasks like cube stacking and placing mugs in drawers, even under unpredictable environment changes. By eliminating the need for extensive human demonstrations and enabling generalization in dynamic settings, D-MG offers a powerful and efficient alternative to manual data collection, paving the way toward scalable, autonomous robot learning.
title DynaMimicGen: A Data Generation Framework for Robot Learning of Dynamic Tasks
topic Robotics
url https://arxiv.org/abs/2511.16223