Data efficient Robotic Object Throwing with Model-Based Reinforcement Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Turcato, Niccolò, Giacomuzzo, Giulio, Terreran, Matteo, Allegro, Davide, Carli, Ruggero, Libera, Alberto Dalla
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910819919331328
author Turcato, Niccolò
Giacomuzzo, Giulio
Terreran, Matteo
Allegro, Davide
Carli, Ruggero
Libera, Alberto Dalla
author_facet Turcato, Niccolò
Giacomuzzo, Giulio
Terreran, Matteo
Allegro, Davide
Carli, Ruggero
Libera, Alberto Dalla
contents Pick-and-place (PnP) operations, featuring object grasping and trajectory planning, are fundamental in industrial robotics applications. Despite many advancements in the field, PnP is limited by workspace constraints, reducing flexibility. Pick-and-throw (PnT) is a promising alternative where the robot throws objects to target locations, leveraging extrinsic resources like gravity to improve efficiency and expand the workspace. However, PnT execution is complex, requiring precise coordination of high-speed movements and object dynamics. Solutions to the PnT problem are categorized into analytical and learning-based approaches. Analytical methods focus on system modeling and trajectory generation but are time-consuming and offer limited generalization. Learning-based solutions, in particular Model-Free Reinforcement Learning (MFRL), offer automation and adaptability but require extensive interaction time. This paper introduces a Model-Based Reinforcement Learning (MBRL) framework, MC-PILOT, which combines data-driven modeling with policy optimization for efficient and accurate PnT tasks. MC-PILOT accounts for model uncertainties and release errors, demonstrating superior performance in simulations and real-world tests with a Franka Emika Panda manipulator. The proposed approach generalizes rapidly to new targets, offering advantages over analytical and Model-Free methods.
format Preprint
id arxiv_https___arxiv_org_abs_2502_05595
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Data efficient Robotic Object Throwing with Model-Based Reinforcement Learning
Turcato, Niccolò
Giacomuzzo, Giulio
Terreran, Matteo
Allegro, Davide
Carli, Ruggero
Libera, Alberto Dalla
Robotics
Pick-and-place (PnP) operations, featuring object grasping and trajectory planning, are fundamental in industrial robotics applications. Despite many advancements in the field, PnP is limited by workspace constraints, reducing flexibility. Pick-and-throw (PnT) is a promising alternative where the robot throws objects to target locations, leveraging extrinsic resources like gravity to improve efficiency and expand the workspace. However, PnT execution is complex, requiring precise coordination of high-speed movements and object dynamics. Solutions to the PnT problem are categorized into analytical and learning-based approaches. Analytical methods focus on system modeling and trajectory generation but are time-consuming and offer limited generalization. Learning-based solutions, in particular Model-Free Reinforcement Learning (MFRL), offer automation and adaptability but require extensive interaction time. This paper introduces a Model-Based Reinforcement Learning (MBRL) framework, MC-PILOT, which combines data-driven modeling with policy optimization for efficient and accurate PnT tasks. MC-PILOT accounts for model uncertainties and release errors, demonstrating superior performance in simulations and real-world tests with a Franka Emika Panda manipulator. The proposed approach generalizes rapidly to new targets, offering advantages over analytical and Model-Free methods.
title Data efficient Robotic Object Throwing with Model-Based Reinforcement Learning
topic Robotics
url https://arxiv.org/abs/2502.05595