Learning Equivariant Neural-Augmented Object Dynamics From Few Interactions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Orozco, Sergio, Kusnur, Tushar, May, Brandon, Konidaris, George, Herlant, Laura
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909012585349120
author Orozco, Sergio
Kusnur, Tushar
May, Brandon
Konidaris, George
Herlant, Laura
author_facet Orozco, Sergio
Kusnur, Tushar
May, Brandon
Konidaris, George
Herlant, Laura
contents Learning data-efficient object dynamics models for robotic manipulation remains challenging, especially for deformable objects. A popular approach is to model objects as sets of 3D particles and learn their motion using graph neural networks. In practice, this is not enough to maintain physical feasibility over long horizons and may require large amounts of interaction data to learn. We introduce PIEGraph, a novel approach to combining analytical physics and data-driven models to capture object dynamics for both rigid and deformable bodies using limited real-world interaction data. PIEGraph consists of two components: (1) a \textbf{P}hysically \textbf{I}nformed particle-based analytical model (implemented as a spring--mass system) to enforce physically feasible motion, and (2) an \textbf{E}quivariant \textbf{Graph} Neural Network with a novel action representation that exploits symmetries in particle interactions to guide the analytical model. We evaluate PIEGraph in simulation and on robot hardware for reorientation and repositioning tasks with ropes, cloth, stuffed animals and rigid objects. We show that our method enables accurate dynamics prediction and reliable downstream robotic manipulation planning, which outperforms state of the art baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2605_02699
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Learning Equivariant Neural-Augmented Object Dynamics From Few Interactions
Orozco, Sergio
Kusnur, Tushar
May, Brandon
Konidaris, George
Herlant, Laura
Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Learning data-efficient object dynamics models for robotic manipulation remains challenging, especially for deformable objects. A popular approach is to model objects as sets of 3D particles and learn their motion using graph neural networks. In practice, this is not enough to maintain physical feasibility over long horizons and may require large amounts of interaction data to learn. We introduce PIEGraph, a novel approach to combining analytical physics and data-driven models to capture object dynamics for both rigid and deformable bodies using limited real-world interaction data. PIEGraph consists of two components: (1) a \textbf{P}hysically \textbf{I}nformed particle-based analytical model (implemented as a spring--mass system) to enforce physically feasible motion, and (2) an \textbf{E}quivariant \textbf{Graph} Neural Network with a novel action representation that exploits symmetries in particle interactions to guide the analytical model. We evaluate PIEGraph in simulation and on robot hardware for reorientation and repositioning tasks with ropes, cloth, stuffed animals and rigid objects. We show that our method enables accurate dynamics prediction and reliable downstream robotic manipulation planning, which outperforms state of the art baselines.
title Learning Equivariant Neural-Augmented Object Dynamics From Few Interactions
topic Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2605.02699