AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Yuanfei, Zhang, Xiaojie, Wu, Ruihai, Li, Yu, Shen, Yan, Wu, Mingdong, He, Zhaofeng, Wang, Yizhou, Dong, Hao
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916617545318400
author Wang, Yuanfei
Zhang, Xiaojie
Wu, Ruihai
Li, Yu
Shen, Yan
Wu, Mingdong
He, Zhaofeng
Wang, Yizhou
Dong, Hao
author_facet Wang, Yuanfei
Zhang, Xiaojie
Wu, Ruihai
Li, Yu
Shen, Yan
Wu, Mingdong
He, Zhaofeng
Wang, Yizhou
Dong, Hao
contents Articulated object manipulation is a critical capability for robots to perform various tasks in real-world scenarios. Composed of multiple parts connected by joints, articulated objects are endowed with diverse functional mechanisms through complex relative motions. For example, a safe consists of a door, a handle, and a lock, where the door can only be opened when the latch is unlocked. The internal structure, such as the state of a lock or joint angle constraints, cannot be directly observed from visual observation. Consequently, successful manipulation of these objects requires adaptive adjustment based on trial and error rather than a one-time visual inference. However, previous datasets and simulation environments for articulated objects have primarily focused on simple manipulation mechanisms where the complete manipulation process can be inferred from the object's appearance. To enhance the diversity and complexity of adaptive manipulation mechanisms, we build a novel articulated object manipulation environment and equip it with 9 categories of objects. Based on the environment and objects, we further propose an adaptive demonstration collection and 3D visual diffusion-based imitation learning pipeline that learns the adaptive manipulation policy. The effectiveness of our designs and proposed method is validated through both simulation and real-world experiments. Our project page is available at: https://adamanip.github.io
format Preprint
id arxiv_https___arxiv_org_abs_2502_11124
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learning
Wang, Yuanfei
Zhang, Xiaojie
Wu, Ruihai
Li, Yu
Shen, Yan
Wu, Mingdong
He, Zhaofeng
Wang, Yizhou
Dong, Hao
Robotics
Artificial Intelligence
Articulated object manipulation is a critical capability for robots to perform various tasks in real-world scenarios. Composed of multiple parts connected by joints, articulated objects are endowed with diverse functional mechanisms through complex relative motions. For example, a safe consists of a door, a handle, and a lock, where the door can only be opened when the latch is unlocked. The internal structure, such as the state of a lock or joint angle constraints, cannot be directly observed from visual observation. Consequently, successful manipulation of these objects requires adaptive adjustment based on trial and error rather than a one-time visual inference. However, previous datasets and simulation environments for articulated objects have primarily focused on simple manipulation mechanisms where the complete manipulation process can be inferred from the object's appearance. To enhance the diversity and complexity of adaptive manipulation mechanisms, we build a novel articulated object manipulation environment and equip it with 9 categories of objects. Based on the environment and objects, we further propose an adaptive demonstration collection and 3D visual diffusion-based imitation learning pipeline that learns the adaptive manipulation policy. The effectiveness of our designs and proposed method is validated through both simulation and real-world experiments. Our project page is available at: https://adamanip.github.io
title AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learning
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2502.11124