S2O: Static to Openable Enhancement for Articulated 3D Objects

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Iliash, Denys, Jiang, Hanxiao, Zhang, Yiming, Savva, Manolis, Chang, Angel X.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917957490180096
author Iliash, Denys
Jiang, Hanxiao
Zhang, Yiming
Savva, Manolis
Chang, Angel X.
author_facet Iliash, Denys
Jiang, Hanxiao
Zhang, Yiming
Savva, Manolis
Chang, Angel X.
contents Despite much progress in large 3D datasets there are currently few interactive 3D object datasets, and their scale is limited due to the manual effort required in their construction. We introduce the static to openable (S2O) task which creates interactive articulated 3D objects from static counterparts through openable part detection, motion prediction, and interior geometry completion. We formulate a unified framework to tackle this task, and curate a challenging dataset of openable 3D objects that serves as a test bed for systematic evaluation. Our experiments benchmark methods from prior work, extended and improved methods, and simple yet effective heuristics for the S2O task. We find that turning static 3D objects into interactively openable counterparts is possible but that all methods struggle to generalize to realistic settings of the task, and we highlight promising future work directions. Our work enables efficient creation of interactive 3D objects for robotic manipulation and embodied AI tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2409_18896
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle S2O: Static to Openable Enhancement for Articulated 3D Objects
Iliash, Denys
Jiang, Hanxiao
Zhang, Yiming
Savva, Manolis
Chang, Angel X.
Computer Vision and Pattern Recognition
Despite much progress in large 3D datasets there are currently few interactive 3D object datasets, and their scale is limited due to the manual effort required in their construction. We introduce the static to openable (S2O) task which creates interactive articulated 3D objects from static counterparts through openable part detection, motion prediction, and interior geometry completion. We formulate a unified framework to tackle this task, and curate a challenging dataset of openable 3D objects that serves as a test bed for systematic evaluation. Our experiments benchmark methods from prior work, extended and improved methods, and simple yet effective heuristics for the S2O task. We find that turning static 3D objects into interactively openable counterparts is possible but that all methods struggle to generalize to realistic settings of the task, and we highlight promising future work directions. Our work enables efficient creation of interactive 3D objects for robotic manipulation and embodied AI tasks.
title S2O: Static to Openable Enhancement for Articulated 3D Objects
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.18896