URDF-Anything+: End-to-End Generation for Simulation-Ready Articulated Assets

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Zhuangzhe, Xin, Yue, Hou, Chengkai, Chen, Minghao, Lyu, Yaoxu, Zhang, Jieyu, Zhang, Shanghang
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917551895740416
author Wu, Zhuangzhe
Xin, Yue
Hou, Chengkai
Chen, Minghao
Lyu, Yaoxu
Zhang, Jieyu
Zhang, Shanghang
author_facet Wu, Zhuangzhe
Xin, Yue
Hou, Chengkai
Chen, Minghao
Lyu, Yaoxu
Zhang, Jieyu
Zhang, Shanghang
contents Articulated objects are fundamental for robotics, simulation of physics, and interactive virtual environments. However, recovering them from visual observations is inherently challenging, as images provide only partial and ambiguous cues about both part geometry and their underlying kinematic structure. Existing approaches typically rely on multi-stage pipelines, retrieval from asset libraries, or explicit part segmentation. We present URDF-Anything+, an end-to-end autoregressive diffusion framework that generates simulation-ready URDF models directly from a single RGB image. Conditioned on visual observations and object geometry, URDF-Anything+ operates in a structured latent space and jointly models part geometry and articulation in a unified generation process. Specifically, the model sequentially predicts each articulated part together with its associated joint parameters, while a termination token dynamically determines the number of parts. This design enables direct generation of fully executable URDFs without external retrieval or post-processing stages. Experiments on large-scale articulated object benchmarks demonstrate that URDF-Anything+ outperforms prior methods in geometric reconstruction quality, joint parameter estimation, and physical executability, while being substantially more efficient than existing multi-stage approaches. Furthermore, the generated URDFs serve as faithful digital twins, enabling the zero-shot transfer of manipulation policies trained purely in simulation.
format Preprint
id arxiv_https___arxiv_org_abs_2603_14010
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle URDF-Anything+: End-to-End Generation for Simulation-Ready Articulated Assets
Wu, Zhuangzhe
Xin, Yue
Hou, Chengkai
Chen, Minghao
Lyu, Yaoxu
Zhang, Jieyu
Zhang, Shanghang
Robotics
Articulated objects are fundamental for robotics, simulation of physics, and interactive virtual environments. However, recovering them from visual observations is inherently challenging, as images provide only partial and ambiguous cues about both part geometry and their underlying kinematic structure. Existing approaches typically rely on multi-stage pipelines, retrieval from asset libraries, or explicit part segmentation. We present URDF-Anything+, an end-to-end autoregressive diffusion framework that generates simulation-ready URDF models directly from a single RGB image. Conditioned on visual observations and object geometry, URDF-Anything+ operates in a structured latent space and jointly models part geometry and articulation in a unified generation process. Specifically, the model sequentially predicts each articulated part together with its associated joint parameters, while a termination token dynamically determines the number of parts. This design enables direct generation of fully executable URDFs without external retrieval or post-processing stages. Experiments on large-scale articulated object benchmarks demonstrate that URDF-Anything+ outperforms prior methods in geometric reconstruction quality, joint parameter estimation, and physical executability, while being substantially more efficient than existing multi-stage approaches. Furthermore, the generated URDFs serve as faithful digital twins, enabling the zero-shot transfer of manipulation policies trained purely in simulation.
title URDF-Anything+: End-to-End Generation for Simulation-Ready Articulated Assets
topic Robotics
url https://arxiv.org/abs/2603.14010