ARMO: Autoregressive Rigging for Multi-Category Objects

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sun, Mingze, Mao, Shiwei, Chen, Keyi, Chen, Yurun, Lu, Shunlin, Wang, Jingbo, Dong, Junting, Huang, Ruqi
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913759960760320
author Sun, Mingze
Mao, Shiwei
Chen, Keyi
Chen, Yurun
Lu, Shunlin
Wang, Jingbo
Dong, Junting
Huang, Ruqi
author_facet Sun, Mingze
Mao, Shiwei
Chen, Keyi
Chen, Yurun
Lu, Shunlin
Wang, Jingbo
Dong, Junting
Huang, Ruqi
contents Recent advancements in large-scale generative models have significantly improved the quality and diversity of 3D shape generation. However, most existing methods focus primarily on generating static 3D models, overlooking the potentially dynamic nature of certain shapes, such as humanoids, animals, and insects. To address this gap, we focus on rigging, a fundamental task in animation that establishes skeletal structures and skinning for 3D models. In this paper, we introduce OmniRig, the first large-scale rigging dataset, comprising 79,499 meshes with detailed skeleton and skinning information. Unlike traditional benchmarks that rely on predefined standard poses (e.g., A-pose, T-pose), our dataset embraces diverse shape categories, styles, and poses. Leveraging this rich dataset, we propose ARMO, a novel rigging framework that utilizes an autoregressive model to predict both joint positions and connectivity relationships in a unified manner. By treating the skeletal structure as a complete graph and discretizing it into tokens, we encode the joints using an auto-encoder to obtain a latent embedding and an autoregressive model to predict the tokens. A mesh-conditioned latent diffusion model is used to predict the latent embedding for conditional skeleton generation. Our method addresses the limitations of regression-based approaches, which often suffer from error accumulation and suboptimal connectivity estimation. Through extensive experiments on the OmniRig dataset, our approach achieves state-of-the-art performance in skeleton prediction, demonstrating improved generalization across diverse object categories. The code and dataset will be made public for academic use upon acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2503_20663
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ARMO: Autoregressive Rigging for Multi-Category Objects
Sun, Mingze
Mao, Shiwei
Chen, Keyi
Chen, Yurun
Lu, Shunlin
Wang, Jingbo
Dong, Junting
Huang, Ruqi
Computer Vision and Pattern Recognition
Recent advancements in large-scale generative models have significantly improved the quality and diversity of 3D shape generation. However, most existing methods focus primarily on generating static 3D models, overlooking the potentially dynamic nature of certain shapes, such as humanoids, animals, and insects. To address this gap, we focus on rigging, a fundamental task in animation that establishes skeletal structures and skinning for 3D models. In this paper, we introduce OmniRig, the first large-scale rigging dataset, comprising 79,499 meshes with detailed skeleton and skinning information. Unlike traditional benchmarks that rely on predefined standard poses (e.g., A-pose, T-pose), our dataset embraces diverse shape categories, styles, and poses. Leveraging this rich dataset, we propose ARMO, a novel rigging framework that utilizes an autoregressive model to predict both joint positions and connectivity relationships in a unified manner. By treating the skeletal structure as a complete graph and discretizing it into tokens, we encode the joints using an auto-encoder to obtain a latent embedding and an autoregressive model to predict the tokens. A mesh-conditioned latent diffusion model is used to predict the latent embedding for conditional skeleton generation. Our method addresses the limitations of regression-based approaches, which often suffer from error accumulation and suboptimal connectivity estimation. Through extensive experiments on the OmniRig dataset, our approach achieves state-of-the-art performance in skeleton prediction, demonstrating improved generalization across diverse object categories. The code and dataset will be made public for academic use upon acceptance.
title ARMO: Autoregressive Rigging for Multi-Category Objects
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.20663