RigMo: Unifying Rig and Motion Learning for Generative Animation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Hao, Luo, Jiahao, Wan, Bohui, Zhao, Yizhou, Li, Zongrui, Vasilkovsky, Michael, Wang, Chaoyang, Wang, Jian, Ahuja, Narendra, Zhou, Bing
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917194312450048
author Zhang, Hao
Luo, Jiahao
Wan, Bohui
Zhao, Yizhou
Li, Zongrui
Vasilkovsky, Michael
Wang, Chaoyang
Wang, Jian
Ahuja, Narendra
Zhou, Bing
author_facet Zhang, Hao
Luo, Jiahao
Wan, Bohui
Zhao, Yizhou
Li, Zongrui
Vasilkovsky, Michael
Wang, Chaoyang
Wang, Jian
Ahuja, Narendra
Zhou, Bing
contents Despite significant progress in 4D generation, rig and motion, the core structural and dynamic components of animation are typically modeled as separate problems. Existing pipelines rely on ground-truth skeletons and skinning weights for motion generation and treat auto-rigging as an independent process, undermining scalability and interpretability. We present RigMo, a unified generative framework that jointly learns rig and motion directly from raw mesh sequences, without any human-provided rig annotations. RigMo encodes per-vertex deformations into two compact latent spaces: a rig latent that decodes into explicit Gaussian bones and skinning weights, and a motion latent that produces time-varying SE(3) transformations. Together, these outputs define an animatable mesh with explicit structure and coherent motion, enabling feed-forward rig and motion inference for deformable objects. Beyond unified rig-motion discovery, we introduce a Motion-DiT model operating in RigMo's latent space and demonstrate that these structure-aware latents can naturally support downstream motion generation tasks. Experiments on DeformingThings4D, Objaverse-XL, and TrueBones demonstrate that RigMo learns smooth, interpretable, and physically plausible rigs, while achieving superior reconstruction and category-level generalization compared to existing auto-rigging and deformation baselines. RigMo establishes a new paradigm for unified, structure-aware, and scalable dynamic 3D modeling.
format Preprint
id arxiv_https___arxiv_org_abs_2601_06378
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RigMo: Unifying Rig and Motion Learning for Generative Animation
Zhang, Hao
Luo, Jiahao
Wan, Bohui
Zhao, Yizhou
Li, Zongrui
Vasilkovsky, Michael
Wang, Chaoyang
Wang, Jian
Ahuja, Narendra
Zhou, Bing
Graphics
Despite significant progress in 4D generation, rig and motion, the core structural and dynamic components of animation are typically modeled as separate problems. Existing pipelines rely on ground-truth skeletons and skinning weights for motion generation and treat auto-rigging as an independent process, undermining scalability and interpretability. We present RigMo, a unified generative framework that jointly learns rig and motion directly from raw mesh sequences, without any human-provided rig annotations. RigMo encodes per-vertex deformations into two compact latent spaces: a rig latent that decodes into explicit Gaussian bones and skinning weights, and a motion latent that produces time-varying SE(3) transformations. Together, these outputs define an animatable mesh with explicit structure and coherent motion, enabling feed-forward rig and motion inference for deformable objects. Beyond unified rig-motion discovery, we introduce a Motion-DiT model operating in RigMo's latent space and demonstrate that these structure-aware latents can naturally support downstream motion generation tasks. Experiments on DeformingThings4D, Objaverse-XL, and TrueBones demonstrate that RigMo learns smooth, interpretable, and physically plausible rigs, while achieving superior reconstruction and category-level generalization compared to existing auto-rigging and deformation baselines. RigMo establishes a new paradigm for unified, structure-aware, and scalable dynamic 3D modeling.
title RigMo: Unifying Rig and Motion Learning for Generative Animation
topic Graphics
url https://arxiv.org/abs/2601.06378