A Unified Conditional Flow for Motion Generation, Editing, and Intra-Structural Retargeting

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Li, Junlin, Song, Xinhao, Wang, Siqi, Huang, Haibin, Zhao, Yili
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913033270329344
author Li, Junlin
Song, Xinhao
Wang, Siqi
Huang, Haibin
Zhao, Yili
author_facet Li, Junlin
Song, Xinhao
Wang, Siqi
Huang, Haibin
Zhao, Yili
contents Text-driven motion editing and intra-structural retargeting, where source and target share topology but may differ in bone lengths, are traditionally handled by fragmented pipelines with incompatible inputs and representations: editing relies on specialized generative steering, while retargeting is deferred to geometric post-processing. We present a unifying perspective where both tasks are cast as instances of conditional transport within a single generative framework. By leveraging recent advances in flow matching, we demonstrate that editing and retargeting are fundamentally the same generative task, distinguished only by which conditioning signal, semantic or structural, is modulated during inference. We implement this vision via a rectified-flow motion model jointly conditioned on text prompts and target skeletal structures. Our architecture extends a DiT-style transformer with per-joint tokenization and explicit joint self-attention to strictly enforce kinematic dependencies, while a multi-condition classifier-free guidance strategy balances text adherence with skeletal conformity. Experiments on SnapMoGen and a multi-character Mixamo subset show that a single trained model supports text-to-motion generation, zero-shot editing, and zero-shot intra-structural retargeting. This unified approach simplifies deployment and improves structural consistency compared to task-specific baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2604_13427
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Unified Conditional Flow for Motion Generation, Editing, and Intra-Structural Retargeting
Li, Junlin
Song, Xinhao
Wang, Siqi
Huang, Haibin
Zhao, Yili
Graphics
Artificial Intelligence
Computer Vision and Pattern Recognition
I.3.7; I.2.6
Text-driven motion editing and intra-structural retargeting, where source and target share topology but may differ in bone lengths, are traditionally handled by fragmented pipelines with incompatible inputs and representations: editing relies on specialized generative steering, while retargeting is deferred to geometric post-processing. We present a unifying perspective where both tasks are cast as instances of conditional transport within a single generative framework. By leveraging recent advances in flow matching, we demonstrate that editing and retargeting are fundamentally the same generative task, distinguished only by which conditioning signal, semantic or structural, is modulated during inference. We implement this vision via a rectified-flow motion model jointly conditioned on text prompts and target skeletal structures. Our architecture extends a DiT-style transformer with per-joint tokenization and explicit joint self-attention to strictly enforce kinematic dependencies, while a multi-condition classifier-free guidance strategy balances text adherence with skeletal conformity. Experiments on SnapMoGen and a multi-character Mixamo subset show that a single trained model supports text-to-motion generation, zero-shot editing, and zero-shot intra-structural retargeting. This unified approach simplifies deployment and improves structural consistency compared to task-specific baselines.
title A Unified Conditional Flow for Motion Generation, Editing, and Intra-Structural Retargeting
topic Graphics
Artificial Intelligence
Computer Vision and Pattern Recognition
I.3.7; I.2.6
url https://arxiv.org/abs/2604.13427