EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ling, Haotian, Chen, Zequn, Chen, Qiuying, Di, Donglin, Ma, Yongjia, Li, Hao, Wei, Chen, Tao, Zhulin, Yang, Xun
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908719992799232
author Ling, Haotian
Chen, Zequn
Chen, Qiuying
Di, Donglin
Ma, Yongjia
Li, Hao
Wei, Chen
Tao, Zhulin
Yang, Xun
author_facet Ling, Haotian
Chen, Zequn
Chen, Qiuying
Di, Donglin
Ma, Yongjia
Li, Hao
Wei, Chen
Tao, Zhulin
Yang, Xun
contents Consistent pose-driven character animation has achieved remarkable progress in single-character scenarios. However, extending these advances to multi-character settings is non-trivial, especially when position swap is involved. Beyond mere scaling, the core challenge lies in enforcing correct Identity Correspondence (IC) between characters in reference and generated frames. To address this, we introduce EverybodyDance, a systematic solution targeting IC correctness in multi-character animation. EverybodyDance is built around the Identity Matching Graph (IMG), which models characters in the generated and reference frames as two node sets in a weighted complete bipartite graph. Edge weights, computed via our proposed Mask-Query Attention (MQA), quantify the affinity between each pair of characters. Our key insight is to formalize IC correctness as a graph structural metric and to optimize it during training. We also propose a series of targeted strategies tailored for multi-character animation, including identity-embedded guidance, a multi-scale matching strategy, and pre-classified sampling, which work synergistically. Finally, to evaluate IC performance, we curate the Identity Correspondence Evaluation benchmark, dedicated to multi-character IC correctness. Extensive experiments demonstrate that EverybodyDance substantially outperforms state-of-the-art baselines in both IC and visual fidelity.
format Preprint
id arxiv_https___arxiv_org_abs_2512_16360
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animation
Ling, Haotian
Chen, Zequn
Chen, Qiuying
Di, Donglin
Ma, Yongjia
Li, Hao
Wei, Chen
Tao, Zhulin
Yang, Xun
Computer Vision and Pattern Recognition
Consistent pose-driven character animation has achieved remarkable progress in single-character scenarios. However, extending these advances to multi-character settings is non-trivial, especially when position swap is involved. Beyond mere scaling, the core challenge lies in enforcing correct Identity Correspondence (IC) between characters in reference and generated frames. To address this, we introduce EverybodyDance, a systematic solution targeting IC correctness in multi-character animation. EverybodyDance is built around the Identity Matching Graph (IMG), which models characters in the generated and reference frames as two node sets in a weighted complete bipartite graph. Edge weights, computed via our proposed Mask-Query Attention (MQA), quantify the affinity between each pair of characters. Our key insight is to formalize IC correctness as a graph structural metric and to optimize it during training. We also propose a series of targeted strategies tailored for multi-character animation, including identity-embedded guidance, a multi-scale matching strategy, and pre-classified sampling, which work synergistically. Finally, to evaluate IC performance, we curate the Identity Correspondence Evaluation benchmark, dedicated to multi-character IC correctness. Extensive experiments demonstrate that EverybodyDance substantially outperforms state-of-the-art baselines in both IC and visual fidelity.
title EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.16360