InterDance:Reactive 3D Dance Generation with Realistic Duet Interactions
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916538534068224 |
|---|---|
| author | Li, Ronghui Zhang, Youliang Zhang, Yachao Zhang, Yuxiang Su, Mingyang Guo, Jie Liu, Ziwei Liu, Yebin Li, Xiu |
| author_facet | Li, Ronghui Zhang, Youliang Zhang, Yachao Zhang, Yuxiang Su, Mingyang Guo, Jie Liu, Ziwei Liu, Yebin Li, Xiu |
| contents | Humans perform a variety of interactive motions, among which duet dance is one of the most challenging interactions. However, in terms of human motion generative models, existing works are still unable to generate high-quality interactive motions, especially in the field of duet dance. On the one hand, it is due to the lack of large-scale high-quality datasets. On the other hand, it arises from the incomplete representation of interactive motion and the lack of fine-grained optimization of interactions. To address these challenges, we propose, InterDance, a large-scale duet dance dataset that significantly enhances motion quality, data scale, and the variety of dance genres. Built upon this dataset, we propose a new motion representation that can accurately and comprehensively describe interactive motion. We further introduce a diffusion-based framework with an interaction refinement guidance strategy to optimize the realism of interactions progressively. Extensive experiments demonstrate the effectiveness of our dataset and algorithm. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_16982 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | InterDance:Reactive 3D Dance Generation with Realistic Duet Interactions Li, Ronghui Zhang, Youliang Zhang, Yachao Zhang, Yuxiang Su, Mingyang Guo, Jie Liu, Ziwei Liu, Yebin Li, Xiu Computer Vision and Pattern Recognition Graphics Multimedia Sound Audio and Speech Processing Humans perform a variety of interactive motions, among which duet dance is one of the most challenging interactions. However, in terms of human motion generative models, existing works are still unable to generate high-quality interactive motions, especially in the field of duet dance. On the one hand, it is due to the lack of large-scale high-quality datasets. On the other hand, it arises from the incomplete representation of interactive motion and the lack of fine-grained optimization of interactions. To address these challenges, we propose, InterDance, a large-scale duet dance dataset that significantly enhances motion quality, data scale, and the variety of dance genres. Built upon this dataset, we propose a new motion representation that can accurately and comprehensively describe interactive motion. We further introduce a diffusion-based framework with an interaction refinement guidance strategy to optimize the realism of interactions progressively. Extensive experiments demonstrate the effectiveness of our dataset and algorithm. |
| title | InterDance:Reactive 3D Dance Generation with Realistic Duet Interactions |
| topic | Computer Vision and Pattern Recognition Graphics Multimedia Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2412.16982 |