Scalable Group Choreography via Variational Phase Manifold Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Le, Nhat, Do, Khoa, Bui, Xuan, Do, Tuong, Tjiputra, Erman, Tran, Quang D., Nguyen, Anh
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929443799302144
author Le, Nhat
Do, Khoa
Bui, Xuan
Do, Tuong
Tjiputra, Erman
Tran, Quang D.
Nguyen, Anh
author_facet Le, Nhat
Do, Khoa
Bui, Xuan
Do, Tuong
Tjiputra, Erman
Tran, Quang D.
Nguyen, Anh
contents Generating group dance motion from the music is a challenging task with several industrial applications. Although several methods have been proposed to tackle this problem, most of them prioritize optimizing the fidelity in dancing movement, constrained by predetermined dancer counts in datasets. This limitation impedes adaptability to real-world applications. Our study addresses the scalability problem in group choreography while preserving naturalness and synchronization. In particular, we propose a phase-based variational generative model for group dance generation on learning a generative manifold. Our method achieves high-fidelity group dance motion and enables the generation with an unlimited number of dancers while consuming only a minimal and constant amount of memory. The intensive experiments on two public datasets show that our proposed method outperforms recent state-of-the-art approaches by a large margin and is scalable to a great number of dancers beyond the training data.
format Preprint
id arxiv_https___arxiv_org_abs_2407_18839
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Scalable Group Choreography via Variational Phase Manifold Learning
Le, Nhat
Do, Khoa
Bui, Xuan
Do, Tuong
Tjiputra, Erman
Tran, Quang D.
Nguyen, Anh
Computer Vision and Pattern Recognition
Generating group dance motion from the music is a challenging task with several industrial applications. Although several methods have been proposed to tackle this problem, most of them prioritize optimizing the fidelity in dancing movement, constrained by predetermined dancer counts in datasets. This limitation impedes adaptability to real-world applications. Our study addresses the scalability problem in group choreography while preserving naturalness and synchronization. In particular, we propose a phase-based variational generative model for group dance generation on learning a generative manifold. Our method achieves high-fidelity group dance motion and enables the generation with an unlimited number of dancers while consuming only a minimal and constant amount of memory. The intensive experiments on two public datasets show that our proposed method outperforms recent state-of-the-art approaches by a large margin and is scalable to a great number of dancers beyond the training data.
title Scalable Group Choreography via Variational Phase Manifold Learning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.18839