RoleMotion: A Large-Scale Dataset towards Robust Scene-Specific Role-Playing Motion Synthesis with Fine-grained Descriptions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Peng, Junran, Huang, Yiheng, Shen, Silei, Wei, Zeji, Yang, Jingwei, Wang, Baojie, He, Yonghao, Luo, Chuanchen, Zhang, Man, Yin, Xucheng, Sui, Wei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914176077660160
author Peng, Junran
Huang, Yiheng
Shen, Silei
Wei, Zeji
Yang, Jingwei
Wang, Baojie
He, Yonghao
Luo, Chuanchen
Zhang, Man
Yin, Xucheng
Sui, Wei
author_facet Peng, Junran
Huang, Yiheng
Shen, Silei
Wei, Zeji
Yang, Jingwei
Wang, Baojie
He, Yonghao
Luo, Chuanchen
Zhang, Man
Yin, Xucheng
Sui, Wei
contents In this paper, we introduce RoleMotion, a large-scale human motion dataset that encompasses a wealth of role-playing and functional motion data tailored to fit various specific scenes. Existing text datasets are mainly constructed decentrally as amalgamation of assorted subsets that their data are nonfunctional and isolated to work together to cover social activities in various scenes. Also, the quality of motion data is inconsistent, and textual annotation lacks fine-grained details in these datasets. In contrast, RoleMotion is meticulously designed and collected with a particular focus on scenes and roles. The dataset features 25 classic scenes, 110 functional roles, over 500 behaviors, and 10296 high-quality human motion sequences of body and hands, annotated with 27831 fine-grained text descriptions. We build an evaluator stronger than existing counterparts, prove its reliability, and evaluate various text-to-motion methods on our dataset. Finally, we explore the interplay of motion generation of body and hands. Experimental results demonstrate the high-quality and functionality of our dataset on text-driven whole-body generation.
format Preprint
id arxiv_https___arxiv_org_abs_2512_01582
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RoleMotion: A Large-Scale Dataset towards Robust Scene-Specific Role-Playing Motion Synthesis with Fine-grained Descriptions
Peng, Junran
Huang, Yiheng
Shen, Silei
Wei, Zeji
Yang, Jingwei
Wang, Baojie
He, Yonghao
Luo, Chuanchen
Zhang, Man
Yin, Xucheng
Sui, Wei
Computer Vision and Pattern Recognition
Artificial Intelligence
In this paper, we introduce RoleMotion, a large-scale human motion dataset that encompasses a wealth of role-playing and functional motion data tailored to fit various specific scenes. Existing text datasets are mainly constructed decentrally as amalgamation of assorted subsets that their data are nonfunctional and isolated to work together to cover social activities in various scenes. Also, the quality of motion data is inconsistent, and textual annotation lacks fine-grained details in these datasets. In contrast, RoleMotion is meticulously designed and collected with a particular focus on scenes and roles. The dataset features 25 classic scenes, 110 functional roles, over 500 behaviors, and 10296 high-quality human motion sequences of body and hands, annotated with 27831 fine-grained text descriptions. We build an evaluator stronger than existing counterparts, prove its reliability, and evaluate various text-to-motion methods on our dataset. Finally, we explore the interplay of motion generation of body and hands. Experimental results demonstrate the high-quality and functionality of our dataset on text-driven whole-body generation.
title RoleMotion: A Large-Scale Dataset towards Robust Scene-Specific Role-Playing Motion Synthesis with Fine-grained Descriptions
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2512.01582