Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914375151910912 |
|---|---|
| author | Li, Mingzhe Liu, Mengyin Wu, Zekai Lin, Xincheng Zhang, Junsheng Yan, Ming Xie, Zengye Zhang, Changwang Wen, Chenglu Xu, Lan Shen, Siqi Wang, Cheng |
| author_facet | Li, Mingzhe Liu, Mengyin Wu, Zekai Lin, Xincheng Zhang, Junsheng Yan, Ming Xie, Zengye Zhang, Changwang Wen, Chenglu Xu, Lan Shen, Siqi Wang, Cheng |
| contents | Humanoid robots have achieved significant progress in motion generation and control, exhibiting movements that appear increasingly natural and human-like. Inspired by the Turing Test, we propose the Motion Turing Test, a framework that evaluates whether human observers can discriminate between humanoid robot and human poses using only kinematic information. To facilitate this evaluation, we present the Human-Humanoid Motion (HHMotion) dataset, which consists of 1,000 motion sequences spanning 15 action categories, performed by 11 humanoid models and 10 human subjects. All motion sequences are converted into SMPL-X representations to eliminate the influence of visual appearance. We recruited 30 annotators to rate the human-likeness of each pose on a 0-5 scale, resulting in over 500 hours of annotation. Analysis of the collected data reveals that humanoid motions still exhibit noticeable deviations from human movements, particularly in dynamic actions such as jumping, boxing, and running. Building on HHMotion, we formulate a human-likeness evaluation task that aims to automatically predict human-likeness scores from motion data. Despite recent progress in multimodal large language models, we find that they remain inadequate for assessing motion human-likeness. To address this, we propose a simple baseline model and demonstrate that it outperforms several contemporary LLM-based methods. The dataset, code, and benchmark will be publicly released to support future research in the community. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_06181 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots Li, Mingzhe Liu, Mengyin Wu, Zekai Lin, Xincheng Zhang, Junsheng Yan, Ming Xie, Zengye Zhang, Changwang Wen, Chenglu Xu, Lan Shen, Siqi Wang, Cheng Computer Vision and Pattern Recognition Humanoid robots have achieved significant progress in motion generation and control, exhibiting movements that appear increasingly natural and human-like. Inspired by the Turing Test, we propose the Motion Turing Test, a framework that evaluates whether human observers can discriminate between humanoid robot and human poses using only kinematic information. To facilitate this evaluation, we present the Human-Humanoid Motion (HHMotion) dataset, which consists of 1,000 motion sequences spanning 15 action categories, performed by 11 humanoid models and 10 human subjects. All motion sequences are converted into SMPL-X representations to eliminate the influence of visual appearance. We recruited 30 annotators to rate the human-likeness of each pose on a 0-5 scale, resulting in over 500 hours of annotation. Analysis of the collected data reveals that humanoid motions still exhibit noticeable deviations from human movements, particularly in dynamic actions such as jumping, boxing, and running. Building on HHMotion, we formulate a human-likeness evaluation task that aims to automatically predict human-likeness scores from motion data. Despite recent progress in multimodal large language models, we find that they remain inadequate for assessing motion human-likeness. To address this, we propose a simple baseline model and demonstrate that it outperforms several contemporary LLM-based methods. The dataset, code, and benchmark will be publicly released to support future research in the community. |
| title | Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2603.06181 |