Temporal Consistency-Aware Text-to-Motion Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Hongsong, Yan, Wenjing, Lai, Qiuxia, Geng, Xin
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912957209772032
author Wang, Hongsong
Yan, Wenjing
Lai, Qiuxia
Geng, Xin
author_facet Wang, Hongsong
Yan, Wenjing
Lai, Qiuxia
Geng, Xin
contents Text-to-Motion (T2M) generation aims to synthesize realistic human motion sequences from natural language descriptions. While two-stage frameworks leveraging discrete motion representations have advanced T2M research, they often neglect cross-sequence temporal consistency, i.e., the shared temporal structures present across different instances of the same action. This leads to semantic misalignments and physically implausible motions. To address this limitation, we propose TCA-T2M, a framework for temporal consistency-aware T2M generation. Our approach introduces a temporal consistency-aware spatial VQ-VAE (TCaS-VQ-VAE) for cross-sequence temporal alignment, coupled with a masked motion transformer for text-conditioned motion generation. Additionally, a kinematic constraint block mitigates discretization artifacts to ensure physical plausibility. Experiments on HumanML3D and KIT-ML benchmarks demonstrate that TCA-T2M achieves state-of-the-art performance, highlighting the importance of temporal consistency in robust and coherent T2M generation.
format Preprint
id arxiv_https___arxiv_org_abs_2602_18057
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Temporal Consistency-Aware Text-to-Motion Generation
Wang, Hongsong
Yan, Wenjing
Lai, Qiuxia
Geng, Xin
Computer Vision and Pattern Recognition
Text-to-Motion (T2M) generation aims to synthesize realistic human motion sequences from natural language descriptions. While two-stage frameworks leveraging discrete motion representations have advanced T2M research, they often neglect cross-sequence temporal consistency, i.e., the shared temporal structures present across different instances of the same action. This leads to semantic misalignments and physically implausible motions. To address this limitation, we propose TCA-T2M, a framework for temporal consistency-aware T2M generation. Our approach introduces a temporal consistency-aware spatial VQ-VAE (TCaS-VQ-VAE) for cross-sequence temporal alignment, coupled with a masked motion transformer for text-conditioned motion generation. Additionally, a kinematic constraint block mitigates discretization artifacts to ensure physical plausibility. Experiments on HumanML3D and KIT-ML benchmarks demonstrate that TCA-T2M achieves state-of-the-art performance, highlighting the importance of temporal consistency in robust and coherent T2M generation.
title Temporal Consistency-Aware Text-to-Motion Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.18057