Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mohamed, Mirgahney, Cunningham, Harry Jake, Deisenroth, Marc P., Agapito, Lourdes
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2406.07169
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914378834509824
author Mohamed, Mirgahney
Cunningham, Harry Jake
Deisenroth, Marc P.
Agapito, Lourdes
author_facet Mohamed, Mirgahney
Cunningham, Harry Jake
Deisenroth, Marc P.
Agapito, Lourdes
contents Human motion generation is a challenging task due to its high dimensionality and the difficulty of generating fine-grained motions. Diffusion methods have been proposed due to their high sample quality and expressiveness. Early approaches treat the entire sequence as a whole, which is computationally expensive and restricts sequence length. In contrast, autoregressive diffusion models generate longer sequences. However, their reliance on fully denoising previous frames complicates training and inference. Consequently, we propose \textit{RDM}, a new recurrent diffusion formulation similar to Recurrent Neural Networks (RNNs).RDMs explicitly condition diffusion processes on preceding noisy frames, avoiding the cost of full denoising. Nonetheless, maintaining its probabilistic nature is non-trivial. Therefore, we employ Normalizing Flows to model recurrent connections. Our evaluations demonstrate RDM's effectiveness: it achieves comparable performance to autoregressive baselines and generates long sequences that remain aligned with the text. RDM also skips diffusion steps during inference, significantly reducing computational cost.
format Preprint
id arxiv_https___arxiv_org_abs_2406_07169
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle RDM: Recurrent Diffusion Model for Human Motion Generation
Mohamed, Mirgahney
Cunningham, Harry Jake
Deisenroth, Marc P.
Agapito, Lourdes
Computer Vision and Pattern Recognition
Human motion generation is a challenging task due to its high dimensionality and the difficulty of generating fine-grained motions. Diffusion methods have been proposed due to their high sample quality and expressiveness. Early approaches treat the entire sequence as a whole, which is computationally expensive and restricts sequence length. In contrast, autoregressive diffusion models generate longer sequences. However, their reliance on fully denoising previous frames complicates training and inference. Consequently, we propose \textit{RDM}, a new recurrent diffusion formulation similar to Recurrent Neural Networks (RNNs).RDMs explicitly condition diffusion processes on preceding noisy frames, avoiding the cost of full denoising. Nonetheless, maintaining its probabilistic nature is non-trivial. Therefore, we employ Normalizing Flows to model recurrent connections. Our evaluations demonstrate RDM's effectiveness: it achieves comparable performance to autoregressive baselines and generates long sequences that remain aligned with the text. RDM also skips diffusion steps during inference, significantly reducing computational cost.
title RDM: Recurrent Diffusion Model for Human Motion Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.07169