GaussianMotion: End-to-End Learning of Animatable Gaussian Avatars with Pose Guidance from Text

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shim, Gyumin, Lee, Sangmin, Choo, Jaegul
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915154484002816
author Shim, Gyumin
Lee, Sangmin
Choo, Jaegul
author_facet Shim, Gyumin
Lee, Sangmin
Choo, Jaegul
contents In this paper, we introduce GaussianMotion, a novel human rendering model that generates fully animatable scenes aligned with textual descriptions using Gaussian Splatting. Although existing methods achieve reasonable text-to-3D generation of human bodies using various 3D representations, they often face limitations in fidelity and efficiency, or primarily focus on static models with limited pose control. In contrast, our method generates fully animatable 3D avatars by combining deformable 3D Gaussian Splatting with text-to-3D score distillation, achieving high fidelity and efficient rendering for arbitrary poses. By densely generating diverse random poses during optimization, our deformable 3D human model learns to capture a wide range of natural motions distilled from a pose-conditioned diffusion model in an end-to-end manner. Furthermore, we propose Adaptive Score Distillation that effectively balances realistic detail and smoothness to achieve optimal 3D results. Experimental results demonstrate that our approach outperforms existing baselines by producing high-quality textures in both static and animated results, and by generating diverse 3D human models from various textual inputs.
format Preprint
id arxiv_https___arxiv_org_abs_2502_11642
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GaussianMotion: End-to-End Learning of Animatable Gaussian Avatars with Pose Guidance from Text
Shim, Gyumin
Lee, Sangmin
Choo, Jaegul
Computer Vision and Pattern Recognition
In this paper, we introduce GaussianMotion, a novel human rendering model that generates fully animatable scenes aligned with textual descriptions using Gaussian Splatting. Although existing methods achieve reasonable text-to-3D generation of human bodies using various 3D representations, they often face limitations in fidelity and efficiency, or primarily focus on static models with limited pose control. In contrast, our method generates fully animatable 3D avatars by combining deformable 3D Gaussian Splatting with text-to-3D score distillation, achieving high fidelity and efficient rendering for arbitrary poses. By densely generating diverse random poses during optimization, our deformable 3D human model learns to capture a wide range of natural motions distilled from a pose-conditioned diffusion model in an end-to-end manner. Furthermore, we propose Adaptive Score Distillation that effectively balances realistic detail and smoothness to achieve optimal 3D results. Experimental results demonstrate that our approach outperforms existing baselines by producing high-quality textures in both static and animated results, and by generating diverse 3D human models from various textual inputs.
title GaussianMotion: End-to-End Learning of Animatable Gaussian Avatars with Pose Guidance from Text
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.11642