3D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Yating, Wang, Xuan, Yi, Ran, Fan, Yanbo, Hu, Jichen, Zhu, Jingcheng, Ma, Lizhuang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915251933413376
author Wang, Yating
Wang, Xuan
Yi, Ran
Fan, Yanbo
Hu, Jichen
Zhu, Jingcheng
Ma, Lizhuang
author_facet Wang, Yating
Wang, Xuan
Yi, Ran
Fan, Yanbo
Hu, Jichen
Zhu, Jingcheng
Ma, Lizhuang
contents Recent studies have combined 3D Gaussian and 3D Morphable Models (3DMM) to construct high-quality 3D head avatars. In this line of research, existing methods either fail to capture the dynamic textures or incur significant overhead in terms of runtime speed or storage space. To this end, we propose a novel method that addresses all the aforementioned demands. In specific, we introduce an expressive and compact representation that encodes texture-related attributes of the 3D Gaussians in the tensorial format. We store appearance of neutral expression in static tri-planes, and represents dynamic texture details for different expressions using lightweight 1D feature lines, which are then decoded into opacity offset relative to the neutral face. We further propose adaptive truncated opacity penalty and class-balanced sampling to improve generalization across different expressions. Experiments show this design enables accurate face dynamic details capturing while maintains real-time rendering and significantly reduces storage costs, thus broadening the applicability to more scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2504_14967
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle 3D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representations
Wang, Yating
Wang, Xuan
Yi, Ran
Fan, Yanbo
Hu, Jichen
Zhu, Jingcheng
Ma, Lizhuang
Computer Vision and Pattern Recognition
Recent studies have combined 3D Gaussian and 3D Morphable Models (3DMM) to construct high-quality 3D head avatars. In this line of research, existing methods either fail to capture the dynamic textures or incur significant overhead in terms of runtime speed or storage space. To this end, we propose a novel method that addresses all the aforementioned demands. In specific, we introduce an expressive and compact representation that encodes texture-related attributes of the 3D Gaussians in the tensorial format. We store appearance of neutral expression in static tri-planes, and represents dynamic texture details for different expressions using lightweight 1D feature lines, which are then decoded into opacity offset relative to the neutral face. We further propose adaptive truncated opacity penalty and class-balanced sampling to improve generalization across different expressions. Experiments show this design enables accurate face dynamic details capturing while maintains real-time rendering and significantly reduces storage costs, thus broadening the applicability to more scenarios.
title 3D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representations
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.14967