FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Kirschstein, Tobias, Giebenhain, Simon, Nießner, Matthias
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908946896257024
author Kirschstein, Tobias
Giebenhain, Simon
Nießner, Matthias
author_facet Kirschstein, Tobias
Giebenhain, Simon
Nießner, Matthias
contents We introduce FlexAvatar, a method for creating high-quality and complete 3D head avatars from a single image. A core challenge lies in the limited availability of multi-view data and the tendency of monocular training to yield incomplete 3D head reconstructions. We identify the root cause of this issue as the entanglement between driving signal and target viewpoint when learning from monocular videos. To address this, we propose a transformer-based 3D portrait animation model with learnable data source tokens, so-called bias sinks, which enables unified training across monocular and multi-view datasets. This design leverages the strengths of both data sources during inference: strong generalization from monocular data and full 3D completeness from multi-view supervision. Furthermore, our training procedure yields a smooth latent avatar space that facilitates identity interpolation and flexible fitting to an arbitrary number of input observations. In extensive evaluations on single-view, few-shot, and monocular avatar creation tasks, we verify the efficacy of FlexAvatar. Many existing methods struggle with view extrapolation while FlexAvatar generates complete 3D head avatars with realistic facial animations. Website: https://tobias-kirschstein.github.io/flexavatar/
format Preprint
id arxiv_https___arxiv_org_abs_2512_15599
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision
Kirschstein, Tobias
Giebenhain, Simon
Nießner, Matthias
Computer Vision and Pattern Recognition
We introduce FlexAvatar, a method for creating high-quality and complete 3D head avatars from a single image. A core challenge lies in the limited availability of multi-view data and the tendency of monocular training to yield incomplete 3D head reconstructions. We identify the root cause of this issue as the entanglement between driving signal and target viewpoint when learning from monocular videos. To address this, we propose a transformer-based 3D portrait animation model with learnable data source tokens, so-called bias sinks, which enables unified training across monocular and multi-view datasets. This design leverages the strengths of both data sources during inference: strong generalization from monocular data and full 3D completeness from multi-view supervision. Furthermore, our training procedure yields a smooth latent avatar space that facilitates identity interpolation and flexible fitting to an arbitrary number of input observations. In extensive evaluations on single-view, few-shot, and monocular avatar creation tasks, we verify the efficacy of FlexAvatar. Many existing methods struggle with view extrapolation while FlexAvatar generates complete 3D head avatars with realistic facial animations. Website: https://tobias-kirschstein.github.io/flexavatar/
title FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.15599