GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xu, Chao, Zhao, Xiaochen, Deng, Xiang, Sun, Jingxiang, Di, Donglin, Su, Zhuo, Liu, Yebin
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912962835382272
author Xu, Chao
Zhao, Xiaochen
Deng, Xiang
Sun, Jingxiang
Di, Donglin
Su, Zhuo
Liu, Yebin
author_facet Xu, Chao
Zhao, Xiaochen
Deng, Xiang
Sun, Jingxiang
Di, Donglin
Su, Zhuo
Liu, Yebin
contents Reconstructing photorealistic and animatable 4D head avatars from a single portrait image remains a fundamental challenge in computer vision. While diffusion models have enabled remarkable progress in image and video generation for avatar reconstruction, existing methods primarily rely on 2D priors and struggle to achieve consistent 3D geometry. We propose a novel framework that leverages geometry-aware diffusion to learn strong geometry priors for high-fidelity head avatar reconstruction. Our approach jointly synthesizes portrait images and corresponding surface normals, while a pose-free expression encoder captures implicit expression representations. Both synthesized images and expression latents are incorporated into 3D Gaussian-based avatars, enabling photorealistic rendering with accurate geometry. Extensive experiments demonstrate that our method substantially outperforms state-of-the-art approaches in visual quality, expression fidelity, and cross-identity generalization, while supporting real-time rendering.
format Preprint
id arxiv_https___arxiv_org_abs_2602_24161
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction
Xu, Chao
Zhao, Xiaochen
Deng, Xiang
Sun, Jingxiang
Di, Donglin
Su, Zhuo
Liu, Yebin
Computer Vision and Pattern Recognition
Reconstructing photorealistic and animatable 4D head avatars from a single portrait image remains a fundamental challenge in computer vision. While diffusion models have enabled remarkable progress in image and video generation for avatar reconstruction, existing methods primarily rely on 2D priors and struggle to achieve consistent 3D geometry. We propose a novel framework that leverages geometry-aware diffusion to learn strong geometry priors for high-fidelity head avatar reconstruction. Our approach jointly synthesizes portrait images and corresponding surface normals, while a pose-free expression encoder captures implicit expression representations. Both synthesized images and expression latents are incorporated into 3D Gaussian-based avatars, enabling photorealistic rendering with accurate geometry. Extensive experiments demonstrate that our method substantially outperforms state-of-the-art approaches in visual quality, expression fidelity, and cross-identity generalization, while supporting real-time rendering.
title GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.24161