FFAvatar: Few-Shot, Feed-Forward, and Generalizable Avatar Reconstruction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Nguyen, Thuan Hoang, Luo, Jiahao, Nie, Yinyu, Li, Hao, Qian, Gordon Guocheng, Wang, Jian
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913130621173760
author Nguyen, Thuan Hoang
Luo, Jiahao
Nie, Yinyu
Li, Hao
Qian, Gordon Guocheng
Wang, Jian
author_facet Nguyen, Thuan Hoang
Luo, Jiahao
Nie, Yinyu
Li, Hao
Qian, Gordon Guocheng
Wang, Jian
contents Avatar reconstruction has traditionally relied on per-subject optimization that requires hours of computation or on expensive preprocessing that limits scalability. We introduce FFAvatar, a generalizable feed-forward framework that reconstructs high-quality, animatable 3D Gaussian head avatars from few-shot unposed portrait images in seconds. FFAvatar fuses information from multiple source images into a unified canonical Gaussian representation through Multi-View Query-Former, which is animated via FLAME parameters predicted end-to-end directly from pixels, eliminating the overhead of offline FLAME extraction. We further propose a three-stage training curriculum that achieves both broad generalization and high-fidelity reconstruction: (i) scalable pretraining on extensive monocular video data with over 1M identities to learn strong generalizable priors; (ii) multi-view fine-tuning on a small but high-quality dataset of 360-degree captures to enhance geometric fidelity and extreme-view awareness; and (iii) optional personalization that adapts to specific identities for maximum fidelity within 500 optimization steps. Extensive experiments demonstrate that FFAvatar sets a new standard for identity preservation, geometric consistency, and animation fidelity. On the NeRSemble benchmark, it outperforms the state-of-the-art LAM by a substantial 5.5 PSNR gain. Furthermore, FFAvatar enables real-time deployment, reconstructing avatars in 2 seconds without personalization and 10 seconds with personalization, while supporting 49 FPS animation on a single NVIDIA A100 GPU.
format Preprint
id arxiv_https___arxiv_org_abs_2605_15320
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle FFAvatar: Few-Shot, Feed-Forward, and Generalizable Avatar Reconstruction
Nguyen, Thuan Hoang
Luo, Jiahao
Nie, Yinyu
Li, Hao
Qian, Gordon Guocheng
Wang, Jian
Graphics
Computer Vision and Pattern Recognition
Machine Learning
Avatar reconstruction has traditionally relied on per-subject optimization that requires hours of computation or on expensive preprocessing that limits scalability. We introduce FFAvatar, a generalizable feed-forward framework that reconstructs high-quality, animatable 3D Gaussian head avatars from few-shot unposed portrait images in seconds. FFAvatar fuses information from multiple source images into a unified canonical Gaussian representation through Multi-View Query-Former, which is animated via FLAME parameters predicted end-to-end directly from pixels, eliminating the overhead of offline FLAME extraction. We further propose a three-stage training curriculum that achieves both broad generalization and high-fidelity reconstruction: (i) scalable pretraining on extensive monocular video data with over 1M identities to learn strong generalizable priors; (ii) multi-view fine-tuning on a small but high-quality dataset of 360-degree captures to enhance geometric fidelity and extreme-view awareness; and (iii) optional personalization that adapts to specific identities for maximum fidelity within 500 optimization steps. Extensive experiments demonstrate that FFAvatar sets a new standard for identity preservation, geometric consistency, and animation fidelity. On the NeRSemble benchmark, it outperforms the state-of-the-art LAM by a substantial 5.5 PSNR gain. Furthermore, FFAvatar enables real-time deployment, reconstructing avatars in 2 seconds without personalization and 10 seconds with personalization, while supporting 49 FPS animation on a single NVIDIA A100 GPU.
title FFAvatar: Few-Shot, Feed-Forward, and Generalizable Avatar Reconstruction
topic Graphics
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2605.15320