HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hu, Hezhen, Zhao, Wangbo, Guo, Lanqing, Jiang, Hanwen, Liu, Jonathan C., Fan, Zhiwen, Wang, Kai, Wang, Zhangyang, Pavlakos, Georgios
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918535369850880
author Hu, Hezhen
Zhao, Wangbo
Guo, Lanqing
Jiang, Hanwen
Liu, Jonathan C.
Fan, Zhiwen
Wang, Kai
Wang, Zhangyang
Pavlakos, Georgios
author_facet Hu, Hezhen
Zhao, Wangbo
Guo, Lanqing
Jiang, Hanwen
Liu, Jonathan C.
Fan, Zhiwen
Wang, Kai
Wang, Zhangyang
Pavlakos, Georgios
contents In this paper, we present HumanNOVA, a photorealistic, universal, and rapid model for generating 3D human avatars from a single RGB image. Achieving both photorealism and generalization is challenging due to the scarcity of diverse, high-quality 3D human data. To address this, we build a scalable data generation pipeline that follows two strategies. The first one is to leverage existing rigged assets and animate them with extensive poses from daily life. The second strategy is to utilize existing multi-camera captures of humans and employ fitting to generate more diverse views for training. These two strategies enable us to scale up to 100k assets, significantly enhancing both the quantity and the diversity of data for robust model training. In terms of the architecture, HumanNOVA adopts a feed-forward, token-conditioned avatar modeling framework that allows fast inference in less than one second and requires no test-time optimization. Given an input image and an estimated simplified human mesh (SMPL) without detailed geometry or appearance, the model first encodes both inputs into compact token representations. These tokens then act as conditioning signals and are fused through cross-attention to construct a triplane-based 3D avatar representation. Extensive experiments on multiple benchmarks demonstrate the superiority of our approach, both quantitatively and qualitatively, as well as its robustness under diverse input image conditions. Project page at https://HumanNOVA.github.io .
format Preprint
id arxiv_https___arxiv_org_abs_2606_02573
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image
Hu, Hezhen
Zhao, Wangbo
Guo, Lanqing
Jiang, Hanwen
Liu, Jonathan C.
Fan, Zhiwen
Wang, Kai
Wang, Zhangyang
Pavlakos, Georgios
Computer Vision and Pattern Recognition
In this paper, we present HumanNOVA, a photorealistic, universal, and rapid model for generating 3D human avatars from a single RGB image. Achieving both photorealism and generalization is challenging due to the scarcity of diverse, high-quality 3D human data. To address this, we build a scalable data generation pipeline that follows two strategies. The first one is to leverage existing rigged assets and animate them with extensive poses from daily life. The second strategy is to utilize existing multi-camera captures of humans and employ fitting to generate more diverse views for training. These two strategies enable us to scale up to 100k assets, significantly enhancing both the quantity and the diversity of data for robust model training. In terms of the architecture, HumanNOVA adopts a feed-forward, token-conditioned avatar modeling framework that allows fast inference in less than one second and requires no test-time optimization. Given an input image and an estimated simplified human mesh (SMPL) without detailed geometry or appearance, the model first encodes both inputs into compact token representations. These tokens then act as conditioning signals and are fused through cross-attention to construct a triplane-based 3D avatar representation. Extensive experiments on multiple benchmarks demonstrate the superiority of our approach, both quantitatively and qualitatively, as well as its robustness under diverse input image conditions. Project page at https://HumanNOVA.github.io .
title HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2606.02573