LAM: Large Avatar Model for One-shot Animatable Gaussian Head
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916673815052288 |
|---|---|
| author | He, Yisheng Gu, Xiaodong Ye, Xiaodan Xu, Chao Zhao, Zhengyi Dong, Yuan Yuan, Weihao Dong, Zilong Bo, Liefeng |
| author_facet | He, Yisheng Gu, Xiaodong Ye, Xiaodan Xu, Chao Zhao, Zhengyi Dong, Yuan Yuan, Weihao Dong, Zilong Bo, Liefeng |
| contents | We present LAM, an innovative Large Avatar Model for animatable Gaussian head reconstruction from a single image. Unlike previous methods that require extensive training on captured video sequences or rely on auxiliary neural networks for animation and rendering during inference, our approach generates Gaussian heads that are immediately animatable and renderable. Specifically, LAM creates an animatable Gaussian head in a single forward pass, enabling reenactment and rendering without additional networks or post-processing steps. This capability allows for seamless integration into existing rendering pipelines, ensuring real-time animation and rendering across a wide range of platforms, including mobile phones. The centerpiece of our framework is the canonical Gaussian attributes generator, which utilizes FLAME canonical points as queries. These points interact with multi-scale image features through a Transformer to accurately predict Gaussian attributes in the canonical space. The reconstructed canonical Gaussian avatar can then be animated utilizing standard linear blend skinning (LBS) with corrective blendshapes as the FLAME model did and rendered in real-time on various platforms. Our experimental results demonstrate that LAM outperforms state-of-the-art methods on existing benchmarks. Our code and video are available at https://aigc3d.github.io/projects/LAM/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_17796 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | LAM: Large Avatar Model for One-shot Animatable Gaussian Head He, Yisheng Gu, Xiaodong Ye, Xiaodan Xu, Chao Zhao, Zhengyi Dong, Yuan Yuan, Weihao Dong, Zilong Bo, Liefeng Computer Vision and Pattern Recognition We present LAM, an innovative Large Avatar Model for animatable Gaussian head reconstruction from a single image. Unlike previous methods that require extensive training on captured video sequences or rely on auxiliary neural networks for animation and rendering during inference, our approach generates Gaussian heads that are immediately animatable and renderable. Specifically, LAM creates an animatable Gaussian head in a single forward pass, enabling reenactment and rendering without additional networks or post-processing steps. This capability allows for seamless integration into existing rendering pipelines, ensuring real-time animation and rendering across a wide range of platforms, including mobile phones. The centerpiece of our framework is the canonical Gaussian attributes generator, which utilizes FLAME canonical points as queries. These points interact with multi-scale image features through a Transformer to accurately predict Gaussian attributes in the canonical space. The reconstructed canonical Gaussian avatar can then be animated utilizing standard linear blend skinning (LBS) with corrective blendshapes as the FLAME model did and rendered in real-time on various platforms. Our experimental results demonstrate that LAM outperforms state-of-the-art methods on existing benchmarks. Our code and video are available at https://aigc3d.github.io/projects/LAM/ |
| title | LAM: Large Avatar Model for One-shot Animatable Gaussian Head |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2502.17796 |