Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911605212577792 |
|---|---|
| author | Huang, Yubo Guo, Hailong Wu, Fangtai Wang, Weiqiang Zhang, Shifeng Huang, Shijie Gan, Qijun Liu, Lin Zhao, Sirui Chen, Enhong Liu, Jiaming Hoi, Steven |
| author_facet | Huang, Yubo Guo, Hailong Wu, Fangtai Wang, Weiqiang Zhang, Shifeng Huang, Shijie Gan, Qijun Liu, Lin Zhao, Sirui Chen, Enhong Liu, Jiaming Hoi, Steven |
| contents | Audio-driven avatar interaction demands real-time, streaming, and infinite-length generation -- capabilities fundamentally at odds with the sequential denoising and long-horizon drift of current diffusion models. We present Live Avatar, an algorithm-system co-designed framework that addresses both challenges for a 14-billion-parameter diffusion model. On the algorithm side, a two-stage pipeline distills a pretrained bidirectional model into a causal, few-step streaming one, while a set of complementary long-horizon strategies eliminate identity drift and visual artifacts, enabling stable autoregressive generation exceeding 10000 seconds. On the system side, Timestep-forcing Pipeline Parallelism (TPP) assigns each GPU a fixed denoising timestep, converting the sequential diffusion chain into an asynchronous spatial pipeline that simultaneously boosts throughput and improves temporal consistency. Live Avatar achieves 45 FPS with a TTFF of 1.21\,s on 5 H800 GPUs, and to our knowledge is the first to enable practical real-time streaming of a 14B diffusion model for infinite-length avatar generation. We further introduce GenBench, a standardized long-form benchmark, to facilitate reproducible evaluation. Our project page is at https://liveavatar.github.io/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_04677 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length Huang, Yubo Guo, Hailong Wu, Fangtai Wang, Weiqiang Zhang, Shifeng Huang, Shijie Gan, Qijun Liu, Lin Zhao, Sirui Chen, Enhong Liu, Jiaming Hoi, Steven Computer Vision and Pattern Recognition Audio-driven avatar interaction demands real-time, streaming, and infinite-length generation -- capabilities fundamentally at odds with the sequential denoising and long-horizon drift of current diffusion models. We present Live Avatar, an algorithm-system co-designed framework that addresses both challenges for a 14-billion-parameter diffusion model. On the algorithm side, a two-stage pipeline distills a pretrained bidirectional model into a causal, few-step streaming one, while a set of complementary long-horizon strategies eliminate identity drift and visual artifacts, enabling stable autoregressive generation exceeding 10000 seconds. On the system side, Timestep-forcing Pipeline Parallelism (TPP) assigns each GPU a fixed denoising timestep, converting the sequential diffusion chain into an asynchronous spatial pipeline that simultaneously boosts throughput and improves temporal consistency. Live Avatar achieves 45 FPS with a TTFF of 1.21\,s on 5 H800 GPUs, and to our knowledge is the first to enable practical real-time streaming of a 14B diffusion model for infinite-length avatar generation. We further introduce GenBench, a standardized long-form benchmark, to facilitate reproducible evaluation. Our project page is at https://liveavatar.github.io/. |
| title | Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2512.04677 |