MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914874275135488 |
|---|---|
| author | Chatziagapi, Aggelina Chrysos, Grigorios G. Samaras, Dimitris |
| author_facet | Chatziagapi, Aggelina Chrysos, Grigorios G. Samaras, Dimitris |
| contents | We introduce MIGS (Multi-Identity Gaussian Splatting), a novel method that learns a single neural representation for multiple identities, using only monocular videos. Recent 3D Gaussian Splatting (3DGS) approaches for human avatars require per-identity optimization. However, learning a multi-identity representation presents advantages in robustly animating humans under arbitrary poses. We propose to construct a high-order tensor that combines all the learnable 3DGS parameters for all the training identities. By assuming a low-rank structure and factorizing the tensor, we model the complex rigid and non-rigid deformations of multiple subjects in a unified network, significantly reducing the total number of parameters. Our proposed approach leverages information from all the training identities and enables robust animation under challenging unseen poses, outperforming existing approaches. It can also be extended to learn unseen identities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_07284 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition Chatziagapi, Aggelina Chrysos, Grigorios G. Samaras, Dimitris Computer Vision and Pattern Recognition We introduce MIGS (Multi-Identity Gaussian Splatting), a novel method that learns a single neural representation for multiple identities, using only monocular videos. Recent 3D Gaussian Splatting (3DGS) approaches for human avatars require per-identity optimization. However, learning a multi-identity representation presents advantages in robustly animating humans under arbitrary poses. We propose to construct a high-order tensor that combines all the learnable 3DGS parameters for all the training identities. By assuming a low-rank structure and factorizing the tensor, we model the complex rigid and non-rigid deformations of multiple subjects in a unified network, significantly reducing the total number of parameters. Our proposed approach leverages information from all the training identities and enables robust animation under challenging unseen poses, outperforming existing approaches. It can also be extended to learn unseen identities. |
| title | MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.07284 |