Topology-Aware Latent Diffusion for 3D Shape Generation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917579303419904 |
|---|---|
| author | Hu, Jiangbei Fei, Ben Xu, Baixin Hou, Fei Yang, Weidong Wang, Shengfa Lei, Na Qian, Chen He, Ying |
| author_facet | Hu, Jiangbei Fei, Ben Xu, Baixin Hou, Fei Yang, Weidong Wang, Shengfa Lei, Na Qian, Chen He, Ying |
| contents | We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as implicit fields, then employing persistent homology to extract topological features, including Betti numbers and persistence diagrams. The shape generation process consists of two steps. Initially, we employ a transformer-based autoencoding module to embed the implicit representation of each 3D shape into a set of latent vectors. Subsequently, we navigate through the learned latent space via a diffusion model. By strategically incorporating topological features into the diffusion process, our generative module is able to produce a richer variety of 3D shapes with different topological structures. Furthermore, our framework is flexible, supporting generation tasks constrained by a variety of inputs, including sparse and partial point clouds, as well as sketches. By modifying the persistence diagrams, we can alter the topology of the shapes generated from these input modalities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_17603 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Topology-Aware Latent Diffusion for 3D Shape Generation Hu, Jiangbei Fei, Ben Xu, Baixin Hou, Fei Yang, Weidong Wang, Shengfa Lei, Na Qian, Chen He, Ying Computer Vision and Pattern Recognition I.3.5; I.2.10 We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as implicit fields, then employing persistent homology to extract topological features, including Betti numbers and persistence diagrams. The shape generation process consists of two steps. Initially, we employ a transformer-based autoencoding module to embed the implicit representation of each 3D shape into a set of latent vectors. Subsequently, we navigate through the learned latent space via a diffusion model. By strategically incorporating topological features into the diffusion process, our generative module is able to produce a richer variety of 3D shapes with different topological structures. Furthermore, our framework is flexible, supporting generation tasks constrained by a variety of inputs, including sparse and partial point clouds, as well as sketches. By modifying the persistence diagrams, we can alter the topology of the shapes generated from these input modalities. |
| title | Topology-Aware Latent Diffusion for 3D Shape Generation |
| topic | Computer Vision and Pattern Recognition I.3.5; I.2.10 |
| url | https://arxiv.org/abs/2401.17603 |