TexPro: Text-guided PBR Texturing with Procedural Material Modeling
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915290820902912 |
|---|---|
| author | Dang, Ziqiang Dong, Wenqi Yang, Zesong Yang, Bangbang Li, Liang Ma, Yuewen Cui, Zhaopeng |
| author_facet | Dang, Ziqiang Dong, Wenqi Yang, Zesong Yang, Bangbang Li, Liang Ma, Yuewen Cui, Zhaopeng |
| contents | In this paper, we present TexPro, a novel method for high-fidelity material generation for input 3D meshes given text prompts. Unlike existing text-conditioned texture generation methods that typically generate RGB textures with baked lighting, TexPro is able to produce diverse texture maps via procedural material modeling, which enables physically-based rendering, relighting, and additional benefits inherent to procedural materials. Specifically, we first generate multi-view reference images given the input textual prompt by employing the latest text-to-image model. We then derive texture maps through rendering-based optimization with recent differentiable procedural materials. To this end, we design several techniques to handle the misalignment between the generated multi-view images and 3D meshes, and introduce a novel material agent that enhances material classification and matching by exploring both part-level understanding and object-aware material reasoning. Experiments demonstrate the superiority of the proposed method over existing SOTAs, and its capability of relighting. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_15891 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | TexPro: Text-guided PBR Texturing with Procedural Material Modeling Dang, Ziqiang Dong, Wenqi Yang, Zesong Yang, Bangbang Li, Liang Ma, Yuewen Cui, Zhaopeng Graphics Computer Vision and Pattern Recognition In this paper, we present TexPro, a novel method for high-fidelity material generation for input 3D meshes given text prompts. Unlike existing text-conditioned texture generation methods that typically generate RGB textures with baked lighting, TexPro is able to produce diverse texture maps via procedural material modeling, which enables physically-based rendering, relighting, and additional benefits inherent to procedural materials. Specifically, we first generate multi-view reference images given the input textual prompt by employing the latest text-to-image model. We then derive texture maps through rendering-based optimization with recent differentiable procedural materials. To this end, we design several techniques to handle the misalignment between the generated multi-view images and 3D meshes, and introduce a novel material agent that enhances material classification and matching by exploring both part-level understanding and object-aware material reasoning. Experiments demonstrate the superiority of the proposed method over existing SOTAs, and its capability of relighting. |
| title | TexPro: Text-guided PBR Texturing with Procedural Material Modeling |
| topic | Graphics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.15891 |