Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2403.11878 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916164077092864 |
|---|---|
| author | Tang, Jiaxiang Lu, Ruijie Chen, Xiaokang Wen, Xiang Zeng, Gang Liu, Ziwei |
| author_facet | Tang, Jiaxiang Lu, Ruijie Chen, Xiaokang Wen, Xiang Zeng, Gang Liu, Ziwei |
| contents | Text-to-texture synthesis has become a new frontier in 3D content creation thanks to the recent advances in text-to-image models. Existing methods primarily adopt a combination of pretrained depth-aware diffusion and inpainting models, yet they exhibit shortcomings such as 3D inconsistency and limited controllability. To address these challenges, we introduce InteX, a novel framework for interactive text-to-texture synthesis. 1) InteX includes a user-friendly interface that facilitates interaction and control throughout the synthesis process, enabling region-specific repainting and precise texture editing. 2) Additionally, we develop a unified depth-aware inpainting model that integrates depth information with inpainting cues, effectively mitigating 3D inconsistencies and improving generation speed. Through extensive experiments, our framework has proven to be both practical and effective in text-to-texture synthesis, paving the way for high-quality 3D content creation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_11878 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpainting Tang, Jiaxiang Lu, Ruijie Chen, Xiaokang Wen, Xiang Zeng, Gang Liu, Ziwei Computer Vision and Pattern Recognition Text-to-texture synthesis has become a new frontier in 3D content creation thanks to the recent advances in text-to-image models. Existing methods primarily adopt a combination of pretrained depth-aware diffusion and inpainting models, yet they exhibit shortcomings such as 3D inconsistency and limited controllability. To address these challenges, we introduce InteX, a novel framework for interactive text-to-texture synthesis. 1) InteX includes a user-friendly interface that facilitates interaction and control throughout the synthesis process, enabling region-specific repainting and precise texture editing. 2) Additionally, we develop a unified depth-aware inpainting model that integrates depth information with inpainting cues, effectively mitigating 3D inconsistencies and improving generation speed. Through extensive experiments, our framework has proven to be both practical and effective in text-to-texture synthesis, paving the way for high-quality 3D content creation. |
| title | InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpainting |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.11878 |