MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusion
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918107543502848 |
|---|---|
| author | He, Zebin Yang, Mingxin Yang, Shuhui Tang, Yixuan Wang, Tao Zhang, Kaihao Chen, Guanying Liu, Yuhong Jiang, Jie Guo, Chunchao Luo, Wenhan |
| author_facet | He, Zebin Yang, Mingxin Yang, Shuhui Tang, Yixuan Wang, Tao Zhang, Kaihao Chen, Guanying Liu, Yuhong Jiang, Jie Guo, Chunchao Luo, Wenhan |
| contents | Physically-based rendering (PBR) has become a cornerstone in modern computer graphics, enabling realistic material representation and lighting interactions in 3D scenes. In this paper, we present MaterialMVP, a novel end-to-end model for generating PBR textures from 3D meshes and image prompts, addressing key challenges in multi-view material synthesis. Our approach leverages Reference Attention to extract and encode informative latent from the input reference images, enabling intuitive and controllable texture generation. We also introduce a Consistency-Regularized Training strategy to enforce stability across varying viewpoints and illumination conditions, ensuring illumination-invariant and geometrically consistent results. Additionally, we propose Dual-Channel Material Generation, which separately optimizes albedo and metallic-roughness (MR) textures while maintaining precise spatial alignment with the input images through Multi-Channel Aligned Attention. Learnable material embeddings are further integrated to capture the distinct properties of albedo and MR. Experimental results demonstrate that our model generates PBR textures with realistic behavior across diverse lighting scenarios, outperforming existing methods in both consistency and quality for scalable 3D asset creation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_10289 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusion He, Zebin Yang, Mingxin Yang, Shuhui Tang, Yixuan Wang, Tao Zhang, Kaihao Chen, Guanying Liu, Yuhong Jiang, Jie Guo, Chunchao Luo, Wenhan Computer Vision and Pattern Recognition Physically-based rendering (PBR) has become a cornerstone in modern computer graphics, enabling realistic material representation and lighting interactions in 3D scenes. In this paper, we present MaterialMVP, a novel end-to-end model for generating PBR textures from 3D meshes and image prompts, addressing key challenges in multi-view material synthesis. Our approach leverages Reference Attention to extract and encode informative latent from the input reference images, enabling intuitive and controllable texture generation. We also introduce a Consistency-Regularized Training strategy to enforce stability across varying viewpoints and illumination conditions, ensuring illumination-invariant and geometrically consistent results. Additionally, we propose Dual-Channel Material Generation, which separately optimizes albedo and metallic-roughness (MR) textures while maintaining precise spatial alignment with the input images through Multi-Channel Aligned Attention. Learnable material embeddings are further integrated to capture the distinct properties of albedo and MR. Experimental results demonstrate that our model generates PBR textures with realistic behavior across diverse lighting scenarios, outperforming existing methods in both consistency and quality for scalable 3D asset creation. |
| title | MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusion |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2503.10289 |