VideoMat: Extracting PBR Materials from Video Diffusion Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915345725390848 |
|---|---|
| author | Munkberg, Jacob Wang, Zian Liang, Ruofan Shen, Tianchang Hasselgren, Jon |
| author_facet | Munkberg, Jacob Wang, Zian Liang, Ruofan Shen, Tianchang Hasselgren, Jon |
| contents | We leverage finetuned video diffusion models, intrinsic decomposition of videos, and physically-based differentiable rendering to generate high quality materials for 3D models given a text prompt or a single image. We condition a video diffusion model to respect the input geometry and lighting condition. This model produces multiple views of a given 3D model with coherent material properties. Secondly, we use a recent model to extract intrinsics (base color, roughness, metallic) from the generated video. Finally, we use the intrinsics alongside the generated video in a differentiable path tracer to robustly extract PBR materials directly compatible with common content creation tools. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_09665 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | VideoMat: Extracting PBR Materials from Video Diffusion Models Munkberg, Jacob Wang, Zian Liang, Ruofan Shen, Tianchang Hasselgren, Jon Graphics Computer Vision and Pattern Recognition We leverage finetuned video diffusion models, intrinsic decomposition of videos, and physically-based differentiable rendering to generate high quality materials for 3D models given a text prompt or a single image. We condition a video diffusion model to respect the input geometry and lighting condition. This model produces multiple views of a given 3D model with coherent material properties. Secondly, we use a recent model to extract intrinsics (base color, roughness, metallic) from the generated video. Finally, we use the intrinsics alongside the generated video in a differentiable path tracer to robustly extract PBR materials directly compatible with common content creation tools. |
| title | VideoMat: Extracting PBR Materials from Video Diffusion Models |
| topic | Graphics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2506.09665 |