Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ying, Zhi, Rong, Boxiang, Wang, Jingyu, Xu, Maoyuan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916947304644608
author Ying, Zhi
Rong, Boxiang
Wang, Jingyu
Xu, Maoyuan
author_facet Ying, Zhi
Rong, Boxiang
Wang, Jingyu
Xu, Maoyuan
contents Material creation and reconstruction are crucial for appearance modeling but traditionally require significant time and expertise from artists. While recent methods leverage visual foundation models to synthesize PBR materials from user-provided inputs, they often fall short in quality, flexibility, and user control. We propose a novel two-stage generate-and-estimate framework for PBR material generation. In the generation stage, a fine-tuned diffusion model synthesizes shaded, tileable texture images aligned with user input. In the estimation stage, we introduce a chained decomposition scheme that sequentially predicts SVBRDF channels by passing previously extracted representation as input into a single-step image-conditional diffusion model. Our method is efficient, high quality, and enables flexible user control. We evaluate our approach against existing material generation and estimation methods, demonstrating superior performance. Our material estimation method shows strong robustness on both generated textures and in-the-wild photographs. Furthermore, we highlight the flexibility of our framework across diverse applications, including text-to-material, image-to-material, structure-guided generation, and material editing.
format Preprint
id arxiv_https___arxiv_org_abs_2509_09952
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images
Ying, Zhi
Rong, Boxiang
Wang, Jingyu
Xu, Maoyuan
Graphics
Computer Vision and Pattern Recognition
Material creation and reconstruction are crucial for appearance modeling but traditionally require significant time and expertise from artists. While recent methods leverage visual foundation models to synthesize PBR materials from user-provided inputs, they often fall short in quality, flexibility, and user control. We propose a novel two-stage generate-and-estimate framework for PBR material generation. In the generation stage, a fine-tuned diffusion model synthesizes shaded, tileable texture images aligned with user input. In the estimation stage, we introduce a chained decomposition scheme that sequentially predicts SVBRDF channels by passing previously extracted representation as input into a single-step image-conditional diffusion model. Our method is efficient, high quality, and enables flexible user control. We evaluate our approach against existing material generation and estimation methods, demonstrating superior performance. Our material estimation method shows strong robustness on both generated textures and in-the-wild photographs. Furthermore, we highlight the flexibility of our framework across diverse applications, including text-to-material, image-to-material, structure-guided generation, and material editing.
title Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images
topic Graphics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.09952