An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenes

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gauthier, Alban, Deschaintre, Valentin, Lanvin, Alexandre, Durand, Fredo, Bousseau, Adrien, Drettakis, George
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918249698951168
author Gauthier, Alban
Deschaintre, Valentin
Lanvin, Alexandre
Durand, Fredo
Bousseau, Adrien
Drettakis, George
author_facet Gauthier, Alban
Deschaintre, Valentin
Lanvin, Alexandre
Durand, Fredo
Bousseau, Adrien
Drettakis, George
contents Digital content creation is experiencing a profound change with the advent of deep generative models. For texturing, conditional image generators now allow the synthesis of realistic RGB images of a 3D scene that align with the geometry of that scene. For appearance modeling, SVBRDF prediction networks recover material parameters from RGB images. Combining these technologies allows us to quickly generate SVBRDF maps for multiple views of a 3D scene, which can be merged to form a SVBRDF texture atlas of that scene. In this paper, we analyze the challenges and opportunities for SVBRDF prediction in the context of such a fast appearance modeling pipeline. On the one hand, single-view SVBRDF predictions might suffer from multiview incoherence and yield inconsistent texture atlases. On the other hand, generated RGB images, and the different modalities on which they are conditioned, can provide additional information for SVBRDF estimation compared to photographs. We compare neural architectures and conditions to identify designs that achieve high accuracy and coherence. We find that, surprisingly, a standard UNet is competitive with more complex designs. Project page: http://repo-sam.inria.fr/nerphys/svbrdf-evaluation
format Preprint
id arxiv_https___arxiv_org_abs_2512_13950
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenes
Gauthier, Alban
Deschaintre, Valentin
Lanvin, Alexandre
Durand, Fredo
Bousseau, Adrien
Drettakis, George
Computer Vision and Pattern Recognition
Graphics
Digital content creation is experiencing a profound change with the advent of deep generative models. For texturing, conditional image generators now allow the synthesis of realistic RGB images of a 3D scene that align with the geometry of that scene. For appearance modeling, SVBRDF prediction networks recover material parameters from RGB images. Combining these technologies allows us to quickly generate SVBRDF maps for multiple views of a 3D scene, which can be merged to form a SVBRDF texture atlas of that scene. In this paper, we analyze the challenges and opportunities for SVBRDF prediction in the context of such a fast appearance modeling pipeline. On the one hand, single-view SVBRDF predictions might suffer from multiview incoherence and yield inconsistent texture atlases. On the other hand, generated RGB images, and the different modalities on which they are conditioned, can provide additional information for SVBRDF estimation compared to photographs. We compare neural architectures and conditions to identify designs that achieve high accuracy and coherence. We find that, surprisingly, a standard UNet is competitive with more complex designs. Project page: http://repo-sam.inria.fr/nerphys/svbrdf-evaluation
title An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenes
topic Computer Vision and Pattern Recognition
Graphics
url https://arxiv.org/abs/2512.13950