PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fei, Fan, Tang, Jiajun, Tian, Fei-Peng, Shi, Boxin, Tan, Ping
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909042524291072
author Fei, Fan
Tang, Jiajun
Tian, Fei-Peng
Shi, Boxin
Tan, Ping
author_facet Fei, Fan
Tang, Jiajun
Tian, Fei-Peng
Shi, Boxin
Tan, Ping
contents We present PacTure, a novel framework for generating physically-based rendering (PBR) material textures for an untextured 3D mesh from a text description. Existing 2D generation-based texturing approaches either generate textures sequentially from different views, resulting in long inference times and globally inconsistent textures, or adopt multi-view generation with cross-view attention to enhance global consistency, which, however, limits the resolution for each view. In response to these weaknesses, we first introduce view packing, a novel technique that significantly increases the effective resolution for each view during multi-view generation, without imposing additional inference cost. Unlike UV mapping, it preserves the spatial proximity essential for image generation and maintains full compatibility with current 2D generative models. To further reduce the inferencing cost, we enable fine-grained control and multi-domain generation within the next-scale prediction autoregressive framework, creating an efficient multi-view PBR generation backbone. Extensive experiments show that PacTure outperforms state-of-the-art methods in both quality and efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2505_22394
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Models
Fei, Fan
Tang, Jiajun
Tian, Fei-Peng
Shi, Boxin
Tan, Ping
Computer Vision and Pattern Recognition
We present PacTure, a novel framework for generating physically-based rendering (PBR) material textures for an untextured 3D mesh from a text description. Existing 2D generation-based texturing approaches either generate textures sequentially from different views, resulting in long inference times and globally inconsistent textures, or adopt multi-view generation with cross-view attention to enhance global consistency, which, however, limits the resolution for each view. In response to these weaknesses, we first introduce view packing, a novel technique that significantly increases the effective resolution for each view during multi-view generation, without imposing additional inference cost. Unlike UV mapping, it preserves the spatial proximity essential for image generation and maintains full compatibility with current 2D generative models. To further reduce the inferencing cost, we enable fine-grained control and multi-domain generation within the next-scale prediction autoregressive framework, creating an efficient multi-view PBR generation backbone. Extensive experiments show that PacTure outperforms state-of-the-art methods in both quality and efficiency.
title PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.22394