PartDiffuser: Part-wise 3D Mesh Generation via Discrete Diffusion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yang, Yichen, Li, Hong, Zhu, Haodong, Yang, Linin, Lei, Guojun, Xu, Sheng, Zhang, Baochang
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918507394891776
author Yang, Yichen
Li, Hong
Zhu, Haodong
Yang, Linin
Lei, Guojun
Xu, Sheng
Zhang, Baochang
author_facet Yang, Yichen
Li, Hong
Zhu, Haodong
Yang, Linin
Lei, Guojun
Xu, Sheng
Zhang, Baochang
contents Existing autoregressive (AR) methods for generating artist-designed meshes struggle to balance global structural consistency with high-fidelity local details, and are susceptible to error accumulation. To address this, we propose PartDiffuser, a novel semi-autoregressive diffusion framework for point-cloud-to-mesh generation. The method first performs semantic segmentation on the mesh and then operates in a "part-wise" manner: it employs autoregression between parts to ensure global topology, while utilizing a parallel discrete diffusion process within each semantic part to precisely reconstruct high-frequency geometric features. PartDiffuser is based on the DiT architecture and introduces a part-aware cross-attention mechanism, using point clouds as hierarchical geometric conditioning to dynamically control the generation process, thereby effectively decoupling the global and local generation tasks. Experiments demonstrate that this method significantly outperforms state-of-the-art (SOTA) models in generating 3D meshes with rich detail, exhibiting exceptional detail representation suitable for real-world applications.
format Preprint
id arxiv_https___arxiv_org_abs_2511_18801
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PartDiffuser: Part-wise 3D Mesh Generation via Discrete Diffusion
Yang, Yichen
Li, Hong
Zhu, Haodong
Yang, Linin
Lei, Guojun
Xu, Sheng
Zhang, Baochang
Computer Vision and Pattern Recognition
Existing autoregressive (AR) methods for generating artist-designed meshes struggle to balance global structural consistency with high-fidelity local details, and are susceptible to error accumulation. To address this, we propose PartDiffuser, a novel semi-autoregressive diffusion framework for point-cloud-to-mesh generation. The method first performs semantic segmentation on the mesh and then operates in a "part-wise" manner: it employs autoregression between parts to ensure global topology, while utilizing a parallel discrete diffusion process within each semantic part to precisely reconstruct high-frequency geometric features. PartDiffuser is based on the DiT architecture and introduces a part-aware cross-attention mechanism, using point clouds as hierarchical geometric conditioning to dynamically control the generation process, thereby effectively decoupling the global and local generation tasks. Experiments demonstrate that this method significantly outperforms state-of-the-art (SOTA) models in generating 3D meshes with rich detail, exhibiting exceptional detail representation suitable for real-world applications.
title PartDiffuser: Part-wise 3D Mesh Generation via Discrete Diffusion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.18801