TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lionar, Stefan, Liang, Jiabin, Lee, Gim Hee
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916652823609344
author Lionar, Stefan
Liang, Jiabin
Lee, Gim Hee
author_facet Lionar, Stefan
Liang, Jiabin
Lee, Gim Hee
contents We introduce TreeMeshGPT, an autoregressive Transformer designed to generate high-quality artistic meshes aligned with input point clouds. Instead of the conventional next-token prediction in autoregressive Transformer, we propose a novel Autoregressive Tree Sequencing where the next input token is retrieved from a dynamically growing tree structure that is built upon the triangle adjacency of faces within the mesh. Our sequencing enables the mesh to extend locally from the last generated triangular face at each step, and therefore reduces training difficulty and improves mesh quality. Our approach represents each triangular face with two tokens, achieving a compression rate of approximately 22% compared to the naive face tokenization. This efficient tokenization enables our model to generate highly detailed artistic meshes with strong point cloud conditioning, surpassing previous methods in both capacity and fidelity. Furthermore, our method generates mesh with strong normal orientation constraints, minimizing flipped normals commonly encountered in previous methods. Our experiments show that TreeMeshGPT enhances the mesh generation quality with refined details and normal orientation consistency.
format Preprint
id arxiv_https___arxiv_org_abs_2503_11629
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencing
Lionar, Stefan
Liang, Jiabin
Lee, Gim Hee
Graphics
Computer Vision and Pattern Recognition
Multimedia
We introduce TreeMeshGPT, an autoregressive Transformer designed to generate high-quality artistic meshes aligned with input point clouds. Instead of the conventional next-token prediction in autoregressive Transformer, we propose a novel Autoregressive Tree Sequencing where the next input token is retrieved from a dynamically growing tree structure that is built upon the triangle adjacency of faces within the mesh. Our sequencing enables the mesh to extend locally from the last generated triangular face at each step, and therefore reduces training difficulty and improves mesh quality. Our approach represents each triangular face with two tokens, achieving a compression rate of approximately 22% compared to the naive face tokenization. This efficient tokenization enables our model to generate highly detailed artistic meshes with strong point cloud conditioning, surpassing previous methods in both capacity and fidelity. Furthermore, our method generates mesh with strong normal orientation constraints, minimizing flipped normals commonly encountered in previous methods. Our experiments show that TreeMeshGPT enhances the mesh generation quality with refined details and normal orientation consistency.
title TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencing
topic Graphics
Computer Vision and Pattern Recognition
Multimedia
url https://arxiv.org/abs/2503.11629