PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail Prediction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Meng, Ziqiao, Wang, Qichao, Dou, Zhiyang, Song, Zixing, Zhou, Zhipeng, King, Irwin, Zhao, Peilin
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912737081163776
author Meng, Ziqiao
Wang, Qichao
Dou, Zhiyang
Song, Zixing
Zhou, Zhipeng
King, Irwin
Zhao, Peilin
author_facet Meng, Ziqiao
Wang, Qichao
Dou, Zhiyang
Song, Zixing
Zhou, Zhipeng
King, Irwin
Zhao, Peilin
contents Autoregressive point cloud generation has long lagged behind diffusion-based approaches in quality. The performance gap stems from the fact that autoregressive models impose an artificial ordering on inherently unordered point sets, forcing shape generation to proceed as a sequence of local predictions. This sequential bias emphasizes short-range continuity but undermines the model's capacity to capture long-range dependencies, hindering its ability to enforce global structural properties such as symmetry, consistent topology, and large-scale geometric regularities. Inspired by the level-of-detail (LOD) principle in shape modeling, we propose PointNSP, a coarse-to-fine generative framework that preserves global shape structure at low resolutions and progressively refines fine-grained geometry at higher scales through a next-scale prediction paradigm. This multi-scale factorization aligns the autoregressive objective with the permutation-invariant nature of point sets, enabling rich intra-scale interactions while avoiding brittle fixed orderings. Experiments on ShapeNet show that PointNSP establishes state-of-the-art (SOTA) generation quality for the first time within the autoregressive paradigm. In addition, it surpasses strong diffusion-based baselines in parameter, training, and inference efficiency. Finally, in dense generation with 8,192 points, PointNSP's advantages become even more pronounced, underscoring its scalability potential.
format Preprint
id arxiv_https___arxiv_org_abs_2503_08594
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail Prediction
Meng, Ziqiao
Wang, Qichao
Dou, Zhiyang
Song, Zixing
Zhou, Zhipeng
King, Irwin
Zhao, Peilin
Computer Vision and Pattern Recognition
Machine Learning
Autoregressive point cloud generation has long lagged behind diffusion-based approaches in quality. The performance gap stems from the fact that autoregressive models impose an artificial ordering on inherently unordered point sets, forcing shape generation to proceed as a sequence of local predictions. This sequential bias emphasizes short-range continuity but undermines the model's capacity to capture long-range dependencies, hindering its ability to enforce global structural properties such as symmetry, consistent topology, and large-scale geometric regularities. Inspired by the level-of-detail (LOD) principle in shape modeling, we propose PointNSP, a coarse-to-fine generative framework that preserves global shape structure at low resolutions and progressively refines fine-grained geometry at higher scales through a next-scale prediction paradigm. This multi-scale factorization aligns the autoregressive objective with the permutation-invariant nature of point sets, enabling rich intra-scale interactions while avoiding brittle fixed orderings. Experiments on ShapeNet show that PointNSP establishes state-of-the-art (SOTA) generation quality for the first time within the autoregressive paradigm. In addition, it surpasses strong diffusion-based baselines in parameter, training, and inference efficiency. Finally, in dense generation with 8,192 points, PointNSP's advantages become even more pronounced, underscoring its scalability potential.
title PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail Prediction
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2503.08594