Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Humt, Matthias, Hillenbrand, Ulrich, Triebel, Rudolph
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908773963005952
author Humt, Matthias
Hillenbrand, Ulrich
Triebel, Rudolph
author_facet Humt, Matthias
Hillenbrand, Ulrich
Triebel, Rudolph
contents While generative models have seen significant adoption across a wide range of data modalities, including 3D data, a consensus on which model is best suited for which task has yet to be reached. Further, conditional information such as text and images to steer the generation process are frequently employed, whereas others, like partial 3D data, have not been thoroughly evaluated. In this work, we compare two of the most promising generative models--Denoising Diffusion Probabilistic Models and Autoregressive Causal Transformers--which we adapt for the tasks of generative shape modeling and completion. We conduct a thorough quantitative evaluation and comparison of both tasks, including a baseline discriminative model and an extensive ablation study. Our results show that (1) the diffusion model with continuous latents outperforms both the discriminative model and the autoregressive approach and delivers state-of-the-art performance on multi-modal shape completion from a single, noisy depth image under realistic conditions and (2) when compared on the same discrete latent space, the autoregressive model can match or exceed diffusion performance on these tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2511_11074
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image
Humt, Matthias
Hillenbrand, Ulrich
Triebel, Rudolph
Computer Vision and Pattern Recognition
While generative models have seen significant adoption across a wide range of data modalities, including 3D data, a consensus on which model is best suited for which task has yet to be reached. Further, conditional information such as text and images to steer the generation process are frequently employed, whereas others, like partial 3D data, have not been thoroughly evaluated. In this work, we compare two of the most promising generative models--Denoising Diffusion Probabilistic Models and Autoregressive Causal Transformers--which we adapt for the tasks of generative shape modeling and completion. We conduct a thorough quantitative evaluation and comparison of both tasks, including a baseline discriminative model and an extensive ablation study. Our results show that (1) the diffusion model with continuous latents outperforms both the discriminative model and the autoregressive approach and delivers state-of-the-art performance on multi-modal shape completion from a single, noisy depth image under realistic conditions and (2) when compared on the same discrete latent space, the autoregressive model can match or exceed diffusion performance on these tasks.
title Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.11074