DiffPCN: Latent Diffusion Model Based on Multi-view Depth Images for Point Cloud Completion

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Zijun, Yan, Hongyu, Li, Shijie, Luo, Kunming, Lu, Li, Yang, Xulei, Lin, Weisi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912612597366784
author Li, Zijun
Yan, Hongyu
Li, Shijie
Luo, Kunming
Lu, Li
Yang, Xulei
Lin, Weisi
author_facet Li, Zijun
Yan, Hongyu
Li, Shijie
Luo, Kunming
Lu, Li
Yang, Xulei
Lin, Weisi
contents Latent diffusion models (LDMs) have demonstrated remarkable generative capabilities across various low-level vision tasks. However, their potential for point cloud completion remains underexplored due to the unstructured and irregular nature of point clouds. In this work, we propose DiffPCN, a novel diffusion-based coarse-to-fine framework for point cloud completion. Our approach comprises two stages: an initial stage for generating coarse point clouds, and a refinement stage that improves their quality through point denoising and upsampling. Specifically, we first project the unordered and irregular partial point cloud into structured depth images, which serve as conditions for a well-designed DepthLDM to synthesize completed multi-view depth images that are used to form coarse point clouds. In this way, our DiffPCN can yield high-quality and high-completeness coarse point clouds by leveraging LDM' s powerful generation and comprehension capabilities. Then, since LDMs inevitably introduce outliers into the generated depth maps, we design a Point Denoising Network to remove artifacts from the coarse point cloud by predicting a per-point distance score. Finally, we devise an Association-Aware Point Upsampler, which guides the upsampling process by leveraging local association features between the input point cloud and the corresponding coarse points, further yielding a dense and high-fidelity output. Experimental results demonstrate that our DiffPCN achieves state-of-the-art performance in geometric accuracy and shape completeness, significantly improving the robustness and consistency of point cloud completion.
format Preprint
id arxiv_https___arxiv_org_abs_2509_23723
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DiffPCN: Latent Diffusion Model Based on Multi-view Depth Images for Point Cloud Completion
Li, Zijun
Yan, Hongyu
Li, Shijie
Luo, Kunming
Lu, Li
Yang, Xulei
Lin, Weisi
Computer Vision and Pattern Recognition
Latent diffusion models (LDMs) have demonstrated remarkable generative capabilities across various low-level vision tasks. However, their potential for point cloud completion remains underexplored due to the unstructured and irregular nature of point clouds. In this work, we propose DiffPCN, a novel diffusion-based coarse-to-fine framework for point cloud completion. Our approach comprises two stages: an initial stage for generating coarse point clouds, and a refinement stage that improves their quality through point denoising and upsampling. Specifically, we first project the unordered and irregular partial point cloud into structured depth images, which serve as conditions for a well-designed DepthLDM to synthesize completed multi-view depth images that are used to form coarse point clouds. In this way, our DiffPCN can yield high-quality and high-completeness coarse point clouds by leveraging LDM' s powerful generation and comprehension capabilities. Then, since LDMs inevitably introduce outliers into the generated depth maps, we design a Point Denoising Network to remove artifacts from the coarse point cloud by predicting a per-point distance score. Finally, we devise an Association-Aware Point Upsampler, which guides the upsampling process by leveraging local association features between the input point cloud and the corresponding coarse points, further yielding a dense and high-fidelity output. Experimental results demonstrate that our DiffPCN achieves state-of-the-art performance in geometric accuracy and shape completeness, significantly improving the robustness and consistency of point cloud completion.
title DiffPCN: Latent Diffusion Model Based on Multi-view Depth Images for Point Cloud Completion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.23723