SG-LDM: Semantic-Guided LiDAR Generation via Latent-Aligned Diffusion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xiang, Zhengkang, Li, Zizhao, Khodabandeh, Amir, Khoshelham, Kourosh
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909666955493376
author Xiang, Zhengkang
Li, Zizhao
Khodabandeh, Amir
Khoshelham, Kourosh
author_facet Xiang, Zhengkang
Li, Zizhao
Khodabandeh, Amir
Khoshelham, Kourosh
contents Lidar point cloud synthesis based on generative models offers a promising solution to augment deep learning pipelines, particularly when real-world data is scarce or lacks diversity. By enabling flexible object manipulation, this synthesis approach can significantly enrich training datasets and enhance discriminative models. However, existing methods focus on unconditional lidar point cloud generation, overlooking their potential for real-world applications. In this paper, we propose SG-LDM, a Semantic-Guided Lidar Diffusion Model that employs latent alignment to enable robust semantic-to-lidar synthesis. By directly operating in the native lidar space and leveraging explicit semantic conditioning, SG-LDM achieves state-of-the-art performance in generating high-fidelity lidar point clouds guided by semantic labels. Moreover, we propose the first diffusion-based lidar translation framework based on SG-LDM, which enables cross-domain translation as a domain adaptation strategy to enhance downstream perception performance. Systematic experiments demonstrate that SG-LDM significantly outperforms existing lidar diffusion models and the proposed lidar translation framework further improves data augmentation performance in the downstream lidar segmentation task.
format Preprint
id arxiv_https___arxiv_org_abs_2506_23606
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SG-LDM: Semantic-Guided LiDAR Generation via Latent-Aligned Diffusion
Xiang, Zhengkang
Li, Zizhao
Khodabandeh, Amir
Khoshelham, Kourosh
Computer Vision and Pattern Recognition
Lidar point cloud synthesis based on generative models offers a promising solution to augment deep learning pipelines, particularly when real-world data is scarce or lacks diversity. By enabling flexible object manipulation, this synthesis approach can significantly enrich training datasets and enhance discriminative models. However, existing methods focus on unconditional lidar point cloud generation, overlooking their potential for real-world applications. In this paper, we propose SG-LDM, a Semantic-Guided Lidar Diffusion Model that employs latent alignment to enable robust semantic-to-lidar synthesis. By directly operating in the native lidar space and leveraging explicit semantic conditioning, SG-LDM achieves state-of-the-art performance in generating high-fidelity lidar point clouds guided by semantic labels. Moreover, we propose the first diffusion-based lidar translation framework based on SG-LDM, which enables cross-domain translation as a domain adaptation strategy to enhance downstream perception performance. Systematic experiments demonstrate that SG-LDM significantly outperforms existing lidar diffusion models and the proposed lidar translation framework further improves data augmentation performance in the downstream lidar segmentation task.
title SG-LDM: Semantic-Guided LiDAR Generation via Latent-Aligned Diffusion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.23606