LaGen: Towards Autoregressive LiDAR Scene Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Sizhuo, Jia, Xiaosong, Zhang, Fanrui, Li, Junjie, Zhang, Juyong, Feng, Yukang, Sun, Jianwen, Wong, Songbur, You, Junqi, Yan, Junchi
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915638982737920
author Zhou, Sizhuo
Jia, Xiaosong
Zhang, Fanrui
Li, Junjie
Zhang, Juyong
Feng, Yukang
Sun, Jianwen
Wong, Songbur
You, Junqi
Yan, Junchi
author_facet Zhou, Sizhuo
Jia, Xiaosong
Zhang, Fanrui
Li, Junjie
Zhang, Juyong
Feng, Yukang
Sun, Jianwen
Wong, Songbur
You, Junqi
Yan, Junchi
contents Generative world models for autonomous driving (AD) have become a trending topic. Unlike the widely studied image modality, in this work we explore generative world models for LiDAR data. Existing generation methods for LiDAR data only support single frame generation, while existing prediction approaches require multiple frames of historical input and can only deterministically predict multiple frames at once, lacking interactivity. Both paradigms fail to support long-horizon interactive generation. To this end, we introduce LaGen, which to the best of our knowledge is the first framework capable of frame-by-frame autoregressive generation of long-horizon LiDAR scenes. LaGen is able to take a single-frame LiDAR input as a starting point and effectively utilize bounding box information as conditions to generate high-fidelity 4D scene point clouds. In addition, we introduce a scene decoupling estimation module to enhance the model's interactive generation capability for object-level content, as well as a noise modulation module to mitigate error accumulation during long-horizon generation. We construct a protocol based on nuScenes for evaluating long-horizon LiDAR scene generation. Experimental results comprehensively demonstrate LaGen outperforms state-of-the-art LiDAR generation and prediction models, especially on the later frames.
format Preprint
id arxiv_https___arxiv_org_abs_2511_21256
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LaGen: Towards Autoregressive LiDAR Scene Generation
Zhou, Sizhuo
Jia, Xiaosong
Zhang, Fanrui
Li, Junjie
Zhang, Juyong
Feng, Yukang
Sun, Jianwen
Wong, Songbur
You, Junqi
Yan, Junchi
Computer Vision and Pattern Recognition
Generative world models for autonomous driving (AD) have become a trending topic. Unlike the widely studied image modality, in this work we explore generative world models for LiDAR data. Existing generation methods for LiDAR data only support single frame generation, while existing prediction approaches require multiple frames of historical input and can only deterministically predict multiple frames at once, lacking interactivity. Both paradigms fail to support long-horizon interactive generation. To this end, we introduce LaGen, which to the best of our knowledge is the first framework capable of frame-by-frame autoregressive generation of long-horizon LiDAR scenes. LaGen is able to take a single-frame LiDAR input as a starting point and effectively utilize bounding box information as conditions to generate high-fidelity 4D scene point clouds. In addition, we introduce a scene decoupling estimation module to enhance the model's interactive generation capability for object-level content, as well as a noise modulation module to mitigate error accumulation during long-horizon generation. We construct a protocol based on nuScenes for evaluating long-horizon LiDAR scene generation. Experimental results comprehensively demonstrate LaGen outperforms state-of-the-art LiDAR generation and prediction models, especially on the later frames.
title LaGen: Towards Autoregressive LiDAR Scene Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.21256