MapGS: Generalizable Pretraining and Data Augmentation for Online Mapping via Novel View Synthesis
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915099240824832 |
|---|---|
| author | Zhang, Hengyuan Paz, David Guo, Yuliang Huang, Xinyu Christensen, Henrik I. Ren, Liu |
| author_facet | Zhang, Hengyuan Paz, David Guo, Yuliang Huang, Xinyu Christensen, Henrik I. Ren, Liu |
| contents | Online mapping reduces the reliance of autonomous vehicles on high-definition (HD) maps, significantly enhancing scalability. However, recent advancements often overlook cross-sensor configuration generalization, leading to performance degradation when models are deployed on vehicles with different camera intrinsics and extrinsics. With the rapid evolution of novel view synthesis methods, we investigate the extent to which these techniques can be leveraged to address the sensor configuration generalization challenge. We propose a novel framework leveraging Gaussian splatting to reconstruct scenes and render camera images in target sensor configurations. The target config sensor data, along with labels mapped to the target config, are used to train online mapping models. Our proposed framework on the nuScenes and Argoverse 2 datasets demonstrates a performance improvement of 18% through effective dataset augmentation, achieves faster convergence and efficient training, and exceeds state-of-the-art performance when using only 25% of the original training data. This enables data reuse and reduces the need for laborious data labeling. Project page at https://henryzhangzhy.github.io/mapgs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_06660 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MapGS: Generalizable Pretraining and Data Augmentation for Online Mapping via Novel View Synthesis Zhang, Hengyuan Paz, David Guo, Yuliang Huang, Xinyu Christensen, Henrik I. Ren, Liu Computer Vision and Pattern Recognition Robotics Online mapping reduces the reliance of autonomous vehicles on high-definition (HD) maps, significantly enhancing scalability. However, recent advancements often overlook cross-sensor configuration generalization, leading to performance degradation when models are deployed on vehicles with different camera intrinsics and extrinsics. With the rapid evolution of novel view synthesis methods, we investigate the extent to which these techniques can be leveraged to address the sensor configuration generalization challenge. We propose a novel framework leveraging Gaussian splatting to reconstruct scenes and render camera images in target sensor configurations. The target config sensor data, along with labels mapped to the target config, are used to train online mapping models. Our proposed framework on the nuScenes and Argoverse 2 datasets demonstrates a performance improvement of 18% through effective dataset augmentation, achieves faster convergence and efficient training, and exceeds state-of-the-art performance when using only 25% of the original training data. This enables data reuse and reduces the need for laborious data labeling. Project page at https://henryzhangzhy.github.io/mapgs. |
| title | MapGS: Generalizable Pretraining and Data Augmentation for Online Mapping via Novel View Synthesis |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2501.06660 |