Physics-Aware 3D Gaussian Editing for Driving Scene Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Feng, Zhang, Jian, Sun, Yuhang, Wang, He, Wen, Qiong, Kong, Debao, Wu, Tieru, Ma, Rui
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916044524748800
author Zhou, Feng
Zhang, Jian
Sun, Yuhang
Wang, He
Wen, Qiong
Kong, Debao
Wu, Tieru
Ma, Rui
author_facet Zhou, Feng
Zhang, Jian
Sun, Yuhang
Wang, He
Wen, Qiong
Kong, Debao
Wu, Tieru
Ma, Rui
contents 3D Gaussian Splatting (3DGS) has shown great potential in autonomous driving simulation and data generation, enabling photorealistic reconstruction and flexible scene manipulation. However, existing 3DGS scene editing methods have limited support for road geometry editing (e.g., inserting speed humps or sunken roads), and generally do not couple such edits with plausible vehicle-road interaction dynamics. Such editing is essential for generating training data under extreme driving scenarios or evaluating system reliability under these road irregularities. Moreover, many optimization-based methods require minutes of per-edit refinement, while existing efficient alternatives mainly focus on appearance-level or object-level manipulation rather than physics-aware road irregularity editing. To address these limitations, we propose RoVES, a Road-and-Vehicle Editing System for physics-aware 3D Gaussian editing in driving scenes. RoVES enables single-image-driven road geometry insertion and couples the edited road profile with a 4-DOF half-car vehicle dynamics model to achieve physics-aware vehicle pose correction in vertical displacement and pitch. RoVES inserts road elements in a one-shot, optimization-free pipeline (1.84s), and the full pipeline (including color transfer and vehicle-dynamics-based pose correction) completes in 6.24s; it edits dynamic vehicles via pose editing and corrects poses frame-by-frame to approximate dynamics-consistent vertical displacement and pitch responses. Experiments on the Waymo dataset show that RoVES provides practical efficiency and competitive visual consistency for physics-aware driving scene generation.
format Preprint
id arxiv_https___arxiv_org_abs_2605_25373
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Physics-Aware 3D Gaussian Editing for Driving Scene Generation
Zhou, Feng
Zhang, Jian
Sun, Yuhang
Wang, He
Wen, Qiong
Kong, Debao
Wu, Tieru
Ma, Rui
Computer Vision and Pattern Recognition
3D Gaussian Splatting (3DGS) has shown great potential in autonomous driving simulation and data generation, enabling photorealistic reconstruction and flexible scene manipulation. However, existing 3DGS scene editing methods have limited support for road geometry editing (e.g., inserting speed humps or sunken roads), and generally do not couple such edits with plausible vehicle-road interaction dynamics. Such editing is essential for generating training data under extreme driving scenarios or evaluating system reliability under these road irregularities. Moreover, many optimization-based methods require minutes of per-edit refinement, while existing efficient alternatives mainly focus on appearance-level or object-level manipulation rather than physics-aware road irregularity editing. To address these limitations, we propose RoVES, a Road-and-Vehicle Editing System for physics-aware 3D Gaussian editing in driving scenes. RoVES enables single-image-driven road geometry insertion and couples the edited road profile with a 4-DOF half-car vehicle dynamics model to achieve physics-aware vehicle pose correction in vertical displacement and pitch. RoVES inserts road elements in a one-shot, optimization-free pipeline (1.84s), and the full pipeline (including color transfer and vehicle-dynamics-based pose correction) completes in 6.24s; it edits dynamic vehicles via pose editing and corrects poses frame-by-frame to approximate dynamics-consistent vertical displacement and pitch responses. Experiments on the Waymo dataset show that RoVES provides practical efficiency and competitive visual consistency for physics-aware driving scene generation.
title Physics-Aware 3D Gaussian Editing for Driving Scene Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.25373