DriveFix: Spatio-Temporally Coherent Driving Scene Restoration
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910056103018496 |
|---|---|
| author | Si, Heyu Denis, Brandon James Sun, Muyang Datcu, Dragos Li, Yaoru Jin, Xin Fu, Ruiju Tatarinova, Yuliia Landi, Federico Song, Jie Song, Mingli Guo, Qi |
| author_facet | Si, Heyu Denis, Brandon James Sun, Muyang Datcu, Dragos Li, Yaoru Jin, Xin Fu, Ruiju Tatarinova, Yuliia Landi, Federico Song, Jie Song, Mingli Guo, Qi |
| contents | Recent advancements in 4D scene reconstruction, particularly those leveraging diffusion priors, have shown promise for novel view synthesis in autonomous driving. However, these methods often process frames independently or in a view-by-view manner, leading to a critical lack of spatio-temporal synergy. This results in spatial misalignment across cameras and temporal drift in sequences. We propose DriveFix, a novel multi-view restoration framework that ensures spatio-temporal coherence for driving scenes. Our approach employs an interleaved diffusion transformer architecture with specialized blocks to explicitly model both temporal dependencies and cross-camera spatial consistency. By conditioning the generation on historical context and integrating geometry-aware training losses, DriveFix enforces that the restored views adhere to a unified 3D geometry. This enables the consistent propagation of high-fidelity textures and significantly reduces artifacts. Extensive evaluations on the Waymo, nuScenes, and PandaSet datasets demonstrate that DriveFix achieves state-of-the-art performance in both reconstruction and novel view synthesis, marking a substantial step toward robust 4D world modeling for real-world deployment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_16306 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | DriveFix: Spatio-Temporally Coherent Driving Scene Restoration Si, Heyu Denis, Brandon James Sun, Muyang Datcu, Dragos Li, Yaoru Jin, Xin Fu, Ruiju Tatarinova, Yuliia Landi, Federico Song, Jie Song, Mingli Guo, Qi Computer Vision and Pattern Recognition Recent advancements in 4D scene reconstruction, particularly those leveraging diffusion priors, have shown promise for novel view synthesis in autonomous driving. However, these methods often process frames independently or in a view-by-view manner, leading to a critical lack of spatio-temporal synergy. This results in spatial misalignment across cameras and temporal drift in sequences. We propose DriveFix, a novel multi-view restoration framework that ensures spatio-temporal coherence for driving scenes. Our approach employs an interleaved diffusion transformer architecture with specialized blocks to explicitly model both temporal dependencies and cross-camera spatial consistency. By conditioning the generation on historical context and integrating geometry-aware training losses, DriveFix enforces that the restored views adhere to a unified 3D geometry. This enables the consistent propagation of high-fidelity textures and significantly reduces artifacts. Extensive evaluations on the Waymo, nuScenes, and PandaSet datasets demonstrate that DriveFix achieves state-of-the-art performance in both reconstruction and novel view synthesis, marking a substantial step toward robust 4D world modeling for real-world deployment. |
| title | DriveFix: Spatio-Temporally Coherent Driving Scene Restoration |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2603.16306 |