The Constant Eye: Benchmarking and Bridging Appearance Robustness in Autonomous Driving

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Jiabao, Zhou, Hongyu, Yang, Yuanbo, Shao, Jiahao, Liao, Yiyi
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914327782490112
author Wang, Jiabao
Zhou, Hongyu
Yang, Yuanbo
Shao, Jiahao
Liao, Yiyi
author_facet Wang, Jiabao
Zhou, Hongyu
Yang, Yuanbo
Shao, Jiahao
Liao, Yiyi
contents Despite rapid progress, autonomous driving algorithms remain notoriously fragile under Out-of-Distribution (OOD) conditions. We identify a critical decoupling failure in current research: the lack of distinction between appearance-based shifts, such as weather and lighting, and structural scene changes. This leaves a fundamental question unanswered: Is the planner failing because of complex road geometry, or simply because it is raining? To resolve this, we establish navdream, a high-fidelity robustness benchmark leveraging generative pixel-aligned style transfer. By creating a visual stress test with negligible geometric deviation, we isolate the impact of appearance on driving performance. Our evaluation reveals that existing planning algorithms often show significant degradation under OOD appearance conditions, even when the underlying scene structure remains consistent. To bridge this gap, we propose a universal perception interface leveraging a frozen visual foundation model (DINOv3). By extracting appearance-invariant features as a stable interface for the planner, we achieve exceptional zero-shot generalization across diverse planning paradigms, including regression-based, diffusion-based, and scoring-based models. Our plug-and-play solution maintains consistent performance across extreme appearance shifts without requiring further fine-tuning. The benchmark and code will be made available.
format Preprint
id arxiv_https___arxiv_org_abs_2602_12563
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle The Constant Eye: Benchmarking and Bridging Appearance Robustness in Autonomous Driving
Wang, Jiabao
Zhou, Hongyu
Yang, Yuanbo
Shao, Jiahao
Liao, Yiyi
Computer Vision and Pattern Recognition
Despite rapid progress, autonomous driving algorithms remain notoriously fragile under Out-of-Distribution (OOD) conditions. We identify a critical decoupling failure in current research: the lack of distinction between appearance-based shifts, such as weather and lighting, and structural scene changes. This leaves a fundamental question unanswered: Is the planner failing because of complex road geometry, or simply because it is raining? To resolve this, we establish navdream, a high-fidelity robustness benchmark leveraging generative pixel-aligned style transfer. By creating a visual stress test with negligible geometric deviation, we isolate the impact of appearance on driving performance. Our evaluation reveals that existing planning algorithms often show significant degradation under OOD appearance conditions, even when the underlying scene structure remains consistent. To bridge this gap, we propose a universal perception interface leveraging a frozen visual foundation model (DINOv3). By extracting appearance-invariant features as a stable interface for the planner, we achieve exceptional zero-shot generalization across diverse planning paradigms, including regression-based, diffusion-based, and scoring-based models. Our plug-and-play solution maintains consistent performance across extreme appearance shifts without requiring further fine-tuning. The benchmark and code will be made available.
title The Constant Eye: Benchmarking and Bridging Appearance Robustness in Autonomous Driving
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.12563