Saved in:
Bibliographic Details
Main Authors: Zhuo, Lifeng, Jin, Kefan, Liu, Zhe, Wang, Hesheng
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.09529
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914620103458816
author Zhuo, Lifeng
Jin, Kefan
Liu, Zhe
Wang, Hesheng
author_facet Zhuo, Lifeng
Jin, Kefan
Liu, Zhe
Wang, Hesheng
contents Bird's-eye-view (BEV) perception has emerged as a cornerstone of autonomous driving systems, providing a structured, ego-centric representation critical for downstream planning and control. However, real-world deployment faces challenges from sensor degradation and adversarial attacks, which can cause severe perceptual anomalies and ultimately compromise the safety of autonomous driving systems. To address this, we propose a resilient and plug-and-play BEV perception method, RESBev, which can be easily applied to existing BEV perception methods to enhance their robustness to diverse disturbances. Specifically, we reframe perception robustness as a latent semantic prediction problem. A latent world model is constructed to extract spatiotemporal correlations across sequential BEV observations, thereby learning the underlying BEV state transitions to predict clean BEV features for reconstructing corrupted observations. The proposed framework operates at the semantic feature level of the Lift-Splat-Shoot pipeline, enabling recovery that generalizes across both natural disturbances and adversarial attacks without modifying the underlying backbone. Extensive experiments on the nuScenes dataset demonstrate that, with few-shot fine-tuning, RESBev significantly improves the robustness of existing BEV perception models against various external disturbances and adversarial attacks.
format Preprint
id arxiv_https___arxiv_org_abs_2603_09529
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RESBev: Making BEV Perception More Robust
Zhuo, Lifeng
Jin, Kefan
Liu, Zhe
Wang, Hesheng
Computer Vision and Pattern Recognition
Bird's-eye-view (BEV) perception has emerged as a cornerstone of autonomous driving systems, providing a structured, ego-centric representation critical for downstream planning and control. However, real-world deployment faces challenges from sensor degradation and adversarial attacks, which can cause severe perceptual anomalies and ultimately compromise the safety of autonomous driving systems. To address this, we propose a resilient and plug-and-play BEV perception method, RESBev, which can be easily applied to existing BEV perception methods to enhance their robustness to diverse disturbances. Specifically, we reframe perception robustness as a latent semantic prediction problem. A latent world model is constructed to extract spatiotemporal correlations across sequential BEV observations, thereby learning the underlying BEV state transitions to predict clean BEV features for reconstructing corrupted observations. The proposed framework operates at the semantic feature level of the Lift-Splat-Shoot pipeline, enabling recovery that generalizes across both natural disturbances and adversarial attacks without modifying the underlying backbone. Extensive experiments on the nuScenes dataset demonstrate that, with few-shot fine-tuning, RESBev significantly improves the robustness of existing BEV perception models against various external disturbances and adversarial attacks.
title RESBev: Making BEV Perception More Robust
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.09529