Probabilistic Segmentation for Robust Field of View Estimation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hallyburton, R. Spencer, Hunt, David, He, Yiwei, He, Judy, Pajic, Miroslav
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916648358772736
author Hallyburton, R. Spencer
Hunt, David
He, Yiwei
He, Judy
Pajic, Miroslav
author_facet Hallyburton, R. Spencer
Hunt, David
He, Yiwei
He, Judy
Pajic, Miroslav
contents Attacks on sensing and perception threaten the safe deployment of autonomous vehicles (AVs). Security-aware sensor fusion helps mitigate threats but requires accurate field of view (FOV) estimation which has not been evaluated autonomy. To address this gap, we adapt classical computer graphics algorithms to develop the first autonomy-relevant FOV estimators and create the first datasets with ground truth FOV labels. Unfortunately, we find that these approaches are themselves highly vulnerable to attacks on sensing. To improve robustness of FOV estimation against attacks, we propose a learning-based segmentation model that captures FOV features, integrates Monte Carlo dropout (MCD) for uncertainty quantification, and performs anomaly detection on confidence maps. We illustrate through comprehensive evaluations attack resistance and strong generalization across environments. Architecture trade studies demonstrate the model is feasible for real-time deployment in multiple applications.
format Preprint
id arxiv_https___arxiv_org_abs_2503_07375
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Probabilistic Segmentation for Robust Field of View Estimation
Hallyburton, R. Spencer
Hunt, David
He, Yiwei
He, Judy
Pajic, Miroslav
Computer Vision and Pattern Recognition
Machine Learning
Attacks on sensing and perception threaten the safe deployment of autonomous vehicles (AVs). Security-aware sensor fusion helps mitigate threats but requires accurate field of view (FOV) estimation which has not been evaluated autonomy. To address this gap, we adapt classical computer graphics algorithms to develop the first autonomy-relevant FOV estimators and create the first datasets with ground truth FOV labels. Unfortunately, we find that these approaches are themselves highly vulnerable to attacks on sensing. To improve robustness of FOV estimation against attacks, we propose a learning-based segmentation model that captures FOV features, integrates Monte Carlo dropout (MCD) for uncertainty quantification, and performs anomaly detection on confidence maps. We illustrate through comprehensive evaluations attack resistance and strong generalization across environments. Architecture trade studies demonstrate the model is feasible for real-time deployment in multiple applications.
title Probabilistic Segmentation for Robust Field of View Estimation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2503.07375