Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Valentin, Romeo, Katz, Sydney M., Carneiro, Artur B., Walker, Don, Kochenderfer, Mykel J.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909735834353664
author Valentin, Romeo
Katz, Sydney M.
Carneiro, Artur B.
Walker, Don
Kochenderfer, Mykel J.
author_facet Valentin, Romeo
Katz, Sydney M.
Carneiro, Artur B.
Walker, Don
Kochenderfer, Mykel J.
contents Recent advances in data-driven computer vision have enabled robust autonomous navigation capabilities for civil aviation, including automated landing and runway detection. However, ensuring that these systems meet the robustness and safety requirements for aviation applications remains a major challenge. In this work, we present a practical vision-based pipeline for aircraft pose estimation from runway images that represents a step toward the ability to certify these systems for use in safety-critical aviation applications. Our approach features three key innovations: (i) an efficient, flexible neural architecture based on a spatial Soft Argmax operator for probabilistic keypoint regression, supporting diverse vision backbones with real-time inference; (ii) a principled loss function producing calibrated predictive uncertainties, which are evaluated via sharpness and calibration metrics; and (iii) an adaptation of Residual-based Receiver Autonomous Integrity Monitoring (RAIM), enabling runtime detection and rejection of faulty model outputs. We implement and evaluate our pose estimation pipeline on a dataset of runway images. We show that our model outperforms baseline architectures in terms of accuracy while also producing well-calibrated uncertainty estimates with sub-pixel precision that can be used downstream for fault detection.
format Preprint
id arxiv_https___arxiv_org_abs_2508_09732
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System
Valentin, Romeo
Katz, Sydney M.
Carneiro, Artur B.
Walker, Don
Kochenderfer, Mykel J.
Computer Vision and Pattern Recognition
Robotics
Recent advances in data-driven computer vision have enabled robust autonomous navigation capabilities for civil aviation, including automated landing and runway detection. However, ensuring that these systems meet the robustness and safety requirements for aviation applications remains a major challenge. In this work, we present a practical vision-based pipeline for aircraft pose estimation from runway images that represents a step toward the ability to certify these systems for use in safety-critical aviation applications. Our approach features three key innovations: (i) an efficient, flexible neural architecture based on a spatial Soft Argmax operator for probabilistic keypoint regression, supporting diverse vision backbones with real-time inference; (ii) a principled loss function producing calibrated predictive uncertainties, which are evaluated via sharpness and calibration metrics; and (iii) an adaptation of Residual-based Receiver Autonomous Integrity Monitoring (RAIM), enabling runtime detection and rejection of faulty model outputs. We implement and evaluate our pose estimation pipeline on a dataset of runway images. We show that our model outperforms baseline architectures in terms of accuracy while also producing well-calibrated uncertainty estimates with sub-pixel precision that can be used downstream for fault detection.
title Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2508.09732