Runtime Safety Monitoring of Deep Neural Networks for Perception: A Survey

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schotschneider, Albert, Pavlitska, Svetlana, Zöllner, J. Marius
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911255557570560
author Schotschneider, Albert
Pavlitska, Svetlana
Zöllner, J. Marius
author_facet Schotschneider, Albert
Pavlitska, Svetlana
Zöllner, J. Marius
contents Deep neural networks (DNNs) are widely used in perception systems for safety-critical applications, such as autonomous driving and robotics. However, DNNs remain vulnerable to various safety concerns, including generalization errors, out-of-distribution (OOD) inputs, and adversarial attacks, which can lead to hazardous failures. This survey provides a comprehensive overview of runtime safety monitoring approaches, which operate in parallel to DNNs during inference to detect these safety concerns without modifying the DNN itself. We categorize existing methods into three main groups: Monitoring inputs, internal representations, and outputs. We analyze the state-of-the-art for each category, identify strengths and limitations, and map methods to the safety concerns they address. In addition, we highlight open challenges and future research directions.
format Preprint
id arxiv_https___arxiv_org_abs_2511_05982
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Runtime Safety Monitoring of Deep Neural Networks for Perception: A Survey
Schotschneider, Albert
Pavlitska, Svetlana
Zöllner, J. Marius
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Robotics
Deep neural networks (DNNs) are widely used in perception systems for safety-critical applications, such as autonomous driving and robotics. However, DNNs remain vulnerable to various safety concerns, including generalization errors, out-of-distribution (OOD) inputs, and adversarial attacks, which can lead to hazardous failures. This survey provides a comprehensive overview of runtime safety monitoring approaches, which operate in parallel to DNNs during inference to detect these safety concerns without modifying the DNN itself. We categorize existing methods into three main groups: Monitoring inputs, internal representations, and outputs. We analyze the state-of-the-art for each category, identify strengths and limitations, and map methods to the safety concerns they address. In addition, we highlight open challenges and future research directions.
title Runtime Safety Monitoring of Deep Neural Networks for Perception: A Survey
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Robotics
url https://arxiv.org/abs/2511.05982