Talking with Verifiers: Automatic Specification Generation for Neural Network Verification

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Elboher, Yizhak Y., Peleg, Reuven, Shi, Zhouxing, Katz, Guy, Křetínský, Jan
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910038781591552
author Elboher, Yizhak Y.
Peleg, Reuven
Shi, Zhouxing
Katz, Guy
Křetínský, Jan
author_facet Elboher, Yizhak Y.
Peleg, Reuven
Shi, Zhouxing
Katz, Guy
Křetínský, Jan
contents Neural network verification tools currently support only a narrow class of specifications, typically expressed as low-level constraints over raw inputs and outputs. This limitation significantly hinders their adoption and practical applicability across diverse application domains where correctness requirements are naturally expressed at a higher semantic level. This challenge is rooted in the inherent nature of deep neural networks, which learn internal representations that lack an explicit mapping to human-understandable features. To address this, we bridge this gap by introducing a novel component to the verification pipeline, making existing verification tools applicable to a broader range of domains and specification styles. Our framework enables users to formulate specifications in natural language, which are then automatically analyzed and translated into formal verification queries compatible with state-of-the-art neural network verifiers. We evaluate our approach on both structured and unstructured datasets, demonstrating that it successfully verifies complex semantic specifications that were previously inaccessible. Our results show that this translation process maintains high fidelity to user intent while incurring low computational overhead, thereby substantially extending the applicability of formal DNN verification to real-world, high-level requirements.
format Preprint
id arxiv_https___arxiv_org_abs_2603_02235
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Talking with Verifiers: Automatic Specification Generation for Neural Network Verification
Elboher, Yizhak Y.
Peleg, Reuven
Shi, Zhouxing
Katz, Guy
Křetínský, Jan
Machine Learning
Artificial Intelligence
Software Engineering
Neural network verification tools currently support only a narrow class of specifications, typically expressed as low-level constraints over raw inputs and outputs. This limitation significantly hinders their adoption and practical applicability across diverse application domains where correctness requirements are naturally expressed at a higher semantic level. This challenge is rooted in the inherent nature of deep neural networks, which learn internal representations that lack an explicit mapping to human-understandable features. To address this, we bridge this gap by introducing a novel component to the verification pipeline, making existing verification tools applicable to a broader range of domains and specification styles. Our framework enables users to formulate specifications in natural language, which are then automatically analyzed and translated into formal verification queries compatible with state-of-the-art neural network verifiers. We evaluate our approach on both structured and unstructured datasets, demonstrating that it successfully verifies complex semantic specifications that were previously inaccessible. Our results show that this translation process maintains high fidelity to user intent while incurring low computational overhead, thereby substantially extending the applicability of formal DNN verification to real-world, high-level requirements.
title Talking with Verifiers: Automatic Specification Generation for Neural Network Verification
topic Machine Learning
Artificial Intelligence
Software Engineering
url https://arxiv.org/abs/2603.02235