On Improving Deep Active Learning with Formal Verification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Spiegelman, Jonathan, Amir, Guy, Katz, Guy
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911322205061120
author Spiegelman, Jonathan
Amir, Guy
Katz, Guy
author_facet Spiegelman, Jonathan
Amir, Guy
Katz, Guy
contents Deep Active Learning (DAL) aims to reduce labeling costs in neural-network training by prioritizing the most informative unlabeled samples for annotation. Beyond selecting which samples to label, several DAL approaches further enhance data efficiency by augmenting the training set with synthetic inputs that do not require additional manual labeling. In this work, we investigate how augmenting the training data with adversarial inputs that violate robustness constraints can improve DAL performance. We show that adversarial examples generated via formal verification contribute substantially more than those produced by standard, gradient-based attacks. We apply this extension to multiple modern DAL techniques, as well as to a new technique that we propose, and show that it yields significant improvements in model generalization across standard benchmarks.
format Preprint
id arxiv_https___arxiv_org_abs_2512_14170
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On Improving Deep Active Learning with Formal Verification
Spiegelman, Jonathan
Amir, Guy
Katz, Guy
Machine Learning
Logic in Computer Science
Deep Active Learning (DAL) aims to reduce labeling costs in neural-network training by prioritizing the most informative unlabeled samples for annotation. Beyond selecting which samples to label, several DAL approaches further enhance data efficiency by augmenting the training set with synthetic inputs that do not require additional manual labeling. In this work, we investigate how augmenting the training data with adversarial inputs that violate robustness constraints can improve DAL performance. We show that adversarial examples generated via formal verification contribute substantially more than those produced by standard, gradient-based attacks. We apply this extension to multiple modern DAL techniques, as well as to a new technique that we propose, and show that it yields significant improvements in model generalization across standard benchmarks.
title On Improving Deep Active Learning with Formal Verification
topic Machine Learning
Logic in Computer Science
url https://arxiv.org/abs/2512.14170