Saved in:
Bibliographic Details
Main Authors: Bechtle, Philip, Flek, Lucie, Jung, Philipp Alexander, Karimi, Akbar, Saala, Timo, Schmidt, Alexander, Schott, Matthias, Soldin, Philipp, Wiebusch, Christopher, Willemsen, Ulrich
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.13970
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914457253314560
author Bechtle, Philip
Flek, Lucie
Jung, Philipp Alexander
Karimi, Akbar
Saala, Timo
Schmidt, Alexander
Schott, Matthias
Soldin, Philipp
Wiebusch, Christopher
Willemsen, Ulrich
author_facet Bechtle, Philip
Flek, Lucie
Jung, Philipp Alexander
Karimi, Akbar
Saala, Timo
Schmidt, Alexander
Schott, Matthias
Soldin, Philipp
Wiebusch, Christopher
Willemsen, Ulrich
contents In High Energy Physics, as in many other fields of science, the application of machine learning techniques has been crucial in advancing our understanding of fundamental phenomena. Increasingly, deep learning models are applied to analyze both simulated and experimental data. In most experiments, a rigorous regime of testing for physically motivated systematic uncertainties is in place. The numerical evaluation of these tests for differences between the data on the one side and simulations on the other side quantifies the effect of potential sources of mismodelling on the machine learning output. In addition, thorough comparisons of marginal distributions and (linear) feature correlations between data and simulation in "control regions" are applied. However, the guidance by physical motivation, and the need to constrain comparisons to specific regions, does not guarantee that all possible sources of deviations have been accounted for. We therefore propose a new adversarial attack - the CONSERVAttack - designed to exploit the remaining space of hypothetical deviations between simulation and data after the above mentioned tests. The resulting adversarial perturbations are consistent within the uncertainty bounds - evading standard validation checks - while successfully fooling the underlying model. We further propose strategies to mitigate such vulnerabilities and argue that robustness to adversarial effects must be considered when interpreting results from deep learning in particle physics.
format Preprint
id arxiv_https___arxiv_org_abs_2603_13970
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Shapes are not enough: CONSERVAttack and its use for finding vulnerabilities and uncertainties in machine learning applications
Bechtle, Philip
Flek, Lucie
Jung, Philipp Alexander
Karimi, Akbar
Saala, Timo
Schmidt, Alexander
Schott, Matthias
Soldin, Philipp
Wiebusch, Christopher
Willemsen, Ulrich
Machine Learning
High Energy Physics - Experiment
In High Energy Physics, as in many other fields of science, the application of machine learning techniques has been crucial in advancing our understanding of fundamental phenomena. Increasingly, deep learning models are applied to analyze both simulated and experimental data. In most experiments, a rigorous regime of testing for physically motivated systematic uncertainties is in place. The numerical evaluation of these tests for differences between the data on the one side and simulations on the other side quantifies the effect of potential sources of mismodelling on the machine learning output. In addition, thorough comparisons of marginal distributions and (linear) feature correlations between data and simulation in "control regions" are applied. However, the guidance by physical motivation, and the need to constrain comparisons to specific regions, does not guarantee that all possible sources of deviations have been accounted for. We therefore propose a new adversarial attack - the CONSERVAttack - designed to exploit the remaining space of hypothetical deviations between simulation and data after the above mentioned tests. The resulting adversarial perturbations are consistent within the uncertainty bounds - evading standard validation checks - while successfully fooling the underlying model. We further propose strategies to mitigate such vulnerabilities and argue that robustness to adversarial effects must be considered when interpreting results from deep learning in particle physics.
title Shapes are not enough: CONSERVAttack and its use for finding vulnerabilities and uncertainties in machine learning applications
topic Machine Learning
High Energy Physics - Experiment
url https://arxiv.org/abs/2603.13970