Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Krzmanc, Gregor, Mikuni, Vinicius, Nachman, Benjamin, Wilkinson, Callum
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915936403980288
author Krzmanc, Gregor
Mikuni, Vinicius
Nachman, Benjamin
Wilkinson, Callum
author_facet Krzmanc, Gregor
Mikuni, Vinicius
Nachman, Benjamin
Wilkinson, Callum
contents Future AI-based studies in particle physics will likely start from a foundation model to accelerate training and enhance sensitivity. As a step towards a general-purpose foundation model for particle physics, we investigate whether the OmniLearned foundation model pre-trained on diverse high-$Q^2$ simulated and real $pp$ and $ep$ collisions can be effectively transferred to a few-GeV fixed-target neutrino experiment. We process MINERvA neutrino--nucleus scattering events and evaluate pre-trained models on two types of tasks: regression of available energy and binary classification of charged-current pion final states ($\mathrm{CC1π^{\pm}}$, $\mathrm{CCNπ^{\pm}}$, and $\mathrm{CC1π^{0}}$). Pre-trained OmniLearned models consistently outperform similarly sized models trained from scratch, achieving better overall performance at the same compute budget, as well as achieving better performance at the same number of training steps. These results suggest that particle-level foundation models acquire inductive biases that generalize across large differences in energy scale, detector technology, and underlying physics processes, pointing toward a paradigm of detector-agnostic inference in particle physics.
format Preprint
id arxiv_https___arxiv_org_abs_2604_12364
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions
Krzmanc, Gregor
Mikuni, Vinicius
Nachman, Benjamin
Wilkinson, Callum
High Energy Physics - Experiment
Machine Learning
High Energy Physics - Phenomenology
Data Analysis, Statistics and Probability
Future AI-based studies in particle physics will likely start from a foundation model to accelerate training and enhance sensitivity. As a step towards a general-purpose foundation model for particle physics, we investigate whether the OmniLearned foundation model pre-trained on diverse high-$Q^2$ simulated and real $pp$ and $ep$ collisions can be effectively transferred to a few-GeV fixed-target neutrino experiment. We process MINERvA neutrino--nucleus scattering events and evaluate pre-trained models on two types of tasks: regression of available energy and binary classification of charged-current pion final states ($\mathrm{CC1π^{\pm}}$, $\mathrm{CCNπ^{\pm}}$, and $\mathrm{CC1π^{0}}$). Pre-trained OmniLearned models consistently outperform similarly sized models trained from scratch, achieving better overall performance at the same compute budget, as well as achieving better performance at the same number of training steps. These results suggest that particle-level foundation models acquire inductive biases that generalize across large differences in energy scale, detector technology, and underlying physics processes, pointing toward a paradigm of detector-agnostic inference in particle physics.
title Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions
topic High Energy Physics - Experiment
Machine Learning
High Energy Physics - Phenomenology
Data Analysis, Statistics and Probability
url https://arxiv.org/abs/2604.12364