RINO: Renormalization Group Invariance with No Labels
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908649800073216 |
|---|---|
| author | Hao, Zichun Kansal, Raghav Gandrakota, Abhijith Sun, Chang Jennifer, Ngadiuba Duarte, Javier Spiropulu, Maria |
| author_facet | Hao, Zichun Kansal, Raghav Gandrakota, Abhijith Sun, Chang Jennifer, Ngadiuba Duarte, Javier Spiropulu, Maria |
| contents | A common challenge with supervised machine learning (ML) in high energy physics (HEP) is the reliance on simulations for labeled data, which can often mismodel the underlying collision or detector response. To help mitigate this problem of domain shift, we propose RINO (Renormalization Group Invariance with No Labels), a self-supervised learning approach that can instead pretrain models directly on collision data, learning embeddings invariant to renormalization group flow scales. In this work, we pretrain a transformer-based model on jets originating from quantum chromodynamic (QCD) interactions from the JetClass dataset, emulating real QCD-dominated experimental data, and then finetune on the JetNet dataset -- emulating simulations -- for the task of identifying jets originating from top quark decays. RINO demonstrates improved generalization from the JetNet training data to JetClass data compared to supervised training on JetNet from scratch, demonstrating the potential for RINO pretraining on real collision data followed by fine-tuning on small, high-quality MC datasets, to improve the robustness of ML models in HEP. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_07486 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RINO: Renormalization Group Invariance with No Labels Hao, Zichun Kansal, Raghav Gandrakota, Abhijith Sun, Chang Jennifer, Ngadiuba Duarte, Javier Spiropulu, Maria High Energy Physics - Experiment Machine Learning A common challenge with supervised machine learning (ML) in high energy physics (HEP) is the reliance on simulations for labeled data, which can often mismodel the underlying collision or detector response. To help mitigate this problem of domain shift, we propose RINO (Renormalization Group Invariance with No Labels), a self-supervised learning approach that can instead pretrain models directly on collision data, learning embeddings invariant to renormalization group flow scales. In this work, we pretrain a transformer-based model on jets originating from quantum chromodynamic (QCD) interactions from the JetClass dataset, emulating real QCD-dominated experimental data, and then finetune on the JetNet dataset -- emulating simulations -- for the task of identifying jets originating from top quark decays. RINO demonstrates improved generalization from the JetNet training data to JetClass data compared to supervised training on JetNet from scratch, demonstrating the potential for RINO pretraining on real collision data followed by fine-tuning on small, high-quality MC datasets, to improve the robustness of ML models in HEP. |
| title | RINO: Renormalization Group Invariance with No Labels |
| topic | High Energy Physics - Experiment Machine Learning |
| url | https://arxiv.org/abs/2509.07486 |