Cover Image

An Evaluation of Representation Learning Methods in Particle Physics Foundation Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Michael, Kansal, Raghav, Gandrakota, Abhijith, Hao, Zichun, Ngadiuba, Jennifer, Spiropulu, Maria
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RINO: Renormalization Group Invariance with No Labels
by: Hao, Zichun, et al.
Published: (2025)

Robust Anomaly Detection for Particle Physics Using Multi-Background Representation Learning
by: Gandrakota, Abhijith, et al.
Published: (2024)

Real-time Anomaly Detection at the L1 Trigger of CMS Experiment
by: Gandrakota, Abhijith
Published: (2024)

Fast Jet Tagging with MLP-Mixers on FPGAs
by: Sun, Chang, et al.
Published: (2025)

Sub-microsecond Transformers for Jet Tagging on FPGAs
by: Laatu, Lauri, et al.
Published: (2025)

Spatially Aware Linear Transformer (SAL-T) for Particle Jet Tagging
by: Wang, Aaron, et al.
Published: (2025)

Interpreting Transformers for Jet Tagging
by: Wang, Aaron, et al.
Published: (2024)

HGQ: High Granularity Quantization for Real-time Neural Networks on FPGAs
by: Sun, Chang, et al.
Published: (2024)

Patch Hierarchical Attention Transformer for Efficient Particle Jet Tagging
by: Wang, Aaron, et al.
Published: (2026)

Canonicalizing Multimodal Contrastive Representation Learning
by: Gupta, Sharut, et al.
Published: (2026)

Why Is Attention Sparse In Particle Transformer?
by: Legge, Timothy, et al.
Published: (2025)

FLAME-MoE: A Transparent End-to-End Research Platform for Mixture-of-Experts Language Models
by: Kang, Hao, et al.
Published: (2025)

Learning Symmetry-Independent Jet Representations via Jet-Based Joint Embedding Predictive Architecture
by: Katel, Subash, et al.
Published: (2024)

RePro: Training Language Models to Faithfully Recycle the Web for Pretraining
by: Yu, Zichun, et al.
Published: (2025)

CLOUD: A Scalable and Physics-Informed Foundation Model for Crystal Representation Learning
by: Xu, Changwen, et al.
Published: (2025)

Parametric Dynamic Mode Decomposition with multi-linear interpolation for prediction of thermal fields of Al2O3-water nanofluid flows at unseen parameters
by: S, Abhijith M, et al.
Published: (2025)

Model-Free Approximate Bayesian Learning for Large-Scale Conversion Funnel Optimization
by: Iyengar, Garud, et al.
Published: (2024)

ABBA-Adapters: Efficient and Expressive Fine-Tuning of Foundation Models
by: Singhal, Raghav, et al.
Published: (2025)

MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models
by: Yu, Zichun, et al.
Published: (2024)

Position: Foundation Models Need Digital Twin Representations
by: Shen, Yiqing, et al.
Published: (2025)

AURORA: Contextual Orthogonalization for Geometric Representation Learning in Healthcare Foundation Models
by: Zhang, Yuanyun, et al.
Published: (2026)

Bumblebee: Foundation Model for Particle Physics Discovery
by: Wildridge, Andrew J., et al.
Published: (2024)

Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning
by: Li, Xiaochuan, et al.
Published: (2024)

AI Foundation Model for Time Series with Innovations Representation
by: Tong, Lang, et al.
Published: (2025)

Representation Learning of Structured Data for Medical Foundation Models
by: Dwivedi, Vijay Prakash, et al.
Published: (2024)

Training-Free Imitation Learning with Closed-Form Diffusion Policies
by: Mishra, Raghav, et al.
Published: (2026)

Exploring Representations and Interventions in Time Series Foundation Models
by: Wiliński, Michał, et al.
Published: (2024)

RAVEL: Evaluating Interpretability Methods on Disentangling Language Model Representations
by: Huang, Jing, et al.
Published: (2024)

Uni-NTFM: A Unified Foundation Model for EEG Signal Representation Learning
by: Chen, Zhisheng, et al.
Published: (2025)

Linking Properties to Microstructure in Liquid Metal Embedded Elastomers via Machine Learning
by: Anantharanga, Abhijith Thoopul, et al.
Published: (2022)

Variational Pseudo Marginal Methods for Jet Reconstruction in Particle Physics
by: Yang, Hanming, et al.
Published: (2024)

Automated Capability Evaluation of Foundation Models
by: Afkanpour, Arash, et al.
Published: (2025)

Generating Pretraining Tokens from Organic Data for Data-Bound Scaling
by: Yu, Zichun, et al.
Published: (2026)

FeDaL: Federated Dataset Learning for General Time Series Foundation Models
by: Chen, Shengchao, et al.
Published: (2025)

Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Models
by: Rajendran, Goutham, et al.
Published: (2024)

Discrete Diffusion with Sample-Efficient Estimators for Conditionals
by: Elamvazhuthi, Karthik, et al.
Published: (2026)

Aspen Open Jets: Unlocking LHC Data for Foundation Models in Particle Physics
by: Amram, Oz, et al.
Published: (2024)

Small Language Models for Agentic Systems: A Survey of Architectures, Capabilities, and Deployment Trade offs
by: Sharma, Raghav, et al.
Published: (2025)

Comparative Evaluation of Clustered Federated Learning Methods
by: Ali, Michael Ben, et al.
Published: (2024)

Theoretical Foundations of Representation Learning using Unlabeled Data: Statistics and Optimization
by: Esser, Pascal, et al.
Published: (2025)