Cover Image

On the Value of Tokeniser Pretraining in Physics Foundation Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sotoudeh, Hadi, Mukhopadhyay, Payel, Ohana, Ruben, McCabe, Michael, Lawrence, Neil D., Ho, Shirley, Cranmer, Miles
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Instrumentation and Methods for Astrophysics Artificial Intelligence Computational Physics 68T07 (Primary) 68T05, 65M99, 65Z05, 62P35, 35Q35, 35Q31 (Secondary) I.2.6; I.6.5; I.6.4; I.2.10; G.1.8; F.2.1; I.5.1
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Physics-Informed Learning of Microvascular Flow Models using Graph Neural Networks
by: Botta, Paolo, et al.
Published: (2025)

QoSGMAA: A Robust Multi-Order Graph Attention and Adversarial Framework for Sparse QoS Prediction
by: Du, Guanchen, et al.
Published: (2025)

PDE-DKL: PDE-constrained deep kernel learning in high dimensionality
by: Yan, Weihao, et al.
Published: (2025)

Modeling Vehicle-Type-Specific Pedestrian Crash Avoidance Behavior in Safety-Critical Interactions Using Smooth-Mamba Deep Reinforcement Learning
by: Pu, Qingwen, et al.
Published: (2026)

Frequency Bias and OOD Generalization in Neural Operators under a Variable-Coefficient Wave Equation
by: Xie, Runlong, et al.
Published: (2026)

Learnable Viscosity Modulation in Physics-Informed Neural Networks for Incompressible Flow Reconstruction
by: Xu, Ke, et al.
Published: (2026)

FDQN: A Flexible Deep Q-Network Framework for Game Automation
by: Gujavarthy, Prabhath Reddy
Published: (2024)

Dynamic Hybrid Modeling: Incremental Identification and Model Predictive Control
by: Caspari, Adrian, et al.
Published: (2025)

Transformer self-attention encoder-decoder with multimodal deep learning for response time series forecasting and digital twin support in wind structural health monitoring
by: Zhou, Feiyu, et al.
Published: (2026)

Extracting Manifold Information from Point Clouds
by: Guidotti, Patrick
Published: (2024)

Predicting Anthropometric Body Composition Variables Using 3D Optical Imaging and Machine Learning
by: Agrahari, Gyaneshwar, et al.
Published: (2025)

Threat Detection in Social Media Networks Using Machine Learning Based Network Analysis
by: Agrawal, Aditi Sanjay
Published: (2026)

AgentFacts: Universal KYA Standard for Verified AI Agent Metadata & Deployment
by: Grogan, Jared James
Published: (2025)

CS-SHRED: Enhancing SHRED for Robust Recovery of Spatiotemporal Dynamics
by: da Silva, Romulo B., et al.
Published: (2025)

On the Structural Failure of Chamfer Distance in 3D Shape Optimization
by: Song, Chang-Yong, et al.
Published: (2026)

Tricks and Plug-ins for Gradient Boosting in Image Classification
by: Fang, Biyi, et al.
Published: (2025)

Multirate Stein Variational Gradient Descent for Efficient Bayesian Sampling
by: Sarshar, Arash
Published: (2026)

PACT: Reducing Alert Fatigue in Low-Prevalence SOC Streams with Triggered Active Learning
by: Ndichu, Samuel, et al.
Published: (2026)

Optimal Transport-Based Displacement Interpolation with Data Augmentation for Reduced Order Modeling of Nonlinear Dynamical Systems
by: Khamlich, Moaad, et al.
Published: (2024)

A geometric modelling framework to support the design of heterogeneous lattice structures with non-linearly varying geometry
by: Letov, Nikita, et al.
Published: (2026)

Adaptive Mixture Importance Sampling for Automated Ads Auction Tuning
by: Jia, Yimeng, et al.
Published: (2024)

ZetA: A Riemann Zeta-Scaled Extension of Adam for Deep Learning
by: BC, Samiksha
Published: (2025)

Accelerating wave simulations with neural dispersion correctors
by: Rincón, Felipe, et al.
Published: (2025)

Ultrahigh-Q chiral resonances empowered by multi-head attention deep learning
by: Zhang, Cong, et al.
Published: (2025)

PhysMorph-GS: Render-Guided Volumetric Morphing with Differentiable Physics
by: Song, Chang-Yong, et al.
Published: (2025)

GLL: A Differentiable Graph Learning Layer for Neural Networks
by: Brown, Jason, et al.
Published: (2024)

CaLoRAify: Calorie Estimation with Visual-Text Pairing and LoRA-Driven Visual Language Models
by: Yao, Dongyu, et al.
Published: (2024)

Design Patterns for Multilevel Modeling and Simulation
by: Serena, Luca, et al.
Published: (2024)

FUSE: A Flow-based Mapping Between Shapes
by: Olearo, Lorenzo, et al.
Published: (2025)

Robustness, Cost, and Attack-Surface Concentration in Phishing Detection
by: Allagan, Julian, et al.
Published: (2026)

Hybrid activation functions for deep neural networks: S3 and S4 -- a novel approach to gradient flow optimization
by: Kavun, Sergii
Published: (2025)

On Woolhouse's Cotton-Spinning Problem
by: Groote, Jan Friso, et al.
Published: (2024)

Model order reduction of hemodynamics by space-time reduced basis and reduced fluid-structure interaction
by: Tenderini, Riccardo, et al.
Published: (2025)

Efficient Fine-Tuning Methods for Portuguese Question Answering: A Comparative Study of PEFT on BERTimbau and Exploratory Evaluation of Generative LLMs
by: Nina, Mariela M., et al.
Published: (2026)

Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow prediction
by: Genuist, Wilfried, et al.
Published: (2025)

Monte Carlo sampling with integrator snippets
by: Andrieu, Christophe, et al.
Published: (2024)

Local properties of neural networks through the lens of layer-wise Hessians
by: Bolshim, Maxim, et al.
Published: (2025)

Inter-Layer Hessian Analysis of Neural Networks with DAG Architectures
by: Bolshim, Maxim, et al.
Published: (2026)

Stochastic Estimation of the Layer-wise Hessian Trace for Monitoring Neural-network Training
by: Bolshim, Maxim, et al.
Published: (2026)

Deep Operator Networks for Bayesian Parameter Estimation in PDEs
by: Raj, Amogh, et al.
Published: (2025)