Cover Image

Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behavior

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Subramanian, Shashank, Harrington, Peter, Keutzer, Kurt, Bhimji, Wahid, Morozov, Dmitriy, Mahoney, Michael, Gholami, Amir
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Numerical Analysis
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SciML Agents: Write the Solver, Not the Solution
by: Gaonkar, Saarth, et al.
Published: (2025)

Recent and Upcoming Developments in Randomized Numerical Linear Algebra for Machine Learning
by: Dereziński, Michał, et al.
Published: (2024)

On Neural Scaling Laws for Weather Emulation through Continual Training
by: Subramanian, Shashank, et al.
Published: (2026)

A Variable Eddington Factor Model for Thermal Radiative Transfer with Closure based on Data-Driven Shape Function
by: Coale, Joseph M., et al.
Published: (2023)

A Reduced-Order Model for Nonlinear Radiative Transfer Problems Based on Moment Equations and POD-Petrov-Galerkin Projection of the Normalized Boltzmann Transport Equation
by: Coale, Joseph M., et al.
Published: (2023)

Optimal Space-Variant Anisotropic Tikhonov Regularization for Full Waveform Inversion of Sparse Data
by: Gholami, Ali, et al.
Published: (2025)

From LIF to QIF: Toward Differentiable Spiking Neurons for Scientific Machine Learning
by: Wan, Ruyin, et al.
Published: (2025)

Implicit Methods with Reduced Memory for Thermal Radiative Transfer
by: Anistratov, Dmitriy Y., et al.
Published: (2021)

Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEs
by: Mouli, S. Chandra, et al.
Published: (2024)

Multilevel Method with Low-Order Equations of Mixed Types and Two Grids in Photon Energy for Thermal Radiative Transfer
by: Anistratov, Dmitriy Y., et al.
Published: (2024)

Multilevel Method for Thermal Radiative Transfer Problems with Method of Long Characteristics for the Boltzmann Transport Equation
by: Coale, Joseph M., et al.
Published: (2023)

An extended Gauss-Newton method for full waveform inversion
by: Gholami, Ali
Published: (2023)

Reduced-Order Models for Thermal Radiative Transfer Based on POD-Galerkin Method and Low-Order Quasidiffusion Equations
by: Coale, Joseph M., et al.
Published: (2021)

A Nonlinear Projection-Based Iteration Scheme with Cycles over Multiple Time Steps for Solving Thermal Radiative Transfer Problems
by: Coale, Joseph M., et al.
Published: (2023)

Determinant Estimation under Memory Constraints and Neural Scaling Laws
by: Ameli, Siavash, et al.
Published: (2025)

Hybrid Surrogate Models: Circumventing Gibbs Phenomenon for Partial Differential Equations with Finite Shock-Type Discontinuities
by: Cardona, Juan-Esteban Suarez, et al.
Published: (2024)

Weak Form Scientific Machine Learning: Test Function Construction for System Identification
by: Tran, April, et al.
Published: (2025)

Nonlinear Iterative Projection Methods with Multigrid in Photon Frequency for Thermal Radiative Transfer
by: Anistratov, Dmitriy Y.
Published: (2020)

RELift: Learned Coarse-to-Fine Propagators for Time-Dependent PDEs with Applications to Electron Dynamics
by: Bassi, Hardeep, et al.
Published: (2025)

Convergence of Multi-Level Hybrid Monte Carlo Methods for 1-D Particle Transport Problems
by: Novellino, Vincent N., et al.
Published: (2025)

Analysis of Hybrid MC/Deterministic Methods for Transport Problems Based on Low-Order Equations Discretized by Finite Volume Schemes
by: Novellino, Vincent N., et al.
Published: (2024)

Reduced order models for nonlinear radiative transfer based on moment equations and POD/DMD of Eddington tensor
by: Coale, Joseph M., et al.
Published: (2021)

Weak maximum principle of finite element methods for parabolic equations in polygonal domains
by: Bai, Genming, et al.
Published: (2024)

A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions
by: Negrini, Elisa, et al.
Published: (2025)

Multilevel Iteration Method for Binary Stochastic Transport Problems
by: Anistratov, Dmitriy Y.
Published: (2021)

PDEformer: Towards a Foundation Model for One-Dimensional Partial Differential Equations
by: Ye, Zhanhong, et al.
Published: (2024)

CholeskyQR with Randomization and Pivoting for Tall Matrices (CQRRPT)
by: Melnichenko, Maksim, et al.
Published: (2023)

Machine Learning and Control: Foundations, Advances, and Perspectives
by: Zuazua, Enrique
Published: (2025)

Learning to Discover Iterative Spectral Algorithms
by: Liu, Zihang, et al.
Published: (2026)

Robust elastic full-waveform inversion using an alternating direction method of multipliers with reconstructed wavefields
by: Aghazade, Kamal, et al.
Published: (2024)

Hybrid Weight Window Techniques for Time-Dependent Monte Carlo Neutronics
by: Shaw, Caleb S., et al.
Published: (2025)

Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolation
by: Sun, Jingmin, et al.
Published: (2024)

Scale-Adaptive Generative Flows for Multiscale Scientific Data
by: Chen, Yifan, et al.
Published: (2025)

Reduced-order modeling of neutron transport separated in axial and radial space by Proper Generalized Decomposition with applications to nuclear reactor physics
by: Dominesey, Kurt A., et al.
Published: (2024)

OmniMol: Transferring Particle Physics Knowledge to Molecular Dynamics with Point-Edge Transformers
by: Elsharkawy, Ibrahim, et al.
Published: (2026)

Physics-Informed Machine Learning for Characterizing System Stability
by: Koike, Tomoki, et al.
Published: (2025)

Scientific Applications Leveraging Randomized Linear Algebra
by: Patel, Vivak, et al.
Published: (2025)

Reduced-Memory Methods for Linear Discontinuous Discretization of the Time-Dependent Boltzmann Transport Equation
by: Paye, Rylan C., et al.
Published: (2023)

Machine Learning for highly oscillatory differential equations
by: Bouchereau, Maxime
Published: (2026)

Isogeometric Simulation and Shape Optimization with Applications to Electrical Machines
by: Gangl, Peter, et al.
Published: (2018)