Cover Image

When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yee, Brandon, Koh, Pairie, Rodriguez, Jack, Tekal, Mihir
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Numerical Analysis Computational Physics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solvers
by: Zhou, Hang, et al.
Published: (2024)

CATO: Charted Attention for Neural PDE Operators
by: Cheng, Chun-Wun, et al.
Published: (2026)

Physics-Informed Inference Time Scaling for Solving High-Dimensional PDE via Defect Correction
by: Fan, Zexi, et al.
Published: (2025)

Beyond Loss Guidance: Using PDE Residuals as Spectral Attention in Diffusion Neural Operators
by: Sawhney, Medha, et al.
Published: (2025)

Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems
by: Li, Rui, et al.
Published: (2024)

AttNS: Attention-Inspired Numerical Solving For Limited Data Scenarios
by: Huang, Zhongzhan, et al.
Published: (2023)

DiffusionPDE: Generative PDE-Solving Under Partial Observation
by: Huang, Jiahe, et al.
Published: (2024)

AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computing
by: Du, Jianda, et al.
Published: (2026)

STNet: Spectral Transformation Network for Solving Operator Eigenvalue Problem
by: Wang, Hong, et al.
Published: (2025)

FAST: Factorizable Attention for Speeding up Transformers
by: Gerami, Armin, et al.
Published: (2024)

Kinetic-based regularization: Learning spatial derivatives and PDE applications
by: Ganguly, Abhisek, et al.
Published: (2026)

Better Neural PDE Solvers Through Data-Free Mesh Movers
by: Hu, Peiyan, et al.
Published: (2023)

Moving Sampling Physics-informed Neural Networks induced by Moving Mesh PDE
by: Yang, Yu, et al.
Published: (2023)

CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operators
by: Hou, Xianglong, et al.
Published: (2025)

CodePDE: An Inference Framework for LLM-driven PDE Solver Generation
by: Li, Shanda, et al.
Published: (2025)

Benchmarking Emergent Coordination in Large-Scale LLM Populations: An Evaluation Framework on the MoltBook Archive
by: Yee, Brandon, et al.
Published: (2026)

PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Laws
by: Yang, Liu, et al.
Published: (2024)

P$^2$C$^2$Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamics
by: Wang, Qi, et al.
Published: (2024)

Solving PDEs With Deep Neural Nets under General Boundary Conditions
by: Zhang, Chenggong
Published: (2025)

Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learning
by: Mustajab, Abdul Hannan, et al.
Published: (2024)

KAN versus MLP on Irregular or Noisy Functions
by: Zeng, Chen, et al.
Published: (2024)

Calibrating Behavioral Parameters with Large Language Models
by: Yee, Brandon, et al.
Published: (2026)

DeepContour: A Hybrid Deep Learning Framework for Accelerating Generalized Eigenvalue Problem Solving via Efficient Contour Design
by: Chen, Yeqiu, et al.
Published: (2025)

A Mathematical Explanation of Transformers
by: Tai, Xue-Cheng, et al.
Published: (2025)

SPIKE: Stable Physics-Informed Kernel Evolution Method for Solving Hyperbolic Conservation Laws
by: Su, Hua, et al.
Published: (2025)

Flexible SE(2) graph neural networks with applications to PDE surrogates
by: Bånkestad, Maria, et al.
Published: (2024)

Sparse $L^1$-Autoencoders for Scientific Data Compression
by: Chung, Matthias, et al.
Published: (2024)

LieSolver: A PDE-constrained solver for IBVPs using Lie symmetries
by: Klausen, René P., et al.
Published: (2025)

Deriving Transformer Architectures as Implicit Multinomial Regression
by: Actor, Jonas A., et al.
Published: (2025)

AlgoFormer: An Efficient Transformer Framework with Algorithmic Structures
by: Gao, Yihang, et al.
Published: (2024)

Accelerating Matrix Diagonalization through Decision Transformers with Epsilon-Greedy Optimization
by: Bhatta, Kshitij, et al.
Published: (2024)

Core-Halo Decomposition: Decentralizing Large-Scale Fixed-Point Problems
by: Haixiang, et al.
Published: (2026)

Mixture-of-Experts Operator Transformer for Large-Scale PDE Pre-Training
by: Wang, Hong, et al.
Published: (2025)

Latent Neural Operator for Solving Forward and Inverse PDE Problems
by: Wang, Tian, et al.
Published: (2024)

PI-JEPA: Label-Free Surrogate Pretraining for Coupled Multiphysics Simulation via Operator-Split Latent Prediction
by: Yee, Brandon, et al.
Published: (2026)

DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training
by: Hao, Zhongkai, et al.
Published: (2024)

Generative Neural Reparameterization for Differentiable PDE-constrained Optimization
by: Joglekar, Archis S.
Published: (2024)

Online Pseudo-average Shifting Attention(PASA) for Robust Low-precision LLM Inference: Algorithms and Numerical Analysis
by: Cheng, Long, et al.
Published: (2025)

MC$^2$: Monte Carlo Correction for Fast Elliptic PDE Solving
by: Hsu, Ethan, et al.
Published: (2026)

Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generation
by: Zhang, Yi, et al.
Published: (2025)