Cover Image

Beyond Loss Guidance: Using PDE Residuals as Spectral Attention in Diffusion Neural Operators

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sawhney, Medha, Neog, Abhilash, Khurana, Mridul, Karpatne, Anuj
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Numerical Analysis
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CATO: Charted Attention for Neural PDE Operators
by: Cheng, Chun-Wun, et al.
Published: (2026)

CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operators
by: Hou, Xianglong, et al.
Published: (2025)

Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solvers
by: Zhou, Hang, et al.
Published: (2024)

Better Neural PDE Solvers Through Data-Free Mesh Movers
by: Hu, Peiyan, et al.
Published: (2023)

Moving Sampling Physics-informed Neural Networks induced by Moving Mesh PDE
by: Yang, Yu, et al.
Published: (2023)

PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Laws
by: Yang, Liu, et al.
Published: (2024)

STNet: Spectral Transformation Network for Solving Operator Eigenvalue Problem
by: Wang, Hong, et al.
Published: (2025)

Learning from Integral Losses in Physics Informed Neural Networks
by: Saleh, Ehsan, et al.
Published: (2023)

Neural Operators with Localized Integral and Differential Kernels
by: Liu-Schiaffini, Miguel, et al.
Published: (2024)

Autoregression-Free Neural Operators for Time-Dependent PDEs
by: Zhang, Jiaquan, et al.
Published: (2026)

Monte Carlo-Type Neural Operator for Differential Equations
by: Choutri, Salah Eddine, et al.
Published: (2025)

Kinetic-based regularization: Learning spatial derivatives and PDE applications
by: Ganguly, Abhisek, et al.
Published: (2026)

When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains
by: Yee, Brandon, et al.
Published: (2026)

DiffusionPDE: Generative PDE-Solving Under Partial Observation
by: Huang, Jiahe, et al.
Published: (2024)

Accelerating Data Generation for Neural Operators via Krylov Subspace Recycling
by: Wang, Hong, et al.
Published: (2024)

DeltaPhi: Physical States Residual Learning for Neural Operators in Data-Limited PDE Solving
by: Yue, Xihang, et al.
Published: (2024)

AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computing
by: Du, Jianda, et al.
Published: (2026)

TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation
by: Monsefi, Amin Karimi, et al.
Published: (2025)

Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilation
by: Singh, Ashutosh, et al.
Published: (2024)

Intrinsic Dimension Estimating Autoencoder (IDEA) Using CancelOut Layer and a Projected Loss
by: Oriou, Antoine, et al.
Published: (2025)

Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems
by: Li, Rui, et al.
Published: (2024)

CodePDE: An Inference Framework for LLM-driven PDE Solver Generation
by: Li, Shanda, et al.
Published: (2025)

Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learning
by: Berner, Julius, et al.
Published: (2025)

P$^2$C$^2$Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamics
by: Wang, Qi, et al.
Published: (2024)

One Operator to Rule Them All? On Boundary-Indexed Operator Families in Neural PDE Solvers
by: Shikhman, Lennon J.
Published: (2026)

ProFlow: Zero-Shot Physics-Consistent Sampling via Proximal Flow Guidance
by: Yu, Zichao, et al.
Published: (2026)

Learning to Discover Iterative Spectral Algorithms
by: Liu, Zihang, et al.
Published: (2026)

Accelerated Gradient-based Design Optimization Via Differentiable Physics-Informed Neural Operator: A Composites Autoclave Processing Case Study
by: Patel, Janak M., et al.
Published: (2025)

Neural Operators as Efficient Function Interpolators
by: Niarchos, Vasilis, et al.
Published: (2026)

Generative Neural Reparameterization for Differentiable PDE-constrained Optimization
by: Joglekar, Archis S.
Published: (2024)

Operator learning without the adjoint
by: Boullé, Nicolas, et al.
Published: (2024)

Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generation
by: Zhang, Yi, et al.
Published: (2025)

A Mathematical Guide to Operator Learning
by: Boullé, Nicolas, et al.
Published: (2023)

Physics-Informed Inference Time Scaling for Solving High-Dimensional PDE via Defect Correction
by: Fan, Zexi, et al.
Published: (2025)

Spectral Informed Neural Network: An Efficient and Low-Memory PINN
by: Yu, Tianchi, et al.
Published: (2024)

FAST: Factorizable Attention for Speeding up Transformers
by: Gerami, Armin, et al.
Published: (2024)

Projection Methods for Operator Learning and Universal Approximation
by: Zappala, Emanuele
Published: (2024)

Mixture of Experts Softens the Curse of Dimensionality in Operator Learning
by: Kratsios, Anastasis, et al.
Published: (2024)

AttNS: Attention-Inspired Numerical Solving For Limited Data Scenarios
by: Huang, Zhongzhan, et al.
Published: (2023)

Critical Sampling for Robust Evolution Operator Learning of Unknown Dynamical Systems
by: Zhang, Ce, et al.
Published: (2023)