Imagen de Portada

Physics-Guided Transformer (PGT): Physics-Aware Attention Mechanism for PINNs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zeraatkar, Ehsan, Podorozhny, Rodion, Tešić, Jelena
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Energy-Efficient Transformer Inference: Optimization Strategies for Time Series Classification
por: Kermani, Arshia, et al.
Publicado: (2025)

Frequency-Aware Vision Transformers for High-Fidelity Super-Resolution of Earth System Models
por: Zeraatkar, Ehsan, et al.
Publicado: (2025)

ViSIR: Vision Transformer Single Image Reconstruction Method for Earth System Models
por: Zeraatkar, Ehsan, et al.
Publicado: (2025)

Physics-Guided Tiny-Mamba Transformer for Reliability-Aware Early Fault Warning
por: Li, Changyu, et al.
Publicado: (2026)

Continuous-Time Attention: PDE-Guided Mechanisms for Long-Sequence Transformers
por: Zhang, Yukun, et al.
Publicado: (2025)

Mask-PINNs: Mitigating Internal Covariate Shift in Physics-Informed Neural Networks
por: Jiang, Feilong, et al.
Publicado: (2025)

FAMOUS: Flexible Accelerator for the Attention Mechanism of Transformer on UltraScale+ FPGAs
por: Kabir, Ehsan, et al.
Publicado: (2024)

Transolver is a Linear Transformer: Revisiting Physics-Attention through the Lens of Linear Attention
por: Hu, Wenjie, et al.
Publicado: (2025)

From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learning
por: Toscano, Juan Diego, et al.
Publicado: (2024)

Outperforming Self-Attention Mechanisms in Solar Irradiance Forecasting via Physics-Guided Neural Networks
por: Abdullah, Mohammed Ezzaldin Babiker, et al.
Publicado: (2026)

SEA: State-Exchange Attention for High-Fidelity Physics Based Transformers
por: Esmati, Parsa, et al.
Publicado: (2024)

Feature Mapping in Physics-Informed Neural Networks (PINNs)
por: Zeng, Chengxi, et al.
Publicado: (2024)

Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture
por: Burden, John, et al.
Publicado: (2025)

Dispatch-Aware Ragged Attention for Pruned Vision Transformers
por: Abdellatif, Seifeldin, et al.
Publicado: (2026)

Object-Centric World Models Meet Monte Carlo Tree Search
por: Vakhitov, Rodion, et al.
Publicado: (2026)

Physics-Informed Teleconnection-Aware Transformer for Global Subseasonal-to-Seasonal Forecasting
por: Lyu, Tengfei, et al.
Publicado: (2025)

PGT-I: Scaling Spatiotemporal GNNs with Memory-Efficient Distributed Training
por: Ockerman, Seth, et al.
Publicado: (2025)

Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning
por: Luo, Yi, et al.
Publicado: (2026)

Physics-Guided Multimodal Transformers are the Necessary Foundation for the Next Generation of Meteorological Science
por: Han, Jing, et al.
Publicado: (2025)

KAN KAN Buff Signed Graph Neural Networks?
por: Shebaro, Muhieddine, et al.
Publicado: (2025)

Unveiling the optimization process of Physics Informed Neural Networks: How accurate and competitive can PINNs be?
por: Urbán, Jorge F., et al.
Publicado: (2024)

Noisy PDE Training Requires Bigger PINNs
por: Andre-Sloan, Sebastien, et al.
Publicado: (2025)

GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers
por: Miyato, Takeru, et al.
Publicado: (2023)

Linear Transformers as VAR Models: Aligning Autoregressive Attention Mechanisms with Autoregressive Forecasting
por: Lu, Jiecheng, et al.
Publicado: (2025)

REAct: Rational Exponential Activation for Better Learning and Generalization in PINNs
por: Mishra, Sourav, et al.
Publicado: (2025)

DGTN: Graph-Enhanced Transformer with Diffusive Attention Gating Mechanism for Enzyme DDG Prediction
por: Lin, Abigail
Publicado: (2025)

Towards Physics-Guided Foundation Models
por: Farhadloo, Majid, et al.
Publicado: (2025)

SimFair: Physics-Guided Fairness-Aware Learning with Simulation Models
por: Wang, Zhihao, et al.
Publicado: (2024)

Linear Attention with Global Context: A Multipole Attention Mechanism for Vision and Physics
por: Colagrande, Alex, et al.
Publicado: (2025)

Learning From High-Dimensional Cyber-Physical Data Streams for Diagnosing Faults in Smart Grids
por: Hassani, Hossein, et al.
Publicado: (2023)

Integrating Locality-Aware Attention with Transformers for General Geometry PDEs
por: Koh, Minsu, et al.
Publicado: (2025)

VSFormer: Value and Shape-Aware Transformer with Prior-Enhanced Self-Attention for Multivariate Time Series Classification
por: Xi, Wenjie, et al.
Publicado: (2024)

SG-XDEAT: Sparsity-Guided Cross-Dimensional and Cross-Encoding Attention with Target-Aware Conditioning in Tabular Learning
por: Cheng, Chih-Chuan, et al.
Publicado: (2025)

Quantifying constraint hierarchies in Bayesian PINNs via per-constraint Hessian decomposition
por: Landgren, Filip
Publicado: (2025)

The Bayesian Geometry of Transformer Attention
por: Agarwal, Naman, et al.
Publicado: (2025)

Physics-Guided Geometric Diffusion for Macro Placement Generation
por: Yoon, Jongho, et al.
Publicado: (2026)

Physics-Guided Memory Network for Building Energy Modeling
por: Danish, Muhammad Umair, et al.
Publicado: (2025)

Precision Tracked Transformer via Kalman Filtering, Kriging and Process Noise
por: Long, Bo, et al.
Publicado: (2026)

Do Physics Foundation Models Learn Generalizable Physics? A Bias-Aware Benchmark Across Physical Regimes and Distribution Shifts
por: Chu, Mengdi, et al.
Publicado: (2026)

When and Why Adversarial Training Improves PINNs: A Neural Tangent Kernel Perspective
por: Cao, Yuan-dong, et al.
Publicado: (2026)