Imagen de Portada

A Mathematical Explanation of Transformers

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Tai, Xue-Cheng, Liu, Hao, Li, Lingfeng, Chan, Raymond H.
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence Numerical Analysis
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Mathematical Guide to Operator Learning
por: Boullé, Nicolas, et al.
Publicado: (2023)

AlgoFormer: An Efficient Transformer Framework with Algorithmic Structures
por: Gao, Yihang, et al.
Publicado: (2024)

STNet: Spectral Transformation Network for Solving Operator Eigenvalue Problem
por: Wang, Hong, et al.
Publicado: (2025)

Deriving Transformer Architectures as Implicit Multinomial Regression
por: Actor, Jonas A., et al.
Publicado: (2025)

FAST: Factorizable Attention for Speeding up Transformers
por: Gerami, Armin, et al.
Publicado: (2024)

Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solvers
por: Zhou, Hang, et al.
Publicado: (2024)

Accelerating Matrix Diagonalization through Decision Transformers with Epsilon-Greedy Optimization
por: Bhatta, Kshitij, et al.
Publicado: (2024)

P$^2$C$^2$Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamics
por: Wang, Qi, et al.
Publicado: (2024)

Unveiling the Power of Multiple Gossip Steps: A Stability-Based Generalization Analysis in Decentralized Training
por: Li, Qinglun, et al.
Publicado: (2025)

Accelerating Data Generation for Neural Operators via Krylov Subspace Recycling
por: Wang, Hong, et al.
Publicado: (2024)

Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learning
por: Mustajab, Abdul Hannan, et al.
Publicado: (2024)

HomPINNs: homotopy physics-informed neural networks for solving the inverse problems of nonlinear differential equations with multiple solutions
por: Zheng, Haoyang, et al.
Publicado: (2023)

PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Laws
por: Yang, Liu, et al.
Publicado: (2024)

DeepContour: A Hybrid Deep Learning Framework for Accelerating Generalized Eigenvalue Problem Solving via Efficient Contour Design
por: Chen, Yeqiu, et al.
Publicado: (2025)

CATO: Charted Attention for Neural PDE Operators
por: Cheng, Chun-Wun, et al.
Publicado: (2026)

Branching Strategies Based on Subgraph GNNs: A Study on Theoretical Promise versus Practical Reality
por: Zhou, Junru, et al.
Publicado: (2025)

Advancing the Understanding of Fixed Point Iterations in Deep Neural Networks: A Detailed Analytical Study
por: Ke, Yekun, et al.
Publicado: (2024)

KAN-GCN: Combining Kolmogorov-Arnold Network with Graph Convolution Network for an Accurate Ice Sheet Emulator
por: Liu, Zesheng, et al.
Publicado: (2025)

Mitigating spectral bias for the multiscale operator learning
por: Liu, Xinliang, et al.
Publicado: (2022)

Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems
por: Li, Rui, et al.
Publicado: (2024)

Learning to Discover Iterative Spectral Algorithms
por: Liu, Zihang, et al.
Publicado: (2026)

Numerical Instability and Chaos: Quantifying the Unpredictability of Large Language Models
por: Islam, Chashi Mahiul, et al.
Publicado: (2026)

Transformers Can Implement Preconditioned Richardson Iteration for In-Context Gaussian Kernel Regression
por: Yan, Mingsong, et al.
Publicado: (2026)

Neural Operators with Localized Integral and Differential Kernels
por: Liu-Schiaffini, Miguel, et al.
Publicado: (2024)

ProFlow: Zero-Shot Physics-Consistent Sampling via Proximal Flow Guidance
por: Yu, Zichao, et al.
Publicado: (2026)

Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory
por: Jentzen, Arnulf, et al.
Publicado: (2023)

BWLer: Barycentric Weight Layer Elucidates a Precision-Conditioning Tradeoff for PINNs
por: Liu, Jerry, et al.
Publicado: (2025)

IFNSO: Iteration-Free Newton-Schulz Orthogonalization
por: Hu, Chen, et al.
Publicado: (2026)

FlashSinkhorn: IO-Aware Entropic Optimal Transport on GPU
por: Ye, Felix X. -F., et al.
Publicado: (2026)

A Practical Approach to Causal Inference over Time
por: Cinquini, Martina, et al.
Publicado: (2024)

A Dimensionality Reduction Approach for Convolutional Neural Networks
por: Meneghetti, Laura, et al.
Publicado: (2021)

Defining Foundation Models for Computational Science: A Call for Clarity and Rigor
por: Choi, Youngsoo, et al.
Publicado: (2025)

Online Pseudo-average Shifting Attention(PASA) for Robust Low-precision LLM Inference: Algorithms and Numerical Analysis
por: Cheng, Long, et al.
Publicado: (2025)

Learning Explicitly Conditioned Sparsifying Transforms
por: Pătraşcu, Andrei, et al.
Publicado: (2024)

A practical existence theorem for reduced order models based on convolutional autoencoders
por: Franco, Nicola Rares, et al.
Publicado: (2024)

Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilation
por: Singh, Ashutosh, et al.
Publicado: (2024)

Accelerated Gradient-based Design Optimization Via Differentiable Physics-Informed Neural Operator: A Composites Autoclave Processing Case Study
por: Patel, Janak M., et al.
Publicado: (2025)

Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learning
por: Berner, Julius, et al.
Publicado: (2025)

Truncated Matrix Completion - An Empirical Study
por: Naik, Rishhabh, et al.
Publicado: (2025)

Random weights of DNNs and emergence of fixed points
por: Berlyand, L., et al.
Publicado: (2025)