Cover Image

Attention is a smoothed cubic spline

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lai, Zehua, Lim, Lek-Heng, Liu, Yucong
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Machine Learning Numerical Analysis 26B40, 41A15, 65D07, 68T01, 14P10, 13J30
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Pierce-Birkhoff conjecture is true for splines
by: Lai, Zehua, et al.
Published: (2025)

SUPN: Shallow Universal Polynomial Networks
by: Morrow, Zachary, et al.
Published: (2025)

Implementation of Worsey-Farin splines with applications to solution transfer
by: Larose, Logan, et al.
Published: (2025)

Challenges in automatic differentiation and numerical integration in physics-informed neural networks modelling
by: Daněk, Josef, et al.
Published: (2024)

Trustworthy AI in numerics: On verification algorithms for neural network-based PDE solvers
by: Haugen, Emil, et al.
Published: (2025)

LR B-spline perspective for RM B-splines: construction and effortless refinements
by: Patrizi, Francesco
Published: (2025)

A C^s-smooth mixed degree and regularity isogeometric spline space over planar multi-patch domains
by: Kapl, Mario, et al.
Published: (2024)

Element-based B-spline basis function spaces: construction and application in isogeometric analysis
by: Yang, Peng, et al.
Published: (2026)

A Construction of $C^{r}$ Conforming Finite Elements on the Alfeld Split in Any Dimension
by: Lin, Ting, et al.
Published: (2026)

Near-best univariate spline discrete quasi-interpolants on non-uniform partitions
by: Barrera, D., et al.
Published: (2004)

Volume-Preserving Transformers for Learning Time Series Data with Structure
by: Brantner, Benedikt, et al.
Published: (2023)

Polyharmonic Spline Packages: Composition, Efficient Procedures for Computation and Differentiation
by: Bakhvalov, Yuriy N.
Published: (2025)

Deep Learning Based on Randomized Quasi-Monte Carlo Method for Solving Linear Kolmogorov Partial Differential Equation
by: Xiao, Jichang, et al.
Published: (2023)

Hyperbolic trigonometric functions as approximation kernels and their properties II: Wavelets
by: Buhmann, M., et al.
Published: (2025)

Fast algorithms for interpolation with clamped $L$-splines of order four
by: Kounchev, O., et al.
Published: (2026)

Equidistribution-based training of Free Knot Splines and ReLU Neural Networks
by: Appella, Simone, et al.
Published: (2024)

Lattice algorithms for multivariate approximation in periodic spaces with general weight parameters
by: Cools, Ronald, et al.
Published: (2019)

Grassmannian optimization is NP-hard
by: Lai, Zehua, et al.
Published: (2024)

Adaptive integration of 5-convex and 5-concave functions
by: Wąsowicz, Szymon
Published: (2026)

A Bivariate Spline Construction of Orthonormal Polynomials over Polygonal Domains and Its Applications to Quadrature
by: Lai, Ming-Jun
Published: (2026)

Construction of the Kolmogorov-Arnold representation using the Newton-Kaczmarz method
by: Poluektov, Michael, et al.
Published: (2023)

RandONet: Shallow-Networks with Random Projections for learning linear and nonlinear operators
by: Fabiani, Gianluca, et al.
Published: (2024)

Learning to Integrate
by: Ernst, Oliver G., et al.
Published: (2025)

Surface elevation errors in finite element Stokes models for glacier evolution
by: Bueler, Ed
Published: (2024)

Fourier Residual Networks Achieve Spectral Accuracy for Discontinuous Functions
by: Davis, Owen, et al.
Published: (2026)

Quasi-interpolation projectors for Subdivision Surfaces
by: Xu, Hailun, et al.
Published: (2024)

Improving Matrix Exponential for Generative AI Flows: A Taylor-Based Approach Beyond Paterson--Stockmeyer
by: Sastre, Jorge, et al.
Published: (2025)

Certified and accurate computation of function space norms of deep neural networks
by: Gründler, Johannes, et al.
Published: (2026)

Universal Approximation of Dynamical Systems by Semi-Autonomous Neural ODEs and Applications
by: Li, Ziqian, et al.
Published: (2024)

A neuron-wise subspace correction method for the finite neuron method
by: Park, Jongho, et al.
Published: (2022)

Initialization of a Polyharmonic Cascade, Launch and Testing
by: Bakhvalov, Yuriy N.
Published: (2025)

Local spline refinement driven by fault jump estimates for scattered data approximation
by: Bracco, Cesare, et al.
Published: (2023)

A Unified Framework for Lifted Training and Inversion Approaches
by: Wang, Xiaoyu, et al.
Published: (2025)

Polyharmonic Cascade
by: Bakhvalov, Yuriy N.
Published: (2025)

How sharp are error bounds? --lower bounds on quadrature worst-case errors for analytic functions
by: Goda, Takashi, et al.
Published: (2024)

Stiefel optimization is NP-hard
by: Lai, Zehua, et al.
Published: (2025)

Compression using Quasi-Interpolation
by: Buhmann, Martin, et al.
Published: (2024)

Minimum Width of Leaky-ReLU Neural Networks for Uniform Universal Approximation
by: Li, Li'ang, et al.
Published: (2023)

Vanilla Feedforward Neural Networks as a Discretization of Dynamical Systems
by: Duan, Yifei, et al.
Published: (2022)

Quasi-interpolation for high-dimensional function approximation
by: Gao, Wenwu, et al.
Published: (2024)