Cover Image

Approximation Bounds for Transformer Networks with Application to Regression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jiao, Yuling, Lai, Yanming, Sun, Defeng, Wang, Yang, Yan, Bokai
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Approximation Bounds for Recurrent Neural Networks with Application to Regression
by: Jiao, Yuling, et al.
Published: (2024)

Convergence Analysis of Flow Matching in Latent Space with Transformers
by: Jiao, Yuling, et al.
Published: (2024)

Transformers Can Overcome the Curse of Dimensionality: A Theoretical Study from an Approximation Perspective
by: Jiao, Yuling, et al.
Published: (2025)

Standard Transformers Achieve the Minimax Rate in Nonparametric Regression with $C^{s,λ}$ Targets
by: Lai, Yanming, et al.
Published: (2026)

Beyond the Prompt in Large Language Models: Comprehension, In-Context Learning, and Chain-of-Thought
by: Jiao, Yuling, et al.
Published: (2026)

Approximation Error Upper and Lower Bounds for Hölder Class with Transformers
by: He, Xin, et al.
Published: (2026)

Error Analysis of Three-Layer Neural Network Trained with PGD for Deep Ritz Method
by: Jiao, Yuling, et al.
Published: (2024)

Distribution Matching for Self-Supervised Transfer Learning
by: Jiao, Yuling, et al.
Published: (2025)

Non-asymptotic Approximation Error Bounds of Parameterized Quantum Circuits
by: Yu, Zhan, et al.
Published: (2023)

Differentiable Neural Networks with RePU Activation: with Applications to Score Estimation and Isotonic Regression
by: Shen, Guohao, et al.
Published: (2023)

Distributional Off-Policy Evaluation with Deep Quantile Process Regression
by: Kuang, Qi, et al.
Published: (2026)

Semi-Supervised Deep Sobolev Regression: Estimation and Variable Selection by ReQU Neural Network
by: Ding, Zhao, et al.
Published: (2024)

Wasserstein Distributionally Robust Nonparametric Regression
by: Liu, Changyu, et al.
Published: (2025)

Approximated Orthogonal Projection Unit: Stabilizing Regression Network Training Using Natural Gradient
by: Wang, Shaoqi, et al.
Published: (2024)

Error Bounds For Gaussian Process Regression Under Bounded Support Noise With Applications To Safety Certification
by: Reed, Robert, et al.
Published: (2024)

A Score-Based Density Formula, with Applications in Diffusion Generative Models
by: Li, Gen, et al.
Published: (2024)

Deep Transfer Learning: Model Framework and Error Analysis
by: Jiao, Yuling, et al.
Published: (2024)

Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precision
by: Ng, Jakin, et al.
Published: (2024)

In-Context Learning of Linear Dynamical Systems with Transformers: Approximation Bounds and Depth-Separation
by: Cole, Frank, et al.
Published: (2025)

Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models
by: Tang, Jiaqi, et al.
Published: (2025)

Risk Bounds For Distributional Regression
by: Padilla, Carlos Misael Madrid, et al.
Published: (2025)

Predictive variational inference: Learn the predictively optimal posterior distribution
by: Lai, Jinlin, et al.
Published: (2024)

HeTa: Relation-wise Heterogeneous Graph Foundation Attack Model
by: Wang, Yuling, et al.
Published: (2025)

Approximating Full Conformal Prediction for Neural Network Regression with Gauss-Newton Influence
by: Tailor, Dharmesh, et al.
Published: (2025)

Misspecified $Q$-Learning with Sparse Linear Function Approximation: Tight Bounds on Approximation Error
by: Du, Ally Yalei, et al.
Published: (2024)

Understanding In-Context Learning for Nonlinear Regression with Transformers: Attention as Featurizer
by: Hsu, Alexander, et al.
Published: (2026)

Uniform Error Bounds for Gaussian Process Regression with Application to Safe Control
by: Lederer, Armin, et al.
Published: (2019)

Expectation Error Bounds for Transfer Learning in Linear Regression and Linear Neural Networks
by: Liu, Meitong, et al.
Published: (2026)

Transformers Handle Endogeneity in In-Context Linear Regression
by: Liang, Haodong, et al.
Published: (2024)

PAC-Bayes Bounds for Multivariate Linear Regression and Linear Autoencoders
by: Guo, Ruixin, et al.
Published: (2025)

On the Rate of Convergence of Kolmogorov-Arnold Network Regression Estimators
by: Liu, Wei, et al.
Published: (2025)

Online Realizable Regression and Applications for ReLU Networks
by: Doron-Arad, Ilan, et al.
Published: (2026)

Scalable Kernel Logistic Regression with Nyström Approximation: Theoretical Analysis and Application to Discrete Choice Modelling
by: Martín-Baos, José Ángel, et al.
Published: (2024)

Deep Bootstrap
by: Chang, Jinyuan, et al.
Published: (2026)

Steady-State Behavior of Constant-Stepsize Stochastic Approximation: Gaussian Approximation and Tail Bounds
by: Wang, Zedong, et al.
Published: (2026)

Exploring the Impact of Temperature Scaling in Softmax for Classification and Adversarial Robustness
by: Xuan, Hao, et al.
Published: (2025)

Bridging Molecular Graphs and Large Language Models
by: Wang, Runze, et al.
Published: (2025)

Deep conditional distribution learning via conditional Föllmer flow
by: Chang, Jinyuan, et al.
Published: (2024)

Adv-SSL: Adversarial Self-Supervised Representation Learning with Theoretical Guarantees
by: Duan, Chenguang, et al.
Published: (2024)

Transformers Meet In-Context Learning: A Universal Approximation Theory
by: Li, Gen, et al.
Published: (2025)