Image de couverture de livre

Efficient and Minimax Optimal In-context Nonparametric Regression with Transformers

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ching, Michelle, Popescu, Ioana, Smith, Nico, Ma, Tianyi, Underwood, William G., Samworth, Richard J.
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Statistics Theory 62G08, 68T07
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Optimal In-context Adaptivity and Distributional Robustness of Transformers
par: Ma, Tianyi, et autres
Publié: (2025)

Wasserstein Distributionally Robust Nonparametric Regression
par: Liu, Changyu, et autres
Publié: (2025)

Generalized Factor Neural Network Model for High-dimensional Regression
par: Guo, Zichuan, et autres
Publié: (2025)

Optimal Rate of Kernel Regression in Large Dimensions
par: Lu, Weihao, et autres
Publié: (2023)

A Minimax Theory of Nonparametric Regression Under Covariate Shift
par: Zamolodtchikov, Petr
Publié: (2026)

Optimal Federated Learning for Nonparametric Regression with Heterogeneous Distributed Differential Privacy Constraints
par: Cai, T. Tony, et autres
Publié: (2024)

Deep learning with missing data
par: Ma, Tianyi, et autres
Publié: (2025)

TILT: Target-induced loss tilting under covariate shift
par: Yamamoto, Kakei, et autres
Publié: (2026)

Estimating Unbounded Density Ratios: Applications in Error Control under Covariate Shift
par: Xu, Shuntuo, et autres
Publié: (2025)

Generalization Error of GAN from the Discriminator's Perspective
par: Yang, Hongkang, et autres
Publié: (2021)

Convergence rates of non-stationary and deep Gaussian process regression
par: Osborne, Conor, et autres
Publié: (2023)

The Optimality of Kernel Classifiers in Sobolev Space
par: Lai, Jianfa, et autres
Publié: (2024)

Symmetry: a General Structure in Nonparametric Regression
par: Christie, Louis G., et autres
Publié: (2024)

From Conditional to Unconditional Independence: Testing Conditional Independence via Transport Maps
par: He, Chenxuan, et autres
Publié: (2025)

Nonparametric Regression for Random Unbiased Perturbations
par: Lyubarskaja, Anna, et autres
Publié: (2025)

Nonparametric estimation of a factorizable density using diffusion models
par: Kwon, Hyeok Kyu, et autres
Publié: (2025)

Ranking Perspective for Tree-based Methods with Applications to Symbolic Feature Selection
par: Luo, Hengrui, et autres
Publié: (2024)

Covering Numbers for Deep ReLU Networks with Applications to Function Approximation and Nonparametric Regression
par: Ou, Weigutian, et autres
Publié: (2024)

Minimax And Adaptive Transfer Learning for Nonparametric Classification under Distributed Differential Privacy Constraints
par: Auddy, Arnab, et autres
Publié: (2024)

On the Convergence of the ELBO to Entropy Sums
par: Lücke, Jörg, et autres
Publié: (2022)

Generative Models with ELBOs Converging to Entropy Sums
par: Warnken, Jan, et autres
Publié: (2024)

Factor Augmented Quantile Regression Model
par: Wei, Xiaoyang, et autres
Publié: (2025)

Composite Lp-quantile regression, near quantile regression and the oracle model selection theory
par: Mou, Fuming Lin WEilin
Publié: (2025)

The Cost of Adaptation under Differential Privacy: Optimal Adaptive Federated Density Estimation
par: Cai, T. Tony, et autres
Publié: (2025)

On the Statistical Optimality of Optimal Decision Trees
par: Xu, Zineng, et autres
Publié: (2026)

A supervised deep learning method for nonparametric density estimation
par: Bos, Thijs, et autres
Publié: (2023)

Understanding the Effect of GCN Convolutions in Regression Tasks
par: Chen, Juntong, et autres
Publié: (2024)

On the minimax optimality of Flow Matching through the connection to kernel density estimation
par: Kunkel, Lea, et autres
Publié: (2025)

Distribution estimation via Flow Matching with Lipschitz guarantees
par: Kunkel, Lea
Publié: (2025)

CRPS-Optimal Binning for Univariate Conformal Regression
par: Toccaceli, Paolo
Publié: (2026)

Regularized least squares learning with heavy-tailed noise is minimax optimal
par: Mollenhauer, Mattes, et autres
Publié: (2025)

Multi-Head Attention as Ensemble Nadaraya-Watson Estimation: Variance Reduction, Decorrelation, and Optimal Head Diversity
par: Fokoué, Ernest
Publié: (2026)

Nonparametric local polynomial regression for functional covariates
par: Jirak, Moritz, et autres
Publié: (2025)

Evaluating the Quality of the Quantified Uncertainty for (Re)Calibration of Data-Driven Regression Models
par: Wibbeke, Jelke, et autres
Publié: (2025)

Alignment-Sensitive Minimax Rates for Spectral Algorithms with Learned Kernels
par: Huang, Dongming, et autres
Publié: (2025)

Quick and Simple Kernel Differential Equation Regression Estimators for Data with Sparse Design
par: Ge, Chunlei, et autres
Publié: (2024)

Differentiable Neural Networks with RePU Activation: with Applications to Score Estimation and Isotonic Regression
par: Shen, Guohao, et autres
Publié: (2023)

Bayesian Neural Networks vs. Mixture Density Networks: Theoretical and Empirical Insights for Uncertainty-Aware Nonlinear Modeling
par: Ghosh, Riddhi Pratim, et autres
Publié: (2025)

Dirichlet kernel density estimation on the simplex with missing data
par: Daayeb, Hanen, et autres
Publié: (2026)

Minimax properties of gamma kernel density estimators under $L^p$ loss and $β$-Hölder smoothness of the target
par: Ouimet, Frédéric
Publié: (2026)