Image de couverture de livre

Multi-Head Attention as Ensemble Nadaraya-Watson Estimation: Variance Reduction, Decorrelation, and Optimal Head Diversity

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Fokoué, Ernest
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Primary 62G08, 62H12, Secondary 68T07, 15A42
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Fibonacci-Driven Recursive Ensembles: Algorithms, Convergence, and Learning Dynamics
par: Fokoué, Ernest
Publié: (2026)

Decorrelation, Diversity, and Emergent Intelligence: The Isomorphism Between Social Insect Colonies and Ensemble Machine Learning
par: Fokoué, Ernest, et autres
Publié: (2026)

A General Weighting Theory for Ensemble Learning: Beyond Variance Reduction via Spectral and Geometric Structure
par: Fokoué, Ernest
Publié: (2025)

Nonparametric Envelopes for Flexible Response Reduction
par: Jacobson, Tate
Publié: (2025)

Causality as the Statistical Conscience of Artificial Intelligence: From Pearl's Ladder to Trustworthy Machines
par: Fokoué, Ernest
Publié: (2026)

On Fibonacci Ensembles: An Alternative Approach to Ensemble Learning Inspired by the Timeless Architecture of the Golden Ratio
par: Fokoué, Ernest
Publié: (2025)

Adaptive exact recovery in sparse nonparametric models
par: Stepanova, Natalia, et autres
Publié: (2024)

Adaptive almost full recovery in sparse nonparametric models
par: Stepanova, Natalia, et autres
Publié: (2025)

Exact variable selection in sparse nonparametric models
par: Stepanova, Natalia, et autres
Publié: (2023)

Quick and Simple Kernel Differential Equation Regression Estimators for Data with Sparse Design
par: Ge, Chunlei, et autres
Publié: (2024)

A General Bayesian Nonparametric Approach for Estimating Population-Level and Conditional Causal Effects
par: Hur, Yongseok, et autres
Publié: (2025)

Transcendental Regularization of Finite Mixtures:Theoretical Guarantees and Practical Limitations
par: Fokoué, Ernest
Publié: (2026)

Efficient Inference on High-Dimensional Linear Models with Missing Outcomes
par: Zhang, Yikun, et autres
Publié: (2023)

A Principled Approach to Bayesian Transfer Learning
par: Bretherton, Adam, et autres
Publié: (2025)

Tuning free Catoni type joint robust estimation
par: Li, Xiang, et autres
Publié: (2025)

Composite Lp-quantile regression, near quantile regression and the oracle model selection theory
par: Mou, Fuming Lin WEilin
Publié: (2025)

Maximum smoothed likelihood method for the combination of multiple diagnostic tests, with application to the ROC estimation
par: Zheng, Fangyong, et autres
Publié: (2026)

Conditionality principle under unconstrained randomness
par: Vovk, Vladimir
Publié: (2024)

Dimensionality-Aware Outlier Detection: Theoretical and Experimental Analysis
par: Anderberg, Alastair, et autres
Publié: (2024)

Identifiability and Exact Reconstruction of the Optimal Transport Cost on Finite Spaces
par: González-Sanz, Alberto, et autres
Publié: (2024)

Nonparametric velocity estimation in stochastic convection-diffusion equations from multiple local measurements
par: Strauch, Claudia, et autres
Publié: (2024)

Localizing differences in smooths with simultaneous confidence bounds on the true discovery proportion
par: Swanson, David
Publié: (2020)

Regression and Dimension Reduction for Multivariate Mixed-Type Data via Semiparametric Gaussian Copula
par: Dey, Debangan, et autres
Publié: (2022)

Copula Modelling of Serially Correlated Multivariate Data with Hidden Structures
par: Zimmerman, Robert, et autres
Publié: (2022)

Simultaneous Heterogeneity and Reduced-rank Learning for Multivariate Response Regression
par: Wu, Jie, et autres
Publié: (2025)

Nonparametric geostatistical risk mapping
par: Fernández-casal, Rubén, et autres
Publié: (2024)

Nonparametric conditional risk mapping under heteroscedasticity
par: Fernández-Casal, Rubén, et autres
Publié: (2024)

Trend Filtered Mixture of Experts for Automated Gating of High-Frequency Flow Cytometry Data
par: Hyun, Sangwon, et autres
Publié: (2025)

Regularized least squares learning with heavy-tailed noise is minimax optimal
par: Mollenhauer, Mattes, et autres
Publié: (2025)

Estimating Unbounded Density Ratios: Applications in Error Control under Covariate Shift
par: Xu, Shuntuo, et autres
Publié: (2025)

Moment Estimator-Based Extreme Quantile Estimation with Erroneous Observations: Application to Elliptical Extreme Quantile Region Estimation
par: Pere, Jaakko, et autres
Publié: (2025)

Bayesian Joint Modeling of Interrater and Intrarater Reliability with Multilevel Data
par: Hawila, Nour, et autres
Publié: (2024)

Semiparametric copula-based quantile regression for semicontinuous outcomes with application to healthcare data
par: Lyu, Guanjie, et autres
Publié: (2026)

Estimation of Shannon differential entropy: An extensive comparative review
par: Madukaife, Mbanefo S., et autres
Publié: (2024)

Sparse factor models of high dimension
par: Poignard, Benjamin, et autres
Publié: (2023)

Tensor Neyman-Pearson Classification: Theory, Algorithms, and Error Control
par: Liu, Lingchong, et autres
Publié: (2025)

Dirichlet kernel density estimation on the simplex with missing data
par: Daayeb, Hanen, et autres
Publié: (2026)

Constant-Target Energy Matching: A Unified Framework for Continuous and Discrete Density Estimation
par: Zeng, Zhijun, et autres
Publié: (2026)

Bayesian Additive Regression Trees (BART) in Food Authenticity: A Classification Approach to Food Fraud Detection
par: Zhu, Mengxiang, et autres
Publié: (2025)

Low-Rank and Sparse Drift Estimation for High-Dimensional Lévy-Driven Ornstein--Uhlenbeck Processes
par: Palaisti, Marina
Publié: (2026)