Multi-Head Attention as Ensemble Nadaraya-Watson Estimation: Variance Reduction, Decorrelation, and Optimal Head Diversity

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Fokoué, Ernest
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Primary 62G08, 62H12, Secondary 68T07, 15A42
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2605.20271