Cover Image

Scaled-Dot-Product Attention as One-Sided Entropic Optimal Transport

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Litman, Elon
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Origin of Edge of Stability
by: Litman, Elon
Published: (2026)

You Need Better Attention Priors
by: Litman, Elon, et al.
Published: (2026)

Equilibrium Propagation Without Limits
by: Litman, Elon
Published: (2025)

A Theory of Generalization in Deep Learning
by: Litman, Elon, et al.
Published: (2026)

Neural Estimation for Scaling Entropic Multimarginal Optimal Transport
by: Tsur, Dor, et al.
Published: (2025)

Variational Entropic Optimal Transport
by: Dyachenko, Roman, et al.
Published: (2026)

Progressive Entropic Optimal Transport Solvers
by: Kassraie, Parnian, et al.
Published: (2024)

Two-Sided Bounds for Entropic Optimal Transport via a Rate-Distortion Integral
by: Liu, Jingbo
Published: (2026)

Entropic Riemannian Neural Optimal Transport
by: Micheli, Alessandro, et al.
Published: (2026)

Energy-guided Entropic Neural Optimal Transport
by: Mokrov, Petr, et al.
Published: (2023)

Decentralized Entropic Optimal Transport for Distributed Distribution Comparison
by: Wang, Xiangfeng, et al.
Published: (2023)

On Model-Based Clustering With Entropic Optimal Transport
by: Mena, Gonzalo
Published: (2026)

Generative Conditional Distributions by Neural (Entropic) Optimal Transport
by: Nguyen, Bao, et al.
Published: (2024)

Scalable Simulation-free Entropic Unbalanced Optimal Transport
by: Choi, Jaemoo, et al.
Published: (2024)

Decreasing Entropic Regularization Averaged Gradient for Semi-Discrete Optimal Transport
by: Genans, Ferdinand, et al.
Published: (2025)

On the Efficiency of Sinkhorn-Knopp for Entropically Regularized Optimal Transport
by: He, Kun
Published: (2026)

ABC: Any-Subset Autoregression via Non-Markovian Diffusion Bridges in Continuous Time and Space
by: Guo, Gabe, et al.
Published: (2026)

Designing Algorithms for Entropic Optimal Transport from an Optimisation Perspective
by: Srinivasan, Vishwak, et al.
Published: (2025)

FlashSinkhorn: IO-Aware Entropic Optimal Transport on GPU
by: Ye, Felix X. -F., et al.
Published: (2026)

Entering the Era of Discrete Diffusion Models: A Benchmark for Schrödinger Bridges and Entropic Optimal Transport
by: Carrasco, Xavier Aramayo, et al.
Published: (2025)

Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization
by: Genans, Ferdinand, et al.
Published: (2024)

Entropic Optimal Transport Eigenmaps for Nonlinear Alignment and Joint Embedding of High-Dimensional Datasets
by: Landa, Boris, et al.
Published: (2024)

Inverse Entropic Optimal Transport Solves Semi-supervised Learning via Data Likelihood Maximization
by: Persiianov, Mikhail, et al.
Published: (2024)

Faster Computation of Entropic Optimal Transport via Stable Low Frequency Modes
by: Chhaibi, Reda, et al.
Published: (2025)

Geometrically Constrained Stenosis Editing in Coronary Angiography via Entropic Optimal Transport
by: Li, Jialin, et al.
Published: (2026)

cuRegOT: A GPU-Accelerated Solver for Entropic-Regularized Optimal Transport
by: Qiu, Yixuan
Published: (2026)

Scaled Dot-Product Attention implements projection of inputs onto a common surface
by: Sanger, Terence D
Published: (2026)

Lower Complexity Adaptation for Empirical Entropic Optimal Transport
by: Groppe, Michel, et al.
Published: (2023)

Continual Low-Rank Scaled Dot-product Attention
by: Picón, Ginés Carreto, et al.
Published: (2024)

LOTFormer: Doubly-Stochastic Linear Attention via Low-Rank Optimal Transport
by: Shahbazi, Ashkan, et al.
Published: (2025)

Score-based Generative Neural Networks for Large-Scale Optimal Transport
by: Daniels, Mara, et al.
Published: (2021)

Transformers for Tabular Data: A Training Perspective of Self-Attention via Optimal Transport
by: Quadrio, Alessandro, et al.
Published: (2025)

Asymptotically-Optimal Gaussian Bandits with Side Observations
by: Atsidakou, Alexia, et al.
Published: (2025)

Reliable Pseudo-labeling via Optimal Transport with Attention for Short Text Clustering
by: Yao, Zhihao
Published: (2025)

Linear Bandits beyond Inner Product Spaces, the case of Bandit Optimal Transport
by: Croissant, Lorenzo
Published: (2025)

Stochastic MeanFlow Policies: One-Step Generative Control with Entropic Mirror Descent
by: Wang, Zeyuan, et al.
Published: (2026)

Entropic-Time Inference: Self-Organizing Large Language Model Decoding Beyond Attention
by: Kiruluta, Andrew
Published: (2026)

WFR-MFM: One-Step Inference for Dynamic Unbalanced Optimal Transport
by: Wang, Xinyu, et al.
Published: (2026)

Risk-Entropic Flow Matching
by: Ramezani, Vahid R., et al.
Published: (2025)

Conditional Risk Minimization with Side Information: A Tractable, Universal Optimal Transport Framework
by: Xie, Xinqiao, et al.
Published: (2025)