Cover Image

OT-Transformer: A Continuous-time Transformer Architecture with Optimal Transport Regularization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kan, Kelvin, Li, Xingjian, Osher, Stanley
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Optimal Control for Transformer Architectures: Enhancing Generalization, Robustness and Efficiency
by: Kan, Kelvin, et al.
Published: (2025)

Stability of Transformers under Layer Normalization
by: Kan, Kelvin, et al.
Published: (2025)

cuRegOT: A GPU-Accelerated Solver for Entropic-Regularized Optimal Transport
by: Qiu, Yixuan
Published: (2026)

Sparse Transformer Architectures via Regularized Wasserstein Proximal Operator with $L_1$ Prior
by: Han, Fuqun, et al.
Published: (2025)

Zero-Shot Transferable Solution Method for Parametric Optimal Control Problems
by: Li, Xingjian, et al.
Published: (2025)

PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Laws
by: Yang, Liu, et al.
Published: (2024)

Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
by: Súkeník, Peter, et al.
Published: (2025)

Bispectral OT: Dataset Comparison using Symmetry-Aware Optimal Transport
by: Ma, Annabel, et al.
Published: (2025)

ContiFormer: Continuous-Time Transformer for Irregular Time Series Modeling
by: Chen, Yuqi, et al.
Published: (2024)

On Limitations of the Transformer Architecture
by: Peng, Binghui, et al.
Published: (2024)

H$_{2}$OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformers
by: Li, Wenhao, et al.
Published: (2025)

A Primal-Dual Framework for Transformers and Neural Networks
by: Nguyen, Tan M., et al.
Published: (2024)

Expressive Power of Implicit Models: Rich Equilibria and Test-Time Scaling
by: Liu, Jialin, et al.
Published: (2025)

Architecture Determines Observability of Transformers
by: Carmichael, Thomas
Published: (2026)

From Alexnet to Transformers: Measuring the Non-linearity of Deep Neural Networks with Affine Optimal Transport
by: Bouniot, Quentin, et al.
Published: (2023)

ENOT: Expectile Regularization for Fast and Accurate Training of Neural Optimal Transport
by: Buzun, Nazar, et al.
Published: (2024)

Finding Clustering Algorithms in the Transformer Architecture
by: Clarkson, Kenneth L., et al.
Published: (2025)

OT Score: An OT based Confidence Score for Prototype-Assisted Source Free Unsupervised Domain Adaptation
by: Zhang, Yiming, et al.
Published: (2025)

Enhancing GNNs with Architecture-Agnostic Graph Transformations: A Systematic Analysis
by: Li, Zhifei, et al.
Published: (2024)

A Survey of Graph Transformers: Architectures, Theories and Applications
by: Yuan, Chaohao, et al.
Published: (2025)

COPR: Continual Human Preference Learning via Optimal Policy Regularization
by: Zhang, Han, et al.
Published: (2024)

From Noise to Narrative: Tracing the Origins of Hallucinations in Transformers
by: Suresh, Praneet, et al.
Published: (2025)

Offline Reinforcement Learning with Wasserstein Regularization via Optimal Transport Maps
by: Omura, Motoki, et al.
Published: (2025)

Transformers as Neural Operators for Solutions of Differential Equations with Finite Regularity
by: Shih, Benjamin, et al.
Published: (2024)

LENS: Large Pre-trained Transformer for Exploring Financial Time Series Regularities
by: Xu, Yuanjian, et al.
Published: (2024)

Understanding Transformer Architecture through Continuous Dynamics: A Partial Differential Equation Perspective
by: Zhang, Yukun, et al.
Published: (2024)

Thinking Out of the Box: Hybrid SAT Solving by Unconstrained Continuous Optimization
by: Zhang, Zhiwei, et al.
Published: (2025)

Solving Continual Offline Reinforcement Learning with Decision Transformer
by: Huang, Kaixin, et al.
Published: (2024)

Dimension-Free Convergence of Discrete Diffusion Models: Adjoint Equations Induce the Right Space
by: Kan, Kelvin, et al.
Published: (2026)

ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modeling
by: Zhang, Yuanyun, et al.
Published: (2025)

Interpretable-by-Design Transformers via Architectural Stream Independence
by: Kerce, Clayton, et al.
Published: (2026)

Generative Modeling of Networked Time-Series via Transformer Architectures
by: Elnady, Yusuf
Published: (2025)

On Exact Bit-level Reversible Transformers Without Changing Architectures
by: Zhang, Guoqiang, et al.
Published: (2024)

Towards Resilient Transportation: A Conditional Transformer for Accident-Informed Traffic Forecasting
by: Wang, Hongjun, et al.
Published: (2025)

Toto: Time Series Optimized Transformer for Observability
by: Cohen, Ben, et al.
Published: (2024)

Rough Transformers for Continuous and Efficient Time-Series Modelling
by: Moreno-Pino, Fernando, et al.
Published: (2024)

TART: Token-based Architecture Transformer for Neural Network Performance Prediction
by: He, Yannis Y.
Published: (2025)

Triple Attention Transformer Architecture for Time-Dependent Concrete Creep Prediction
by: Dokduea, Warayut, et al.
Published: (2025)

Nash Equilibria, Regularization and Computation in Optimal Transport-Based Distributionally Robust Optimization
by: Shafiee, Soroosh, et al.
Published: (2023)

A Real-time Multimodal Transformer Neural Network-powered Wildfire Forecasting System
by: Chen, Qijun, et al.
Published: (2025)