Cover Image

Generalizing Adam to Manifolds for Efficiently Training Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Brantner, Benedikt
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Differential Geometry 53Z50, 53C30, 68T07, 68W10, 90C26
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Iso-Riemannian Optimization on Learned Data Manifolds
by: Diepeveen, Willem, et al.
Published: (2025)

On the approximation of the Riemannian barycenter
by: Mataigne, Simon, et al.
Published: (2025)

Geometric shape matching for recovering protein conformations from single-particle Cryo-EM data
by: Jansson, Erik, et al.
Published: (2024)

Curvature surfaces in generic conformally flat hypersurfaces arising from Poincaré metric -- Extension and Approximation
by: Matsuura, Nozomu, et al.
Published: (2023)

Geodesic Calculus on Implicitly Defined Latent Manifolds
by: Hartwig, Florine, et al.
Published: (2025)

Non naturally reductive Einstein metrics on $\SU(N)$ via generalized flag manifolds
by: Arvanitoyeorgos, Andreas, et al.
Published: (2025)

Non naturally reductive Einstein metrics on the orthogonal group via real flag manifolds
by: Arvanitoyeorgos, Andreas, et al.
Published: (2024)

A Riemannian quasi-Newton algorithm for optimization with Euclidean bounds
by: Baran, Mateusz, et al.
Published: (2026)

Riemannian AmbientFlow: Towards Simultaneous Manifold Learning and Generative Modeling from Corrupted Data
by: Diepeveen, Willem, et al.
Published: (2026)

A Gauss-Bonnet-Chern type obstruction for Killing vector fields on Lorentzian manifolds
by: Romero, Alfonso, et al.
Published: (2024)

Bounds on the geodesic distances on the Stiefel manifold for a family of Riemannian metrics
by: Mataigne, Simon, et al.
Published: (2024)

Pulling back symmetric Riemannian geometry for data analysis
by: Diepeveen, Willem
Published: (2024)

$O(k)$-Equivariant Dimensionality Reduction on Stiefel Manifolds
by: Lee, Andrew, et al.
Published: (2023)

Special metrics in hypercomplex geometry
by: Fusi, Elia, et al.
Published: (2024)

Understanding the geometry of deep learning with decision boundary volume
by: Burfitt, Matthew, et al.
Published: (2026)

LoRA meets Riemannion: Muon Optimizer for Parametrization-independent Low-Rank Adapters
by: Bogachev, Vladimir, et al.
Published: (2025)

The asymptotics of the $\mathrm{SL}_2(\mathbb{C})$-Hitchin metric on the singular locus: subintegrable systems
by: He, Siqi, et al.
Published: (2025)

Examples of deformed Spin(7)-instantons/Donaldson-Thomas connections
by: Fowdar, Udhav
Published: (2023)

Submanifolds of almost quaternionic skew-Hermitian manifolds
by: Chrysikos, Ioannis, et al.
Published: (2026)

Minimal Timelike Surfaces in the Lorentz-Minkowski 3-space and Their Canonical Parameters
by: Kassabov, Ognian, et al.
Published: (2023)

The physical approach on the surfaces of rotation in E24
by: Almaz, Fatma
Published: (2021)

Left-invariant ${\rm G}_2^*$-structures of type III
by: del Barco, Viviana, et al.
Published: (2025)

Renormalized Yang-Mills Energy on Poincaré-Einstein Manifolds
by: Gover, A. R., et al.
Published: (2024)

The completeness problem on the pseudo-homothetic Lie group
by: Chaib, Salah, et al.
Published: (2024)

The distribution of symmetry of Lorentzian naturally reductive nilmanifolds
by: Luporini, Brian, et al.
Published: (2025)

Similarity-based fuzzy clustering scientific articles: potentials and challenges from mathematical and computational perspectives
by: Huong, Vu Thi, et al.
Published: (2025)

Conformal structures with $G_2$-symmetric twistor distribution
by: Nurowski, Pawel, et al.
Published: (2024)

On homogeneous HKT manifolds and the Einstein condition
by: Bedulli, Lucio, et al.
Published: (2026)

On the Gaussian Kinematic Formula of R. Adler and J. Taylor
by: Fu, Joseph H. G.
Published: (2024)

On curvature bounds in Lorentzian length spaces
by: Beran, Tobias, et al.
Published: (2023)

A synthetic Lorentzian Cartan-Hadamard theorem
by: Erös, Darius, et al.
Published: (2025)

Boundary Detection Algorithm Inspired by Locally Linear Embedding
by: Kuo, Pei-Cheng, et al.
Published: (2024)

Weil--Petersson homeomorphisms, minimal lagrangian diffeomorphisms, and maximal surfaces in anti-de Sitter space
by: Diaf, Farid, et al.
Published: (2026)

Quaternionic complex manifolds and fixed-point sets of $S^{1}$-actions
by: Hasegawa, Kazuyuki
Published: (2026)

Curvature of quaternionic skew-Hermitian manifolds and bundle constructions
by: Chrysikos, Ioannis, et al.
Published: (2024)

The vacuum weighted Einstein field equations on pr-waves
by: Brozos-Vázquez, Miguel, et al.
Published: (2024)

On a family of Einstein like Walker metrics
by: Kaboye, Issa Allassane, et al.
Published: (2024)

Conformal Walker metrics and linear Fefferman-Graham equations
by: Anderson, Ian M, et al.
Published: (2016)

Some discussions on null helices in 3D semi-Riemannian manifold
by: Almaz, Fatma
Published: (2025)

A gauge theoretical generalization of Bryant's correspondence
by: Teleman, Andrei
Published: (2026)