Imagen de Portada

LoRA meets Riemannion: Muon Optimizer for Parametrization-independent Low-Rank Adapters

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Bogachev, Vladimir, Aletov, Vladimir, Molozhavenko, Alexander, Bobkov, Denis, Soboleva, Vera, Alanov, Aibek, Rakhuba, Maxim
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Computation and Language Numerical Analysis Differential Geometry 68T07, 65F55, 53Z50
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Optimization on the Extended Tensor-Train Manifold with Shared Factors
por: Molozhavenko, Alexander, et al.
Publicado: (2025)

T-LoRA: Single Image Diffusion Model Customization Without Overfitting
por: Soboleva, Vera, et al.
Publicado: (2025)

OrthoFuse: Training-free Riemannian Fusion of Orthogonal Style-Concept Adapters for Diffusion Models
por: Aliev, Ali, et al.
Publicado: (2026)

Group and Shuffle: Efficient Structured Orthogonal Parametrization
por: Gorbunov, Mikhail, et al.
Publicado: (2024)

Understanding the geometry of deep learning with decision boundary volume
por: Burfitt, Matthew, et al.
Publicado: (2026)

Accelerating Newton-Schulz Iteration for Orthogonalization via Chebyshev-type Polynomials
por: Grishina, Ekaterina, et al.
Publicado: (2025)

Defining geometric gauge theory to accommodate particles, continua, and fields
por: Marsh, Adam
Publicado: (2024)

Geodesic Calculus on Implicitly Defined Latent Manifolds
por: Hartwig, Florine, et al.
Publicado: (2025)

Computing equivariant matrices on homogeneous spaces for Geometric Deep Learning and Automorphic Lie Algebras
por: Knibbeler, Vincent
Publicado: (2023)

General Deformations of Point Configurations Viewed By a Pinhole Model Camera
por: Kaminski, Yirmeyahu, et al.
Publicado: (2015)

Generalizing Adam to Manifolds for Efficiently Training Transformers
por: Brantner, Benedikt
Publicado: (2023)

On the Equilibrium Locus of a Parameterized Dynamical System with Independent First Integrals
por: Kaminski, Yirmeyahu, et al.
Publicado: (2025)

Iso-Riemannian Optimization on Learned Data Manifolds
por: Diepeveen, Willem, et al.
Publicado: (2025)

Beyond Fine-Tuning: A Systematic Study of Sampling Techniques in Personalized Image Generation
por: Soboleva, Vera, et al.
Publicado: (2025)

Renormalized Four Dimensional Quantum Yang-Mills Theory and Mass Gap
por: Farinelli, Simone
Publicado: (2014)

Variational cohomology and topological solitons in Yang-Mills-Chern-Simons theories
por: Winterroth, Ekkehart
Publicado: (2021)

Parametrizations of minimal timelike surfaces in the four-dimensional pseudo-Euclidean space of index two
por: Moriya, Katsuhiro
Publicado: (2026)

A note on the theoretical approach to Grassmannians and Plücker coordinates for additive skew-symmetric pairwise comparisons matrices
por: Koczkodaj, Waldemar W., et al.
Publicado: (2025)

Special Finsler spaces admitting a semi-concurrent vector field
por: Rajeshwari, M. R., et al.
Publicado: (2024)

The role of shape operator in gauge theories
por: Zatloukal, Vaclav, et al.
Publicado: (2022)

Wildfire Propagation Modeling using Satellite-Derived Parameters and Generalized Elliptical Frames
por: Dehkordi, Hengameh R.
Publicado: (2025)

A Gauss-Bonnet-Chern type obstruction for Killing vector fields on Lorentzian manifolds
por: Romero, Alfonso, et al.
Publicado: (2024)

Convergent autoencoder approximation of low bending and low distortion manifold embeddings
por: Braunsmann, Juliane, et al.
Publicado: (2022)

The structure of the token space for large language models
por: Robinson, Michael, et al.
Publicado: (2024)

Boundary Detection Algorithm Inspired by Locally Linear Embedding
por: Kuo, Pei-Cheng, et al.
Publicado: (2024)

Conformal structures with $G_2$-symmetric twistor distribution
por: Nurowski, Pawel, et al.
Publicado: (2024)

Asymptotic Geometry of the Moduli Space of Rank Two Irregular Higgs Bundles over the Projective Line
por: Chen, Gao, et al.
Publicado: (2022)

Context-dependent manifold learning: A neuromodulated constrained autoencoder approach
por: Adriaens, Jérôme, et al.
Publicado: (2026)

Harmonic maps into principal bundles and generalized magnetic maps
por: Benziadi, H., et al.
Publicado: (2025)

On the Gaussian Kinematic Formula of R. Adler and J. Taylor
por: Fu, Joseph H. G.
Publicado: (2024)

Pulling back symmetric Riemannian geometry for data analysis
por: Diepeveen, Willem
Publicado: (2024)

The physical approach on the surfaces of rotation in E24
por: Almaz, Fatma
Publicado: (2021)

Discrete Vector Bundles with Connection
por: Berwick-Evans, Daniel, et al.
Publicado: (2021)

Stress energy momentum in terms of geodesic accelerations and variational tensors including torsion
por: Marsh, Adam
Publicado: (2025)

The geometry of CP violation in Kaluza-Klein models
por: Baptista, Joao
Publicado: (2026)

Simplicial Cheeger-Simons models and simplicial higher abelian gauge theory
por: Teh, Jyh-Haur
Publicado: (2024)

Balanced LoRA: Removing Parameter Invariance to Accelerate Convergence
por: Castin, Valérie, et al.
Publicado: (2026)

The Devil is in the Details: StyleFeatureEditor for Detail-Rich StyleGAN Inversion and High Quality Image Editing
por: Bobkov, Denis, et al.
Publicado: (2024)

Probing the topology of the space of tokens with structured prompts
por: Robinson, Michael, et al.
Publicado: (2025)

Generalized Fermat's principle and Snell's law for cone structures and applications
por: Javaloyes, Miguel Ángel, et al.
Publicado: (2025)