:: Library Catalog

Image de couverture de livre

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lion, Kai, Hübler, Florian, Li, Bingcong, Orvieto, Antonio, He, Niao
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	https://arxiv.org/abs/2605.10797
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

PoLAR: Polar-Decomposed Low-Rank Adapter Representation
par: Lion, Kai, et autres
Publié: (2025)

From Gradient Clipping to Normalization for Heavy Tailed SGD
par: Hübler, Florian, et autres
Publié: (2024)

Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems
par: Li, Bingcong, et autres
Publié: (2024)

Can RLHF be More Efficient with Imperfect Reward Models? A Policy Coverage Perspective
par: Huang, Jiawei, et autres
Publié: (2025)

On the Benefits of Weight Normalization for Overparameterized Matrix Sensing
par: Wei, Yudong, et autres
Publié: (2025)

On the Crucial Role of Initialization for Matrix Factorization
par: Li, Bingcong, et autres
Publié: (2024)

ANCRe: Adaptive Neural Connection Reassignment for Efficient Depth Scaling
par: Zhang, Yilang, et autres
Publié: (2026)

Zeroth-Order Optimization at the Edge of Stability
par: Song, Minhak, et autres
Publié: (2026)

Zeroth-Order Optimization Finds Flat Minima
par: Zhang, Liang, et autres
Publié: (2025)

DPZero: Private Fine-Tuning of Language Models without Backpropagation
par: Zhang, Liang, et autres
Publié: (2023)

Muon Optimizes Under Spectral Norm Constraints
par: Chen, Lizhang, et autres
Publié: (2025)

SALAAD: Sparse And Low-Rank Adaptation via ADMM for Large Language Model Inference
par: Ma, Hao, et autres
Publié: (2026)

Can SGD Handle Heavy-Tailed Noise?
par: Fatkhullin, Ilyas, et autres
Publié: (2025)

Integrated electro-optic attention nonlinearities for transformers
par: Mickeler, Luis, et autres
Publié: (2026)

TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization
par: Li, Xiang, et autres
Publié: (2022)

NuMuon: Nuclear-Norm-Constrained Muon for Compressible LLM Training
par: Dolatabadi, Hadi Mohaghegh, et autres
Publié: (2026)

Adam Simplified: Bias Correction Debunked
par: Laing, Sam, et autres
Publié: (2025)

Revisiting associative recall in modern recurrent models
par: Okpekpe, Destiny, et autres
Publié: (2025)

Landing with the Score: Riemannian Optimization through Denoising
par: Kharitenko, Andrey, et autres
Publié: (2025)

An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
par: Orvieto, Antonio, et autres
Publié: (2024)

In Search of Adam's Secret Sauce
par: Orvieto, Antonio, et autres
Publié: (2025)

Enhancing Optimizer Stability: Momentum Adaptation of The NGN Step-size
par: Islamov, Rustem, et autres
Publié: (2025)

Recurrent neural networks: vanishing and exploding gradients are not the end of the story
par: Zucchet, Nicolas, et autres
Publié: (2024)

Robust Knowledge Transfer in Tiered Reinforcement Learning
par: Huang, Jiawei, et autres
Publié: (2023)

Explaining Grokking in Transformers through the Lens of Inductive Bias
par: Singh, Jaisidh, et autres
Publié: (2026)

Universal Dynamics of Warmup Stable Decay: understanding WSD beyond Transformers
par: Belloni, Annalisa, et autres
Publié: (2026)

Improved state mixing in higher-order and block diagonal linear recurrent networks
par: Dubinin, Igor, et autres
Publié: (2026)

An Uncertainty Principle for Linear Recurrent Neural Networks
par: François, Alexandre, et autres
Publié: (2025)

When, Where and Why to Average Weights?
par: Ajroldi, Niccolò, et autres
Publié: (2025)

Flow Density Control: Generative Optimization Beyond Entropy-Regularized Fine-Tuning
par: De Santi, Riccardo, et autres
Publié: (2025)

Optimal Guarantees for Algorithmic Reproducibility and Gradient Complexity in Convex Optimization
par: Zhang, Liang, et autres
Publié: (2023)

AdaMuon: Adaptive Muon Optimizer
par: Si, Chongjie, et autres
Publié: (2025)

Recurrent Distance Filtering for Graph Representation Learning
par: Ding, Yuhui, et autres
Publié: (2023)

Multi-level Monte-Carlo Gradient Methods for Stochastic Optimization with Biased Oracles
par: Hu, Yifan, et autres
Publié: (2024)

Global Optimality for Constrained Exploration via Penalty Regularization
par: Wolf, Florian, et autres
Publié: (2026)

A Schrödinger Eigenfunction Method for Long-Horizon Stochastic Optimal Control
par: Claeys, Louis, et autres
Publié: (2026)

Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimization
par: Zhai, Zhiyuan, et autres
Publié: (2026)

Biased Stochastic First-Order Methods for Conditional Stochastic Optimization and Applications in Meta Learning
par: Hu, Yifan, et autres
Publié: (2020)

Is your batch size the problem? Revisiting the Adam-SGD gap in language modeling
par: Srećković, Teodora, et autres
Publié: (2025)

Scalable Variational Bayesian Fine-Tuning of LLMs via Orthogonalized Low-Rank Adapters
par: Xiang, Haotian, et autres
Publié: (2026)