Image de couverture de livre

Dimension-Free Saddle-Point Escape in Muon

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Long, Yanlin, Gu, Yufei, Xie, Zeke
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Mano: Restriking Manifold Optimization for LLM Training
par: Gu, Yufei, et autres
Publié: (2026)

Efficiently Escaping Saddle Points for Policy Optimization
par: Khorasani, Sadegh, et autres
Publié: (2023)

Hessian-guided Perturbed Wasserstein Gradient Flows for Escaping Saddle Points
par: Yamamoto, Naoya, et autres
Publié: (2025)

Saddle-To-Saddle Dynamics in Deep ReLU Networks: Low-Rank Bias in the First Saddle Escape
par: Bantzis, Ioannis, et autres
Publié: (2025)

Efficiently Escaping Saddle Points under Generalized Smoothness via Self-Bounding Regularity
par: Cao, Daniel Yiming, et autres
Publié: (2025)

Escaping Saddle Points for Nonsmooth Weakly Convex Functions via Perturbed Proximal Algorithms
par: Huang, Minhui, et autres
Publié: (2021)

Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding
par: Wu, Frank Zhengqing, et autres
Publié: (2024)

Dimer-Enhanced Optimization: A First-Order Approach to Escaping Saddle Points in Neural Network Training
par: Hu, Yue, et autres
Publié: (2025)

A Theory of Saddle Escape in Deep Nonlinear Networks
par: Rawal, Divit, et autres
Publié: (2026)

Late-to-Early Training: LET LLMs Learn Earlier, So Faster and Better
par: Zhao, Ji, et autres
Publié: (2026)

Regret Minimization via Saddle Point Optimization
par: Kirschner, Johannes, et autres
Publié: (2024)

Federated Composite Saddle Point Optimization
par: Bai, Site, et autres
Publié: (2023)

Neural Network-based High-index Saddle Dynamics Method for Searching Saddle Points and Solution Landscape
par: Liu, Yuankai, et autres
Publié: (2024)

Proximal Point Method for Online Saddle Point Problem
par: Meng, Qing-xin, et autres
Publié: (2024)

Quantization Avoids Saddle Points in Distributed Optimization
par: Bo, Yanan, et autres
Publié: (2024)

Mirror Descent Algorithms with Nearly Dimension-Independent Rates for Differentially-Private Stochastic Saddle-Point Problems
par: González, Tomás, et autres
Publié: (2024)

Inertial Newton Algorithms Avoiding Strict Saddle Points
par: Castera, Camille
Publié: (2021)

Refining Multidimensional Video Reward Models via Disentangled Influence Functions
par: Wang, Muyao, et autres
Publié: (2026)

Simultaneous Learning and Optimization via Misspecified Saddle Point Problems
par: Ahmadi, Mohammad Mahdi, et autres
Publié: (2025)

A Saddle Point Remedy: Power of Variable Elimination in Non-convex Optimization
par: Gan, Min, et autres
Publié: (2025)

Stochastic Gradient Descent in the Saddle-to-Saddle Regime of Deep Linear Networks
par: Corlouer, Guillaume, et autres
Publié: (2026)

Class-wise Activation Unravelling the Engima of Deep Double Descent
par: Gu, Yufei
Publié: (2024)

NuMuon: Nuclear-Norm-Constrained Muon for Compressible LLM Training
par: Dolatabadi, Hadi Mohaghegh, et autres
Publié: (2026)

Series of Hessian-Vector Products for Tractable Saddle-Free Newton Optimisation of Neural Networks
par: Oldewage, Elre T., et autres
Publié: (2023)

Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures
par: Zhang, Yedi, et autres
Publié: (2025)

Exploring New Frontiers in Vertical Federated Learning: the Role of Saddle Point Reformulation
par: Beznosikov, Aleksandr, et autres
Publié: (2026)

Online Min-Max Optimization: From Individual Regrets to Cumulative Saddle Points
par: Vyas, Abhijeet, et autres
Publié: (2026)

AdaMuon: Adaptive Muon Optimizer
par: Si, Chongjie, et autres
Publié: (2025)

Bilevel Optimization over Saddle Points of Zero-Sum Markov Games
par: Zheng, Zihao, et autres
Publié: (2026)

Enhancing Stability of Physics-Informed Neural Network Training Through Saddle-Point Reformulation
par: Bylinkin, Dmitry, et autres
Publié: (2025)

Accelerated Gradient Methods for Nonconvex Optimization: Escape Trajectories From Strict Saddle Points and Convergence to Local Minima
par: Dixit, Rishabh, et autres
Publié: (2023)

Escaping Saddle Points via Curvature-Calibrated Perturbations: A Complete Analysis with Explicit Constants and Empirical Validation
par: Alpay, Faruk, et autres
Publié: (2025)

Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD
par: Dudukalov, Dmitry, et autres
Publié: (2025)

Weak-to-Strong Diffusion with Reflection
par: Bai, Lichen, et autres
Publié: (2025)

Private Algorithms for Stochastic Saddle Points and Variational Inequalities: Beyond Euclidean Geometry
par: Bassily, Raef, et autres
Publié: (2024)

From Saddle Points Toward Global Minima: A Newton-Type Method on Wasserstein Space
par: Lascu, Razvan-Andrei, et autres
Publié: (2026)

Saddle-Free Guidance: Improved On-Manifold Sampling without Labels or Additional Training
par: Yeats, Eric, et autres
Publié: (2025)

Channel Matters: Estimating Channel Influence for Multivariate Time Series
par: Wang, Muyao, et autres
Publié: (2024)

Multiphysics Bench: Benchmarking and Investigating Scientific Machine Learning for Multiphysics PDEs
par: Yang, Changfan, et autres
Publié: (2025)

WinQ: Accelerating Quantization-Aware Training of Language Models Around Saddle Points
par: Li, Dongyue, et autres
Publié: (2026)