Image de couverture de livre

Lions and Muons: Optimization via Stochastic Frank-Wolfe

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Sfyraki, Maria-Eleni, Wang, Jun-Kun
Format:	Preprint
Publié:	2025
Sujets:	Optimization and Control Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Stochastic Compositional Optimization via Hybrid Momentum Frank--Wolfe
par: Chayti, El Mahdi
Publié: (2026)

Scalable DC Optimization via Adaptive Frank-Wolfe Algorithms
par: Pokutta, Sebastian
Publié: (2025)

Fast Stochastic Composite Minimization and an Accelerated Frank-Wolfe Algorithm under Parallelization
par: Dubois-Taine, Benjamin, et autres
Publié: (2022)

Beyond Short Steps in Frank-Wolfe Algorithms
par: Martínez-Rubio, David, et autres
Publié: (2025)

Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical Features
par: Beznosikov, Aleksandr, et autres
Publié: (2023)

Don't Be Greedy, Just Relax! Pruning LLMs via Frank-Wolfe
par: Roux, Christophe, et autres
Publié: (2025)

Revisiting Frank-Wolfe for Structured Nonconvex Optimization
par: Maskan, Hoomaan, et autres
Publié: (2025)

Accelerated Frank-Wolfe Algorithms: Complementarity Conditions and Sparsity
par: Garber, Dan
Publié: (2025)

Scalable Frank-Wolfe on Generalized Self-concordant Functions via Simple Steps
par: Carderera, Alejandro, et autres
Publié: (2021)

Projected Forward Gradient-Guided Frank-Wolfe Algorithm via Variance Reduction
par: Rostami, M., et autres
Publié: (2024)

Linear Convergence of the Frank-Wolfe Algorithm over Product Polytopes
par: Iommazzo, Gabriele, et autres
Publié: (2025)

Compression-aware Training of Neural Networks using Frank-Wolfe
par: Zimmer, Max, et autres
Publié: (2022)

Using Taylor-Approximated Gradients to Improve the Frank-Wolfe Method for Empirical Risk Minimization
par: Xiong, Zikai, et autres
Publié: (2022)

LiMuon: Light and Fast Muon Optimizer for Large Models
par: Huang, Feihu, et autres
Publié: (2025)

A Randomized Linearly Convergent Frank-Wolfe-type Method for Smooth Convex Minimization over the Spectrahedron
par: Garber, Dan
Publié: (2025)

Convex mixed-integer optimization with Frank-Wolfe methods
par: Hendrych, Deborah, et autres
Publié: (2022)

MuonBP: Faster Muon via Block-Periodic Orthogonalization
par: Khaled, Ahmed, et autres
Publié: (2025)

Boosted Stochastic Frank-Wolfe for Constrained Nonconvex Optimization
par: Nandhan, Navil, et autres
Publié: (2026)

Convergence Analysis of the Lion Optimizer in Centralized and Distributed Settings
par: Jiang, Wei, et autres
Publié: (2025)

CLion: Efficient Cautious Lion Optimizer with Enhanced Generalization
par: Huang, Feihu, et autres
Publié: (2026)

Improved Convergence Rates of Muon Optimizer for Nonconvex Optimization
par: Nagashima, Shuntaro, et autres
Publié: (2026)

Muon Optimizes Under Spectral Norm Constraints
par: Chen, Lizhang, et autres
Publié: (2025)

Phases of Muon: When Muon Eclipses SignSGD
par: Paquette, Elliot, et autres
Publié: (2026)

Stochastic Origin Frank-Wolfe for traffic assignment
par: Ignashin, Igor, et autres
Publié: (2025)

The Newton-Muon Optimizer
par: Du, Zhehang, et autres
Publié: (2026)

Optimal Complexity in Byzantine-Robust Distributed Stochastic Optimization with Data Heterogeneity
par: Shi, Qiankun, et autres
Publié: (2025)

MiMuon: Mixed Muon Optimizer with Improved Generalization for Large Models
par: Huang, Feihu, et autres
Publié: (2026)

FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
par: Takezawa, Yuki, et autres
Publié: (2025)

Achieving Linear Speedup with ProxSkip in Distributed Stochastic Optimization
par: Guo, Luyao, et autres
Publié: (2023)

Leveraging Coordinate Momentum in SignSGD and Muon: Memory-Optimized Zero-Order
par: Petrov, Egor, et autres
Publié: (2025)

Revisiting Active Sequential Prediction-Powered Mean Estimation
par: Sfyraki, Maria-Eleni, et autres
Publié: (2026)

Error Feedback for Muon and Friends
par: Gruntkowska, Kaja, et autres
Publié: (2025)

Convergence of Muon with Newton-Schulz
par: Kim, Gyu Yeol, et autres
Publié: (2026)

Stochastic Frank-Wolfe: Unified Analysis and Zoo of Special Cases
par: Nazykov, Ruslan, et autres
Publié: (2024)

Muon in Associative Memory Learning: Training Dynamics and Scaling Laws
par: Li, Binghui, et autres
Publié: (2026)

Deterministic and Stochastic Frank-Wolfe Recursion on Probability Spaces
par: Yu, Di, et autres
Publié: (2024)

Insights on Muon from Simple Quadratics
par: Gonon, Antoine, et autres
Publié: (2026)

Stochastic-Constrained Stochastic Optimization with Markovian Data
par: Kim, Yeongjong, et autres
Publié: (2023)

Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)
par: Riabinin, Artem, et autres
Publié: (2025)

Comparing Few to Rank Many: Active Human Preference Learning using Randomized Frank-Wolfe
par: Thekumparampil, Kiran Koshy, et autres
Publié: (2024)