Don't Be Greedy, Just Relax! Pruning LLMs via Frank-Wolfe
Fuente:
arXiv
Saved in:
| Main Authors: | Roux, Christophe, Zimmer, Max, d'Aspremont, Alexandre, Pokutta, Sebastian |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Compression-aware Training of Neural Networks using Frank-Wolfe
by: Zimmer, Max, et al.
Published: (2022)
by: Zimmer, Max, et al.
Published: (2022)
Oblivious Stochastic Composite Optimization
by: Lezane, Clément, et al.
Published: (2023)
by: Lezane, Clément, et al.
Published: (2023)
Frank-Wolfe meets Shapley-Folkman: a systematic approach for solving nonconvex separable problems with linear constraints
by: Dubois-Taine, Benjamin, et al.
Published: (2024)
by: Dubois-Taine, Benjamin, et al.
Published: (2024)
Scalable DC Optimization via Adaptive Frank-Wolfe Algorithms
by: Pokutta, Sebastian
Published: (2025)
by: Pokutta, Sebastian
Published: (2025)
Optimal Algorithms for Stochastic Complementary Composite Minimization
by: d'Aspremont, Alexandre, et al.
Published: (2022)
by: d'Aspremont, Alexandre, et al.
Published: (2022)
Lower Bounds for Frank-Wolfe on Strongly Convex Sets
by: Halbey, Jannis, et al.
Published: (2026)
by: Halbey, Jannis, et al.
Published: (2026)
Acceleration Methods
by: d'Aspremont, Alexandre, et al.
Published: (2021)
by: d'Aspremont, Alexandre, et al.
Published: (2021)
Curvature-Dependent Lower Bounds for Frank-Wolfe
by: Halbey, Jannis, et al.
Published: (2026)
by: Halbey, Jannis, et al.
Published: (2026)
Beyond Short Steps in Frank-Wolfe Algorithms
by: Martínez-Rubio, David, et al.
Published: (2025)
by: Martínez-Rubio, David, et al.
Published: (2025)
Scalable Frank-Wolfe on Generalized Self-concordant Functions via Simple Steps
by: Carderera, Alejandro, et al.
Published: (2021)
by: Carderera, Alejandro, et al.
Published: (2021)
Strong Convexity of Sets in Riemannian Manifolds
by: Scieur, Damien, et al.
Published: (2023)
by: Scieur, Damien, et al.
Published: (2023)
Linear Convergence of the Frank-Wolfe Algorithm over Product Polytopes
by: Iommazzo, Gabriele, et al.
Published: (2025)
by: Iommazzo, Gabriele, et al.
Published: (2025)
Frank-Wolfe Beyond 1/t Convergence
by: Pokutta, Sebastian
Published: (2026)
by: Pokutta, Sebastian
Published: (2026)
Convex mixed-integer optimization with Frank-Wolfe methods
by: Hendrych, Deborah, et al.
Published: (2022)
by: Hendrych, Deborah, et al.
Published: (2022)
Implicit Riemannian Optimism with Applications to Min-Max Problems
by: Roux, Christophe, et al.
Published: (2025)
by: Roux, Christophe, et al.
Published: (2025)
Iteratively Reweighted Least Squares for Phase Unwrapping
by: Dubois-Taine, Benjamin, et al.
Published: (2024)
by: Dubois-Taine, Benjamin, et al.
Published: (2024)
Lions and Muons: Optimization via Stochastic Frank-Wolfe
by: Sfyraki, Maria-Eleni, et al.
Published: (2025)
by: Sfyraki, Maria-Eleni, et al.
Published: (2025)
Symmetric multipartite Bell inequalities via Frank-Wolfe algorithms
by: Designolle, Sébastien, et al.
Published: (2023)
by: Designolle, Sébastien, et al.
Published: (2023)
Stochastic Compositional Optimization via Hybrid Momentum Frank--Wolfe
by: Chayti, El Mahdi
Published: (2026)
by: Chayti, El Mahdi
Published: (2026)
Don't Explain Noise: Robust Counterfactuals for Randomized Ensembles
by: Forel, Alexandre, et al.
Published: (2022)
by: Forel, Alexandre, et al.
Published: (2022)
Secant Line Search for Frank-Wolfe Algorithms
by: Hendrych, Deborah, et al.
Published: (2025)
by: Hendrych, Deborah, et al.
Published: (2025)
The Pivoting Framework: Frank-Wolfe Algorithms with Active Set Size Control
by: Wirth, Elias, et al.
Published: (2024)
by: Wirth, Elias, et al.
Published: (2024)
Random-Subspace Frank--Wolfe over Strongly Convex Sets
by: Poirion, Pierre-Louis, et al.
Published: (2026)
by: Poirion, Pierre-Louis, et al.
Published: (2026)
Adaptive Open-Loop Step-Sizes for Accelerated Convergence Rates of the Frank-Wolfe Algorithm
by: Wirth, Elias, et al.
Published: (2025)
by: Wirth, Elias, et al.
Published: (2025)
Accelerated Frank-Wolfe Algorithms: Complementarity Conditions and Sparsity
by: Garber, Dan
Published: (2025)
by: Garber, Dan
Published: (2025)
Projected Forward Gradient-Guided Frank-Wolfe Algorithm via Variance Reduction
by: Rostami, M., et al.
Published: (2024)
by: Rostami, M., et al.
Published: (2024)
Network Design for the Traffic Assignment Problem with Mixed-Integer Frank-Wolfe
by: Sharma, Kartikey, et al.
Published: (2024)
by: Sharma, Kartikey, et al.
Published: (2024)
Accelerated Affine-Invariant Convergence Rates of the Frank-Wolfe Algorithm with Open-Loop Step-Sizes
by: Wirth, Elias, et al.
Published: (2023)
by: Wirth, Elias, et al.
Published: (2023)
Naive Feature Selection: a Nearly Tight Convex Relaxation for Sparse Naive Bayes
by: Askari, Armin, et al.
Published: (2019)
by: Askari, Armin, et al.
Published: (2019)
Second-order Conditional Gradient Sliding
by: Carderera, Alejandro, et al.
Published: (2020)
by: Carderera, Alejandro, et al.
Published: (2020)
Abs-Smooth Frank-Wolfe Method: Primal-Dual Analysis, Heavy Ball Momentum, and Inexact Oracles
by: Tadinada, Sri Harshitha, et al.
Published: (2026)
by: Tadinada, Sri Harshitha, et al.
Published: (2026)
Fast Stochastic Composite Minimization and an Accelerated Frank-Wolfe Algorithm under Parallelization
by: Dubois-Taine, Benjamin, et al.
Published: (2022)
by: Dubois-Taine, Benjamin, et al.
Published: (2022)
Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical Features
by: Beznosikov, Aleksandr, et al.
Published: (2023)
by: Beznosikov, Aleksandr, et al.
Published: (2023)
Fast convergence of Frank-Wolfe algorithms on polytopes
by: Wirth, Elias, et al.
Published: (2024)
by: Wirth, Elias, et al.
Published: (2024)
Using Taylor-Approximated Gradients to Improve the Frank-Wolfe Method for Empirical Risk Minimization
by: Xiong, Zikai, et al.
Published: (2022)
by: Xiong, Zikai, et al.
Published: (2022)
A Free Lunch in LLM Compression: Revisiting Retraining after Pruning
by: Wagner, Moritz, et al.
Published: (2025)
by: Wagner, Moritz, et al.
Published: (2025)
Revisiting Frank-Wolfe for Structured Nonconvex Optimization
by: Maskan, Hoomaan, et al.
Published: (2025)
by: Maskan, Hoomaan, et al.
Published: (2025)
A Randomized Linearly Convergent Frank-Wolfe-type Method for Smooth Convex Minimization over the Spectrahedron
by: Garber, Dan
Published: (2025)
by: Garber, Dan
Published: (2025)
Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point
by: Martínez-Rubio, David, et al.
Published: (2024)
by: Martínez-Rubio, David, et al.
Published: (2024)
Don't Be So Positive: Negative Step Sizes in Second-Order Methods
by: Shea, Betty, et al.
Published: (2024)
by: Shea, Betty, et al.
Published: (2024)
Similar Items
-
Compression-aware Training of Neural Networks using Frank-Wolfe
by: Zimmer, Max, et al.
Published: (2022) -
Oblivious Stochastic Composite Optimization
by: Lezane, Clément, et al.
Published: (2023) -
Frank-Wolfe meets Shapley-Folkman: a systematic approach for solving nonconvex separable problems with linear constraints
by: Dubois-Taine, Benjamin, et al.
Published: (2024) -
Scalable DC Optimization via Adaptive Frank-Wolfe Algorithms
by: Pokutta, Sebastian
Published: (2025) -
Optimal Algorithms for Stochastic Complementary Composite Minimization
by: d'Aspremont, Alexandre, et al.
Published: (2022)