Cover Image

Preconditioned Sharpness-Aware Minimization: Unifying Analysis and a Novel Learning Algorithm

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Yilang, Li, Bingcong, Giannakis, Georgios B.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

VASSO: Variance Suppression for Sharpness-Aware Minimization
by: Li, Bingcong, et al.
Published: (2025)

Learnable Loss Geometries with Mirror Descent for Scalable and Convergent Meta-Learning
by: Zhang, Yilang, et al.
Published: (2025)

Meta-Learning with Versatile Loss Geometries for Fast Adaptation Using Mirror Descent
by: Zhang, Yilang, et al.
Published: (2023)

RefLoRA: Refactored Low-Rank Adaptation for Efficient Fine-Tuning of Large Models
by: Zhang, Yilang, et al.
Published: (2025)

Low-Rank Adaptation Redux for Large Models
by: Li, Bingcong, et al.
Published: (2026)

Binomial Gradient-Based Meta-Learning for Enhanced Meta-Gradient Estimation
by: Zhang, Yilang, et al.
Published: (2026)

ANCRe: Adaptive Neural Connection Reassignment for Efficient Depth Scaling
by: Zhang, Yilang, et al.
Published: (2026)

Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems
by: Li, Bingcong, et al.
Published: (2024)

ScaLoRA: Optimally Scaled Low-Rank Adaptation for Efficient High-Rank Fine-Tuning
by: Zhang, Yilang, et al.
Published: (2025)

Surrogate modeling for Bayesian optimization beyond a single Gaussian process
by: Lu, Qin, et al.
Published: (2022)

FedVSSAM: Mitigating Flatness Incompatibility in Sharpness-Aware Federated Learning
by: Xiao, Bingnan, et al.
Published: (2026)

A Universal Class of Sharpness-Aware Minimization Algorithms
by: Tahmasebi, Behrooz, et al.
Published: (2024)

Monge SAM: Robust Reparameterization-Invariant Sharpness-Aware Minimization Based on Loss Geometry
by: Jacobsen, Albert Kjøller, et al.
Published: (2025)

Tilted Sharpness-Aware Minimization
by: Li, Tian, et al.
Published: (2024)

Friendly Sharpness-Aware Minimization
by: Li, Tao, et al.
Published: (2024)

Stability Analysis of Sharpness-Aware Minimization
by: Kim, Hoki, et al.
Published: (2023)

Enhancing Sharpness-Aware Minimization by Learning Perturbation Radius
by: Wang, Xuehao, et al.
Published: (2024)

Sharpness-Aware Minimization for Generalized Embedding Learning in Federated Recommendation
by: Yu, Fengyuan, et al.
Published: (2026)

Sharpness-Aware Minimization Revisited: Weighted Sharpness as a Regularization Term
by: Yue, Yun, et al.
Published: (2023)

Agnostic Sharpness-Aware Minimization
by: Nguyen, Van-Anh, et al.
Published: (2024)

Online scalable Gaussian processes with conformal prediction for guaranteed coverage
by: Xu, Jinwen, et al.
Published: (2024)

GCSAM: Gradient Centralized Sharpness Aware Minimization
by: Hassan, Mohamed, et al.
Published: (2025)

1st-Order Magic: Analysis of Sharpness-Aware Minimization
by: Tiwary, Nalin, et al.
Published: (2024)

Conformalized Gaussian processes for online uncertainty quantification over graphs
by: Xu, Jinwen, et al.
Published: (2025)

Sharpness-Aware Minimization: General Analysis and Improved Rates
by: Oikonomou, Dimitris, et al.
Published: (2025)

Asynchronous Sharpness-Aware Minimization For Fast and Accurate Deep Learning
by: Jo, Junhyuk, et al.
Published: (2025)

Sharpness-Aware Minimization Can Hallucinate Minimizers
by: Park, Chanwoong, et al.
Published: (2025)

Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate
by: Harada, Hinata, et al.
Published: (2024)

LightSAM: Parameter-Agnostic Sharpness-Aware Minimization
by: Cheng, Yifei, et al.
Published: (2025)

Towards Understanding the Role of Sharpness-Aware Minimization Algorithms for Out-of-Distribution Generalization
by: Schapiro, Samuel, et al.
Published: (2024)

Sharpness-Aware Minimization Enhances Feature Quality via Balanced Learning
by: Springer, Jacob Mitchell, et al.
Published: (2024)

Focal-SAM: Focal Sharpness-Aware Minimization for Long-Tailed Classification
by: Li, Sicong, et al.
Published: (2025)

LSAM: Asynchronous Distributed Training with Landscape-Smoothed Sharpness-Aware Minimization
by: Teng, Yunfei, et al.
Published: (2025)

Sparse Layer Sharpness-Aware Minimization for Efficient Fine-Tuning
by: Cheng, Yifei, et al.
Published: (2026)

Sharpness-Aware Minimization and the Edge of Stability
by: Long, Philip M., et al.
Published: (2023)

Sharpness-Aware Minimization in Genetic Programming
by: Bakurov, Illya, et al.
Published: (2024)

Sharpness-Aware Minimization for Evolutionary Feature Construction in Regression
by: Zhang, Hengzhe, et al.
Published: (2024)

Bilateral Sharpness-Aware Minimization for Flatter Minima
by: Deng, Jiaxin, et al.
Published: (2024)

Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late in Training
by: Zhou, Zhanpeng, et al.
Published: (2024)

Membership Privacy Risks of Sharpness Aware Minimization
by: Kim, Young In, et al.
Published: (2023)