Cover Image

ZO-SAM: Zero-Order Sharpness-Aware Minimization for Efficient Sparse Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ji, Jie, Li, Gen, Deng, Kaiyuan, Afghah, Fatemeh, Ma, Xiaolong
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Modality-Aware SAM: Sharpness-Aware-Minimization Driven Gradient Modulation for Harmonized Multimodal Learning
by: Nowdeh, Hossein R., et al.
Published: (2025)

FairSAM: Fair Classification on Corrupted Data Through Sharpness-Aware Minimization
by: Dai, Yucong, et al.
Published: (2025)

Task Specific Sharpness Aware O-RAN Resource Management using Multi Agent Reinforcement Learning
by: Lotfi, Fatemeh, et al.
Published: (2025)

Sparse Layer Sharpness-Aware Minimization for Efficient Fine-Tuning
by: Cheng, Yifei, et al.
Published: (2026)

LightSAM: Parameter-Agnostic Sharpness-Aware Minimization
by: Cheng, Yifei, et al.
Published: (2025)

Data Overfitting for On-Device Super-Resolution with Dynamic Algorithm and Compiler Co-Design
by: Li, Gen, et al.
Published: (2024)

Forget-It-All: Multi-Concept Machine Unlearning via Concept-Aware Neuron Masking
by: Deng, Kaiyuan, et al.
Published: (2026)

Sculpting Memory: Multi-Concept Forgetting in Diffusion Models via Dynamic Mask and Concept-Aware Optimization
by: Li, Gen, et al.
Published: (2025)

Focal-SAM: Focal Sharpness-Aware Minimization for Long-Tailed Classification
by: Li, Sicong, et al.
Published: (2025)

Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late in Training
by: Zhou, Zhanpeng, et al.
Published: (2024)

LightCache: Memory-Efficient, Training-Free Acceleration for Video Generation
by: Xiao, Yang, et al.
Published: (2025)

Momentum-SAM: Sharpness Aware Minimization without Computational Overhead
by: Becker, Marlon, et al.
Published: (2024)

CurvZO: Adaptive Curvature-Guided Sparse Zeroth-Order Optimization for Efficient LLM Fine-Tuning
by: Wang, Shuo, et al.
Published: (2026)

The Right to be Forgotten in Pruning: Unveil Machine Unlearning on Sparse Models
by: Xiao, Yang, et al.
Published: (2025)

Forget Many, Forget Right: Scalable and Precise Concept Unlearning in Diffusion Models
by: Deng, Kaiyuan, et al.
Published: (2026)

Monge SAM: Robust Reparameterization-Invariant Sharpness-Aware Minimization Based on Loss Geometry
by: Jacobsen, Albert Kjøller, et al.
Published: (2025)

X-SAM: Boosting Sharpness-Aware Minimization with Dominant-Eigenvector Gradient Correction
by: Duan, Hongru, et al.
Published: (2026)

1st-Order Magic: Analysis of Sharpness-Aware Minimization
by: Tiwary, Nalin, et al.
Published: (2024)

Meta Hierarchical Reinforcement Learning for Scalable Resource Management in O-RAN
by: Lotfi, Fatemeh, et al.
Published: (2025)

Adaptive Meta-learning-based Adversarial Training for Robust Automatic Modulation Classification
by: Bamdad, Amirmohammad, et al.
Published: (2025)

Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks
by: Zou, Jinping, et al.
Published: (2024)

Tilted Sharpness-Aware Minimization
by: Li, Tian, et al.
Published: (2024)

Friendly Sharpness-Aware Minimization
by: Li, Tao, et al.
Published: (2024)

SharpZO: Hybrid Sharpness-Aware Vision Language Model Prompt Tuning via Forward-Only Passes
by: Yang, Yifan, et al.
Published: (2025)

Open RAN LSTM Traffic Prediction and Slice Management using Deep Reinforcement Learning
by: Lotfi, Fatemeh, et al.
Published: (2024)

ORAN-GUIDE: RAG-Driven Prompt Learning for LLM-Augmented Reinforcement Learning in O-RAN Network Slicing
by: Lotfi, Fatemeh, et al.
Published: (2025)

Prompt-Tuned LLM-Augmented DRL for Dynamic O-RAN Network Slicing
by: Lotfi, Fatemeh, et al.
Published: (2025)

Agnostic Sharpness-Aware Minimization
by: Nguyen, Van-Anh, et al.
Published: (2024)

Meta Reinforcement Learning Approach for Adaptive Resource Optimization in O-RAN
by: Lotfi, Fatemeh, et al.
Published: (2024)

ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization
by: Sugiura, Keisuke, et al.
Published: (2025)

Efficient Sharpness-Aware Minimization for Molecular Graph Transformer Models
by: Wang, Yili, et al.
Published: (2024)

LSAM: Asynchronous Distributed Training with Landscape-Smoothed Sharpness-Aware Minimization
by: Teng, Yunfei, et al.
Published: (2025)

Sharpness-Aware Minimization in Logit Space Efficiently Enhances Direct Preference Optimization
by: Luo, Haocheng, et al.
Published: (2026)

Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
by: Liu, Yong, et al.
Published: (2024)

Training Diagonal Linear Networks with Stochastic Sharpness-Aware Minimization
by: Clara, Gabriel, et al.
Published: (2025)

VASSO: Variance Suppression for Sharpness-Aware Minimization
by: Li, Bingcong, et al.
Published: (2025)

Bilateral Sharpness-Aware Minimization for Flatter Minima
by: Deng, Jiaxin, et al.
Published: (2024)

Sharpness-Aware Minimization Can Hallucinate Minimizers
by: Park, Chanwoong, et al.
Published: (2025)

On the Duality Between Sharpness-Aware Minimization and Adversarial Training
by: Zhang, Yihao, et al.
Published: (2024)

Sharpness-Aware Minimization Revisited: Weighted Sharpness as a Regularization Term
by: Yue, Yun, et al.
Published: (2023)