Cover Image

Effective Gradient Sample Size via Variation Estimation for Accelerating Sharpness aware Minimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Deng, Jiaxin, Pang, Junbiao, Zhang, Baochang, Wang, Tian
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimization
by: Deng, Jiaxin, et al.
Published: (2024)

Bilateral Sharpness-Aware Minimization for Flatter Minima
by: Deng, Jiaxin, et al.
Published: (2024)

Adaptively Sampling-Reusing-Mixing Decomposed Gradients to Speed Up Sharpness Aware Minimization
by: Deng, Jiaxin, et al.
Published: (2025)

NCSAM Noise-Compensated Sharpness-Aware Minimization for Noisy Label Learning
by: Xu, Jiayu, et al.
Published: (2026)

Pixel-Wise Symbol Spotting via Progressive Points Location for Parsing CAD Images
by: Pang, Junbiao, et al.
Published: (2024)

MEC-Quant: Maximum Entropy Coding for Extremely Low Bit Quantization-Aware Training
by: Pang, Junbiao, et al.
Published: (2025)

Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks
by: Zou, Jinping, et al.
Published: (2024)

In-Distribution Consistency Regularization Improves the Generalization of Quantization-Aware Training
by: Pang, Junbiao, et al.
Published: (2024)

Domain-Inspired Sharpness-Aware Minimization Under Domain Shifts
by: Zhang, Ruipeng, et al.
Published: (2024)

Modality-Aware SAM: Sharpness-Aware-Minimization Driven Gradient Modulation for Harmonized Multimodal Learning
by: Nowdeh, Hossein R., et al.
Published: (2025)

On-the-Fly Data Augmentation via Gradient-Guided and Sample-Aware Influence Estimation
by: Yang, Suorong, et al.
Published: (2025)

You Only Look One Step: Accelerating Backpropagation in Diffusion Sampling with Gradient Shortcuts
by: Dou, Hongkun, et al.
Published: (2025)

Diversity-Aware Agnostic Ensemble of Sharpness Minimizers
by: Bui, Anh, et al.
Published: (2024)

Explicit Eigenvalue Regularization Improves Sharpness-Aware Minimization
by: Luo, Haocheng, et al.
Published: (2025)

A Channel-ensemble Approach: Unbiased and Low-variance Pseudo-labels is Critical for Semi-supervised Classification
by: Wu, Jiaqi, et al.
Published: (2024)

Attributing Data for Sharpness-Aware Minimization
by: Ren, Chenyang, et al.
Published: (2025)

Momentum-SAM: Sharpness Aware Minimization without Computational Overhead
by: Becker, Marlon, et al.
Published: (2024)

Sharpness-Aware Minimization with Z-Score Gradient Filtering
by: Yun, Vincent-Daniel
Published: (2025)

Open Set Domain Adaptation with Vision-language models via Gradient-aware Separation
by: Chen, Haoyang
Published: (2025)

A Shortcut-aware Video-QA Benchmark for Physical Understanding via Minimal Video Pairs
by: Krojer, Benno, et al.
Published: (2025)

Robust Principal Component Analysis via Discriminant Sample Weight Learning
by: Deng, Yingzhuo, et al.
Published: (2024)

Differential-informed Sample Selection Accelerates Multimodal Contrastive Learning
by: Zhao, Zihua, et al.
Published: (2025)

AdaFSNet: Time Series Classification Based on Convolutional Network with a Adaptive and Effective Kernel Size Configuration
by: Wang, Haoxiao, et al.
Published: (2024)

S2AP: Score-space Sharpness Minimization for Adversarial Pruning
by: Piras, Giorgio, et al.
Published: (2025)

SharpZO: Hybrid Sharpness-Aware Vision Language Model Prompt Tuning via Forward-Only Passes
by: Yang, Yifan, et al.
Published: (2025)

Switch EMA: A Free Lunch for Better Flatness and Sharpness
by: Li, Siyuan, et al.
Published: (2024)

Consistency Model is an Effective Posterior Sample Approximation for Diffusion Inverse Solvers
by: Xu, Tongda, et al.
Published: (2024)

Learning to Generate Gradients for Test-Time Adaptation via Test-Time Training Layers
by: Deng, Qi, et al.
Published: (2024)

BayesDiff: Estimating Pixel-wise Uncertainty in Diffusion via Bayesian Inference
by: Kou, Siqi, et al.
Published: (2023)

Adaptive Spectral Feature Forecasting for Diffusion Sampling Acceleration
by: Han, Jiaqi, et al.
Published: (2026)

BootOOD: Self-Supervised Out-of-Distribution Detection via Synthetic Sample Exposure under Neural Collapse
by: Wang, Yuanchao, et al.
Published: (2025)

A Mixture Autoregressive Image Generative Model on Quadtree Regions for Gaussian Noise Removal via Variational Bayes and Gradient Methods
by: Saito, Shota, et al.
Published: (2026)

Sampling Control for Imbalanced Calibration in Semi-Supervised Learning
by: Tian, Senmao, et al.
Published: (2025)

Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimation
by: Paul, Richard D., et al.
Published: (2024)

Sharp Monocular View Synthesis in Less Than a Second
by: Mescheder, Lars, et al.
Published: (2025)

Mitigating Parameter Interference in Model Merging via Sharpness-Aware Fine-Tuning
by: Lee, Yeoreum, et al.
Published: (2025)

TiMix: Text-aware Image Mixing for Effective Vision-Language Pre-training
by: Jiang, Chaoya, et al.
Published: (2023)

Robust and Generalizable GNN Fine-Tuning via Uncertainty-aware Adapter Learning
by: Jiang, Bo, et al.
Published: (2025)

Progressive Element-wise Gradient Estimation for Neural Network Quantization
by: Zhao, Kaiqi
Published: (2025)

A Note on Generalization in Variational Autoencoders: How Effective Is Synthetic Data & Overparameterization?
by: Xiao, Tim Z., et al.
Published: (2023)