Copertina

Turning Stale Gradients into Stable Gradients: Coherent Coordinate Descent with Implicit Landscape Smoothing for Lightweight Zeroth-Order Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liang, Chen, Sun, Xiatao, Wang, Qian, Rakita, Daniel
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

On the Optimal Construction of Unbiased Gradient Estimators for Zeroth-Order Optimization
di: Ma, Shaocong, et al.
Pubblicazione: (2025)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
di: Lei, Yunwen, et al.
Pubblicazione: (2026)

Mesh RAG: Retrieval Augmentation for Autoregressive Mesh Generation
di: Sun, Xiatao, et al.
Pubblicazione: (2025)

Elastic Multi-Gradient Descent for Parallel Continual Learning
di: Lyu, Fan, et al.
Pubblicazione: (2024)

Revisiting Gradient Staleness: Evaluating Distance Metrics for Asynchronous Federated Learning Aggregation
di: Wilhelm, Patrick, et al.
Pubblicazione: (2026)

Revisiting the Initial Steps in Adaptive Gradient Descent Optimization
di: Abuduweili, Abulikemu, et al.
Pubblicazione: (2024)

Gradient Descent Algorithm Survey
di: Fucheng, Deng, et al.
Pubblicazione: (2025)

Asynchronous Distributed Reinforcement Learning for LQR Control via Zeroth-Order Block Coordinate Descent
di: Jing, Gangshan, et al.
Pubblicazione: (2021)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
di: Liu, Junkang, et al.
Pubblicazione: (2026)

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization
di: Zhao, Huaqin, et al.
Pubblicazione: (2024)

Refining Adaptive Zeroth-Order Optimization at Ease
di: Shu, Yao, et al.
Pubblicazione: (2025)

Zeroth-Order Optimization Finds Flat Minima
di: Zhang, Liang, et al.
Pubblicazione: (2025)

Randomness and Interpolation Improve Gradient Descent
di: Li, Jiawen, et al.
Pubblicazione: (2025)

Learning Associative Memories with Gradient Descent
di: Cabannes, Vivien, et al.
Pubblicazione: (2024)

ONG: Orthogonal Natural Gradient Descent
di: Yadav, Yajat, et al.
Pubblicazione: (2025)

Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimization
di: Kumar, Ramnath, et al.
Pubblicazione: (2023)

Accelerating LMO-Based Optimization via Implicit Gradient Transport
di: Jang, Won-Jun, et al.
Pubblicazione: (2026)

Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Training
di: Ma, Yuhan, et al.
Pubblicazione: (2024)

Vanilla Gradient Descent for Oblique Decision Trees
di: Panda, Subrat Prasad, et al.
Pubblicazione: (2024)

Adaptive Heavy-Tailed Stochastic Gradient Descent
di: Gong, Bodu, et al.
Pubblicazione: (2025)

PSMGD: Periodic Stochastic Multi-Gradient Descent for Fast Multi-Objective Optimization
di: Xu, Mingjing, et al.
Pubblicazione: (2024)

Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networks
di: Wang, Puyu, et al.
Pubblicazione: (2026)

Reconstructing Deep Neural Networks: Unleashing the Optimization Potential of Natural Gradient Descent
di: Liu, Weihua, et al.
Pubblicazione: (2024)

Axiomatization of Gradient Smoothing in Neural Networks
di: Zhou, Linjiang, et al.
Pubblicazione: (2024)

Gradient Descent Efficiency Index
di: Dhingra, Aviral
Pubblicazione: (2024)

On the Inherent Privacy of Zeroth Order Projected Gradient Descent
di: Gupta, Devansh, et al.
Pubblicazione: (2025)

Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent
di: Chen, Bo, et al.
Pubblicazione: (2024)

Subspace-based Approximate Hessian Method for Zeroth-Order Optimization
di: Kim, Dongyoon, et al.
Pubblicazione: (2025)

Do pretrained Transformers Learn In-Context by Gradient Descent?
di: Shen, Lingfeng, et al.
Pubblicazione: (2023)

Auto-Unrolled Proximal Gradient Descent: An AutoML Approach to Interpretable Waveform Optimization
di: Kaplan, Ahmet
Pubblicazione: (2026)

Optimizing Predictive AI in Physical Design Flows with Mini Pixel Batch Gradient Descent
di: Yang, Haoyu, et al.
Pubblicazione: (2024)

Efficient Search for Customized Activation Functions with Gradient Descent
di: Strack, Lukas, et al.
Pubblicazione: (2024)

The Initialization Determines Whether In-Context Learning Is Gradient Descent
di: Xie, Shifeng, et al.
Pubblicazione: (2025)

Conflict-Averse Gradient Descent for Multi-task Learning
di: Liu, Bo, et al.
Pubblicazione: (2021)

Noise Balance and Stationary Distribution of Stochastic Gradient Descent
di: Ziyin, Liu, et al.
Pubblicazione: (2023)

Can LLMs predict the convergence of Stochastic Gradient Descent?
di: Zekri, Oussama, et al.
Pubblicazione: (2024)

Soft Deterministic Policy Gradient with Gaussian Smoothing
di: Na, Hyunjun, et al.
Pubblicazione: (2026)

Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
di: Cheng, Wenhua, et al.
Pubblicazione: (2023)

Fisher-Orthogonal Projected Natural Gradient Descent for Continual Learning
di: Garg, Ishir, et al.
Pubblicazione: (2026)

The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery
di: Zheng, Haiyang, et al.
Pubblicazione: (2026)