Copertina

A Historical Trajectory Assisted Optimization Method for Zeroth-Order Federated Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wu, Chenlin, He, Xiaoyu, Li, Zike, Gong, Jing, Zheng, Zibin
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Refining Adaptive Zeroth-Order Optimization at Ease
di: Shu, Yao, et al.
Pubblicazione: (2025)

Subspace-based Approximate Hessian Method for Zeroth-Order Optimization
di: Kim, Dongyoon, et al.
Pubblicazione: (2025)

Zeroth-Order Optimization Finds Flat Minima
di: Zhang, Liang, et al.
Pubblicazione: (2025)

Zeroth-Order Optimization Meets Human Feedback: Provable Learning via Ranking Oracles
di: Tang, Zhiwei, et al.
Pubblicazione: (2023)

Warming Up for Zeroth-Order Federated Pre-Training with Low Resource Clients
di: Legate, Gwen, et al.
Pubblicazione: (2025)

Communication-Efficient and Differentially Private Vertical Federated Learning with Zeroth-Order Optimization
di: Zhang, Jianing, et al.
Pubblicazione: (2025)

MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models
di: Zhang, Zhen, et al.
Pubblicazione: (2025)

Zeroth-Order Fine-Tuning of LLMs in Random Subspaces
di: Yu, Ziming, et al.
Pubblicazione: (2024)

Mitigating Non-IID Drift in Zeroth-Order Federated LLM Fine-Tuning with Transferable Sparsity
di: Ran, Yide, et al.
Pubblicazione: (2025)

When Foresight Pruning Meets Zeroth-Order Optimization: Efficient Federated Learning for Low-Memory Devices
di: Zhang, Pengyu, et al.
Pubblicazione: (2024)

FZOO: Fast Zeroth-Order Optimizer for Fine-Tuning Large Language Models towards Adam-Scale Speed
di: Dang, Sizhe, et al.
Pubblicazione: (2025)

On the Optimal Construction of Unbiased Gradient Estimators for Zeroth-Order Optimization
di: Ma, Shaocong, et al.
Pubblicazione: (2025)

Differentially Private Zeroth-Order Methods for Scalable Large Language Model Finetuning
di: Liu, Z, et al.
Pubblicazione: (2024)

Zeroth-Order Fine-Tuning of LLMs with Extreme Sparsity
di: Guo, Wentao, et al.
Pubblicazione: (2024)

OAT-Rephrase: Optimization-Aware Training Data Rephrasing for Zeroth-Order LLM Fine-Tuning
di: Long, Jikai, et al.
Pubblicazione: (2025)

Robust and Efficient Zeroth-Order LLM Fine-Tuning via Adaptive Bayesian Subspace Optimizer
di: Feng, Jian, et al.
Pubblicazione: (2026)

QuZO: Quantized Zeroth-Order Fine-Tuning for Large Language Models
di: Zhou, Jiajun, et al.
Pubblicazione: (2025)

Asynchronous Distributed Reinforcement Learning for LQR Control via Zeroth-Order Block Coordinate Descent
di: Jing, Gangshan, et al.
Pubblicazione: (2021)

Zeroth-Order Actor-Critic: An Evolutionary Framework for Sequential Decision Problems
di: Lei, Yuheng, et al.
Pubblicazione: (2022)

CurvZO: Adaptive Curvature-Guided Sparse Zeroth-Order Optimization for Efficient LLM Fine-Tuning
di: Wang, Shuo, et al.
Pubblicazione: (2026)

AdaMeZO: Adam-style Zeroth-Order Optimizer for LLM Fine-tuning Without Maintaining the Moments
di: Cai, Zhijie, et al.
Pubblicazione: (2026)

Oversmoothing: A Nightmare for Graph Contrastive Learning?
di: Li, Jintang, et al.
Pubblicazione: (2023)

Turning Stale Gradients into Stable Gradients: Coherent Coordinate Descent with Implicit Landscape Smoothing for Lightweight Zeroth-Order Optimization
di: Liang, Chen, et al.
Pubblicazione: (2026)

Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models
di: Gautam, Tanmay, et al.
Pubblicazione: (2024)

Perturbation-efficient Zeroth-order Optimization for Hardware-friendly On-device Training
di: Tan, Qitao, et al.
Pubblicazione: (2025)

Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
di: Liu, Yong, et al.
Pubblicazione: (2024)

Online Pseudo-Zeroth-Order Training of Neuromorphic Spiking Neural Networks
di: Xiao, Mingqing, et al.
Pubblicazione: (2024)

Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
di: Gong, Chengyue, et al.
Pubblicazione: (2025)

Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned Perturbations
di: Ma, Shaocong, et al.
Pubblicazione: (2025)

Implicit Hypergraph Neural Networks: A Stable Framework for Higher-Order Relational Learning with Provable Guarantees
di: Li, Xiaoyu, et al.
Pubblicazione: (2025)

ZorBA: Zeroth-order Federated Fine-tuning of LLMs with Heterogeneous Block Activation
di: Meng, Chuiyang, et al.
Pubblicazione: (2026)

Towards Performance-Enhanced Model-Contrastive Federated Learning using Historical Information in Heterogeneous Scenarios
di: Zhang, Hongliang, et al.
Pubblicazione: (2026)

MODULI: Unlocking Preference Generalization via Diffusion Models for Offline Multi-Objective Reinforcement Learning
di: Yuan, Yifu, et al.
Pubblicazione: (2024)

Communication-Efficient Byzantine-Resilient Federated Zero-Order Optimization
di: Neto, Afonso de Sá Delgado, et al.
Pubblicazione: (2024)

Zeroth-Order Adaptive Neuron Alignment Based Pruning without Re-Training
di: Cunegatti, Elia, et al.
Pubblicazione: (2024)

State Space Models on Temporal Graphs: A First-Principles Study
di: Li, Jintang, et al.
Pubblicazione: (2024)

GEPO: Group Expectation Policy Optimization for Stable Heterogeneous Reinforcement Learning
di: Zhang, Han, et al.
Pubblicazione: (2025)

AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
di: Yang, Yifan, et al.
Pubblicazione: (2024)

Efficient Beamforming Optimization for STAR-RIS-Assisted Communications: A Gradient-Based Meta Learning Approach
di: Yang, Dongdong, et al.
Pubblicazione: (2025)

LEMMA: Learning from Errors for MatheMatical Advancement in LLMs
di: Pan, Zhuoshi, et al.
Pubblicazione: (2025)