Image de couverture de livre

Revisiting Zeroth-Order Hessian Approximation: A Single-Step Policy Optimization Lens

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Qiu, Junbin, Hong, Zhaowei, Xu, Renzhe, Shu, Yao
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Zeroth-Order Optimization is Secretly Single-Step Policy Optimization
par: Qiu, Junbin, et autres
Publié: (2025)

Subspace-based Approximate Hessian Method for Zeroth-Order Optimization
par: Kim, Dongyoon, et autres
Publié: (2025)

Compander-Aligned Query Geometry for Quantized Zeroth-Order Optimization
par: Shu, Yao, et autres
Publié: (2026)

Refining Adaptive Zeroth-Order Optimization at Ease
par: Shu, Yao, et autres
Publié: (2025)

Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer
par: Zhao, Yanjun, et autres
Publié: (2024)

The Multi-Query Paradox in Zeroth-Order Optimization
par: Lin, Wei, et autres
Publié: (2025)

Converge Faster, Talk Less: Hessian-Informed Federated Zeroth-Order Optimization
par: Li, Zhe, et autres
Publié: (2025)

Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
par: Zhang, Yihua, et autres
Publié: (2024)

Efficient Federated RLHF via Zeroth-Order Policy Optimization
par: Wang, Deyi, et autres
Publié: (2026)

Stochastic Zeroth-Order Optimization under Strongly Convexity and Lipschitz Hessian: Minimax Sample Complexity
par: Yu, Qian, et autres
Publié: (2024)

Why Zeroth-Order Adaptation May Forget Less: A Randomized Shaping Theory
par: Shu, Yao, et autres
Publié: (2026)

On Adaptivity in Zeroth-Order Optimization
par: Dbouk, Hassan, et autres
Publié: (2026)

Gradient Compressed Sensing: A Query-Efficient Gradient Estimator for High-Dimensional Zeroth-Order Optimization
par: Qiu, Ruizhong, et autres
Publié: (2024)

Z0-Inf: Zeroth Order Approximation for Data Influence
par: Kokhlikyan, Narine, et autres
Publié: (2025)

Private Zeroth-Order Optimization with Public Data
par: Gong, Xuchen, et autres
Publié: (2025)

Learning Dynamics of Zeroth-Order Optimization: A Kernel Perspective
par: Li, Zhe, et autres
Publié: (2026)

Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement Learning
par: Elsayed, Mohamed, et autres
Publié: (2024)

Zeroth-Order Optimization at the Edge of Stability
par: Song, Minhak, et autres
Publié: (2026)

Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned Perturbations
par: Ma, Shaocong, et autres
Publié: (2025)

Position: Zeroth-Order Optimization in Deep Learning Is Underexplored, Not Underpowered
par: Liu, Sijia, et autres
Publié: (2026)

Learning a Zeroth-Order Optimizer for Fine-Tuning LLMs
par: Zhang, Kairun, et autres
Publié: (2025)

A Randomized Zeroth-Order Hierarchical Framework for Heterogeneous Federated Learning
par: Qiu, Yuyang, et autres
Publié: (2025)

Model-Agnostic Zeroth-Order Policy Optimization for Meta-Learning of Ergodic Linear Quadratic Regulators
par: Pan, Yunian, et autres
Publié: (2024)

Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess Risk Optimization
par: Gu, Zhihao, et autres
Publié: (2024)

Gradient-Normalized Smoothness for Optimization with Approximate Hessians
par: Semenov, Andrei, et autres
Publié: (2025)

Zeroth-Order Optimization Finds Flat Minima
par: Zhang, Liang, et autres
Publié: (2025)

Certified Multi-Fidelity Zeroth-Order Optimization
par: de Montbrun, Étienne, et autres
Publié: (2023)

Private Zeroth-Order Nonsmooth Nonconvex Optimization
par: Zhang, Qinzi, et autres
Publié: (2024)

A New Formulation for Zeroth-Order Optimization of Adversarial EXEmples in Malware Detection
par: Rando, Marco, et autres
Publié: (2024)

Elucidating Subspace Perturbation in Zeroth-Order Optimization: Theory and Practice at Scale
par: Park, Sihwan, et autres
Publié: (2025)

Privacy Amplification in Differentially Private Zeroth-Order Optimization with Hidden States
par: Chien, Eli, et autres
Publié: (2025)

Low-Rank Curvature for Zeroth-Order Optimization in LLM Fine-Tuning
par: Seung, Hyunseok, et autres
Publié: (2025)

Single Point-Based Distributed Zeroth-Order Optimization with a Non-Convex Stochastic Objective Function
par: Mhanna, Elissa, et autres
Publié: (2024)

OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations
par: Shu, Yao, et autres
Publié: (2024)

Zeroth-Order Methods for Stochastic Nonconvex Nonsmooth Composite Optimization
par: Chen, Ziyi, et autres
Publié: (2025)

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization
par: Zhao, Huaqin, et autres
Publié: (2024)

Model Evolution Under Zeroth-Order Optimization: A Neural Tangent Kernel Perspective
par: Zhang, Chen, et autres
Publié: (2026)

Accelerating Zeroth-Order Spectral Optimization with Partial Orthogonalization from Power Iteration
par: Chen, Jiahe, et autres
Publié: (2026)

Universally Empowering Zeroth-Order Optimization via Adaptive Layer-wise Sampling
par: Wang, Fei, et autres
Publié: (2026)

DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training
par: Chen, Aochuan, et autres
Publié: (2023)