Image de couverture de livre

Exploring the Optimized Value of Each Hyperparameter in Various Gradient Descent Algorithms

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Chen, Abel C. H.
Format:	Preprint
Publié:	2022
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Multiple Wasserstein Gradient Descent Algorithm for Multi-Objective Distributional Optimization
par: Nguyen, Dai Hai, et autres
Publié: (2025)

Gradient Descent Algorithm Survey
par: Fucheng, Deng, et autres
Publié: (2025)

Sequential Policy Gradient for Adaptive Hyperparameter Optimization
par: Li, Zheng, et autres
Publié: (2025)

From Logistic Regression to the Perceptron Algorithm: Exploring Gradient Descent with Large Step Sizes
par: Tyurin, Alexander
Publié: (2024)

Accelerating Feedback-based Algorithms for Quantum Optimization Using Gradient Descent
par: Mozakka, Masih, et autres
Publié: (2026)

Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
par: Lin, Tianyi, et autres
Publié: (2024)

Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Features
par: Dunbar, Oliver R. A., et autres
Publié: (2024)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
par: Lei, Yunwen, et autres
Publié: (2026)

On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent
par: Li, Bingrui, et autres
Publié: (2024)

HyperSHAP: Shapley Values and Interactions for Explaining Hyperparameter Optimization
par: Wever, Marcel, et autres
Publié: (2025)

PMGDA: A Preference-based Multiple Gradient Descent Algorithm
par: Zhang, Xiaoyuan, et autres
Publié: (2024)

Learning Algorithm Hyperparameters for Fast Parametric Convex Optimization
par: Sambharya, Rajiv, et autres
Publié: (2024)

Overtuning in Hyperparameter Optimization
par: Schneider, Lennart, et autres
Publié: (2025)

Quantum Shadow Gradient Descent for Variational Quantum Algorithms
par: Heidari, Mohsen, et autres
Publié: (2023)

Dynamic Decoupling of Placid Terminal Attractor-based Gradient Descent Algorithm
par: Zhao, Jinwei, et autres
Publié: (2024)

Enhancing Fractional Gradient Descent with Learned Optimizers
par: Sobotka, Jan, et autres
Publié: (2025)

Preconditioning for Accelerated Gradient Descent Optimization and Regularization
par: Ye, Qiang
Publié: (2024)

How to Prove the Optimized Values of Hyperparameters for Particle Swarm Optimization?
par: Chen, Abel C. H.
Publié: (2023)

Occam Gradient Descent
par: Kausik, B. N.
Publié: (2024)

Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch
par: Ferreira, Fabio, et autres
Publié: (2026)

A Mirror Descent-Based Algorithm for Corruption-Tolerant Distributed Gradient Descent
par: Wang, Shuche, et autres
Publié: (2024)

Quantum Algorithm for Sparse Online Learning with Truncated Gradient Descent
par: Lim, Debbie, et autres
Publié: (2024)

Hyperparameter Optimization in Machine Learning
par: Franceschi, Luca, et autres
Publié: (2024)

Stochastic Gradient Descent for Nonparametric Additive Regression
par: Chen, Xin, et autres
Publié: (2024)

Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization
par: Zheng, Tianqi, et autres
Publié: (2024)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
par: Livni, Roi
Publié: (2024)

Revisiting the Initial Steps in Adaptive Gradient Descent Optimization
par: Abuduweili, Abulikemu, et autres
Publié: (2024)

Super Gradient Descent: Global Optimization requires Global Gradient
par: Achour, Seifeddine
Publié: (2024)

Bayesian Optimization for Simultaneous Selection of Machine Learning Algorithms and Hyperparameters on Shared Latent Space
par: Ishikawa, Kazuki, et autres
Publié: (2025)

Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization
par: Fehring, Lukas, et autres
Publié: (2025)

An Algebraically Converging Stochastic Gradient Descent Algorithm for Global Optimization
par: Engquist, Björn, et autres
Publié: (2022)

Stacking as Accelerated Gradient Descent
par: Agarwal, Naman, et autres
Publié: (2024)

Cross-Entropy Optimization for Hyperparameter Optimization in Stochastic Gradient-based Approaches to Train Deep Neural Networks
par: Li, Kevin, et autres
Publié: (2024)

An ADRC-Incorporated Stochastic Gradient Descent Algorithm for Latent Factor Analysis
par: Li, Jinli, et autres
Publié: (2024)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

Corner Gradient Descent
par: Yarotsky, Dmitry
Publié: (2025)

The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization
par: Daskalakis, Constantinos, et autres
Publié: (2018)

Gradient Descent, Stochastic Optimization, and Other Tales
par: Lu, Jun
Publié: (2022)

Attacking Large Language Models with Projected Gradient Descent
par: Geisler, Simon, et autres
Publié: (2024)

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
par: Rakotoarison, Herilalaina, et autres
Publié: (2024)