Copertina

Exploring the Optimized Value of Each Hyperparameter in Various Gradient Descent Algorithms

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Chen, Abel C. H.
Natura:	Preprint
Pubblicazione:	2022
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Multiple Wasserstein Gradient Descent Algorithm for Multi-Objective Distributional Optimization
di: Nguyen, Dai Hai, et al.
Pubblicazione: (2025)

Gradient Descent Algorithm Survey
di: Fucheng, Deng, et al.
Pubblicazione: (2025)

Sequential Policy Gradient for Adaptive Hyperparameter Optimization
di: Li, Zheng, et al.
Pubblicazione: (2025)

From Logistic Regression to the Perceptron Algorithm: Exploring Gradient Descent with Large Step Sizes
di: Tyurin, Alexander
Pubblicazione: (2024)

Accelerating Feedback-based Algorithms for Quantum Optimization Using Gradient Descent
di: Mozakka, Masih, et al.
Pubblicazione: (2026)

Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
di: Lin, Tianyi, et al.
Pubblicazione: (2024)

Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Features
di: Dunbar, Oliver R. A., et al.
Pubblicazione: (2024)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
di: Lei, Yunwen, et al.
Pubblicazione: (2026)

On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent
di: Li, Bingrui, et al.
Pubblicazione: (2024)

HyperSHAP: Shapley Values and Interactions for Explaining Hyperparameter Optimization
di: Wever, Marcel, et al.
Pubblicazione: (2025)

PMGDA: A Preference-based Multiple Gradient Descent Algorithm
di: Zhang, Xiaoyuan, et al.
Pubblicazione: (2024)

Learning Algorithm Hyperparameters for Fast Parametric Convex Optimization
di: Sambharya, Rajiv, et al.
Pubblicazione: (2024)

Overtuning in Hyperparameter Optimization
di: Schneider, Lennart, et al.
Pubblicazione: (2025)

Quantum Shadow Gradient Descent for Variational Quantum Algorithms
di: Heidari, Mohsen, et al.
Pubblicazione: (2023)

Dynamic Decoupling of Placid Terminal Attractor-based Gradient Descent Algorithm
di: Zhao, Jinwei, et al.
Pubblicazione: (2024)

How to Prove the Optimized Values of Hyperparameters for Particle Swarm Optimization?
di: Chen, Abel C. H.
Pubblicazione: (2023)

Enhancing Fractional Gradient Descent with Learned Optimizers
di: Sobotka, Jan, et al.
Pubblicazione: (2025)

Preconditioning for Accelerated Gradient Descent Optimization and Regularization
di: Ye, Qiang
Pubblicazione: (2024)

Occam Gradient Descent
di: Kausik, B. N.
Pubblicazione: (2024)

Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch
di: Ferreira, Fabio, et al.
Pubblicazione: (2026)

A Mirror Descent-Based Algorithm for Corruption-Tolerant Distributed Gradient Descent
di: Wang, Shuche, et al.
Pubblicazione: (2024)

Quantum Algorithm for Sparse Online Learning with Truncated Gradient Descent
di: Lim, Debbie, et al.
Pubblicazione: (2024)

Hyperparameter Optimization in Machine Learning
di: Franceschi, Luca, et al.
Pubblicazione: (2024)

Stochastic Gradient Descent for Nonparametric Additive Regression
di: Chen, Xin, et al.
Pubblicazione: (2024)

Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization
di: Zheng, Tianqi, et al.
Pubblicazione: (2024)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
di: Livni, Roi
Pubblicazione: (2024)

Revisiting the Initial Steps in Adaptive Gradient Descent Optimization
di: Abuduweili, Abulikemu, et al.
Pubblicazione: (2024)

Super Gradient Descent: Global Optimization requires Global Gradient
di: Achour, Seifeddine
Pubblicazione: (2024)

Bayesian Optimization for Simultaneous Selection of Machine Learning Algorithms and Hyperparameters on Shared Latent Space
di: Ishikawa, Kazuki, et al.
Pubblicazione: (2025)

Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization
di: Fehring, Lukas, et al.
Pubblicazione: (2025)

An Algebraically Converging Stochastic Gradient Descent Algorithm for Global Optimization
di: Engquist, Björn, et al.
Pubblicazione: (2022)

Stacking as Accelerated Gradient Descent
di: Agarwal, Naman, et al.
Pubblicazione: (2024)

Cross-Entropy Optimization for Hyperparameter Optimization in Stochastic Gradient-based Approaches to Train Deep Neural Networks
di: Li, Kevin, et al.
Pubblicazione: (2024)

An ADRC-Incorporated Stochastic Gradient Descent Algorithm for Latent Factor Analysis
di: Li, Jinli, et al.
Pubblicazione: (2024)

Stochastic Adaptive Gradient Descent Without Descent
di: Aujol, Jean-François, et al.
Pubblicazione: (2025)

Corner Gradient Descent
di: Yarotsky, Dmitry
Pubblicazione: (2025)

The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization
di: Daskalakis, Constantinos, et al.
Pubblicazione: (2018)

Gradient Descent, Stochastic Optimization, and Other Tales
di: Lu, Jun
Pubblicazione: (2022)

Attacking Large Language Models with Projected Gradient Descent
di: Geisler, Simon, et al.
Pubblicazione: (2024)

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
di: Rakotoarison, Herilalaina, et al.
Pubblicazione: (2024)