Copertina

A Theoretical and Experimental Study of a Novel Adaptive Learning Algorithm

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Kumari, Sakshi, M, Shyam Kumar, P, Sushmitha
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

A Control Theoretic Framework for Adaptive Gradient Optimizers in Machine Learning
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2022)

Faster Adaptive Decentralized Learning Algorithms
di: Huang, Feihu, et al.
Pubblicazione: (2024)

A Systems-Theoretic View on the Convergence of Algorithms under Disturbances
di: Er, Guner Dilsad, et al.
Pubblicazione: (2025)

A Theoretical and Empirical Study on the Convergence of Adam with an "Exact" Constant Step Size in Non-Convex Settings
di: Mazumder, Alokendu, et al.
Pubblicazione: (2023)

Adaptive Moment Estimation Optimization Algorithm Using Projection Gradient for Deep Learning
di: Li, Yongqi, et al.
Pubblicazione: (2025)

AdaSwitch: An Adaptive Switching Meta-Algorithm for Learning-Augmented Bounded-Influence Problems
di: Chen, Xi, et al.
Pubblicazione: (2025)

AdaGrad-Diff: A New Version of the Adaptive Gradient Algorithm
di: Bojovic, Matia, et al.
Pubblicazione: (2026)

Adaptive Delayed-Update Cyclic Algorithm for Variational Inequalities
di: Wei, Yi, et al.
Pubblicazione: (2026)

A Theoretical Analysis of Self-Supervised Learning for Vision Transformers
di: Huang, Yu, et al.
Pubblicazione: (2024)

Towards Robust Learning to Optimize with Theoretical Guarantees
di: Song, Qingyu, et al.
Pubblicazione: (2025)

TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization
di: Li, Xiang, et al.
Pubblicazione: (2022)

State Estimation Using Particle Filtering in Adaptive Machine Learning Methods: Integrating Q-Learning and NEAT Algorithms with Noisy Radar Measurements
di: Song, Wonjin, et al.
Pubblicazione: (2025)

Adaptive Algorithms with Sharp Convergence Rates for Stochastic Hierarchical Optimization
di: Gong, Xiaochuan, et al.
Pubblicazione: (2025)

Scalable DC Optimization via Adaptive Frank-Wolfe Algorithms
di: Pokutta, Sebastian
Pubblicazione: (2025)

Control Theoretic Approach to Fine-Tuning and Transfer Learning
di: Bayram, Erkan, et al.
Pubblicazione: (2024)

Reevaluating Theoretical Analysis Methods for Optimization in Deep Learning
di: Tran, Hoang, et al.
Pubblicazione: (2024)

An Efficient Global Optimization Algorithm with Adaptive Estimates of the Local Lipschitz Constants
di: D'Agostino, Danny
Pubblicazione: (2022)

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
di: Xie, Xingyu, et al.
Pubblicazione: (2022)

Theoretical Analysis on how Learning Rate Warmup Accelerates Convergence
di: Liu, Yuxing, et al.
Pubblicazione: (2025)

GeoAdaLer: Geometric Insights into Adaptive Stochastic Gradient Descent Algorithms
di: Eleh, Chinedu, et al.
Pubblicazione: (2024)

From Learning to Optimize to Learning Optimization Algorithms
di: Castera, Camille, et al.
Pubblicazione: (2024)

Learning-to-Optimize with PAC-Bayesian Guarantees: Theoretical Considerations and Practical Implementation
di: Sucker, Michael, et al.
Pubblicazione: (2024)

Sporadic Gradient Tracking over Directed Graphs: A Theoretical Perspective on Decentralized Federated Learning
di: Zehtabi, Shahryar, et al.
Pubblicazione: (2026)

Locally Adaptive Federated Learning
di: Mukherjee, Sohom, et al.
Pubblicazione: (2023)

FedGiA: An Efficient Hybrid Algorithm for Federated Learning
di: Zhou, Shenglong, et al.
Pubblicazione: (2022)

Information Theoretically Optimal Sample Complexity of Learning Dynamical Directed Acyclic Graphs
di: Veedu, Mishfad Shaikh, et al.
Pubblicazione: (2023)

A New First-Order Meta-Learning Algorithm with Convergence Guarantees
di: Chayti, El Mahdi, et al.
Pubblicazione: (2024)

Complexity Lower Bounds of Adaptive Gradient Algorithms for Non-convex Stochastic Optimization under Relaxed Smoothness
di: Crawshaw, Michael, et al.
Pubblicazione: (2025)

Optimization meets Machine Learning: An Exact Algorithm for Semi-Supervised Support Vector Machines
di: Piccialli, Veronica, et al.
Pubblicazione: (2023)

Meta-Learning from Learning Curves for Budget-Limited Algorithm Selection
di: Nguyen, Manh Hung, et al.
Pubblicazione: (2024)

ADDQ: Adaptive Distributional Double Q-Learning
di: Döring, Leif, et al.
Pubblicazione: (2025)

A Machine Learning Approach to Two-Stage Adaptive Robust Optimization
di: Bertsimas, Dimitris, et al.
Pubblicazione: (2023)

A Novel Hybrid Heuristic-Reinforcement Learning Optimization Approach for a Class of Railcar Shunting Problems
di: Zhao, Ruonan, et al.
Pubblicazione: (2026)

The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms
di: Collins-Woodfin, Elizabeth, et al.
Pubblicazione: (2024)

Learning Algorithm Hyperparameters for Fast Parametric Convex Optimization
di: Sambharya, Rajiv, et al.
Pubblicazione: (2024)

A Semidefinite Programming-Based Branch-and-Cut Algorithm for Biclustering
di: Sudoso, Antonio M.
Pubblicazione: (2024)

A Nearly Optimal and Low-Switching Algorithm for Reinforcement Learning with General Function Approximation
di: Zhao, Heyang, et al.
Pubblicazione: (2023)

UVIP: Model-Free Approach to Evaluate Reinforcement Learning Algorithms
di: Belomestny, Denis, et al.
Pubblicazione: (2021)

Exact and Heuristic Algorithms for Constrained Biclustering
di: Sudoso, Antonio M.
Pubblicazione: (2025)

Why Do We Need Warm-up? A Theoretical Perspective
di: Alimisis, Foivos, et al.
Pubblicazione: (2025)