Image de couverture de livre

Measuring Learning Progress via Gradient-Momentum Coupling

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Blad, Samuel, Längkvist, Martin, Loutfi, Amy
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Evolutionary Discovery of Reinforcement Learning Algorithms via Large Language Models
par: Sygkounas, Alkis, et autres
Publié: (2026)

Contextual Bandits for Resource-Constrained Devices using Probabilistic Learning
par: Angioli, Marco, et autres
Publié: (2026)

Affective Priming Score: A Data-Driven Method to Detect Priming in Sequential Datasets
par: Maestro, Eduardo Gutierrez, et autres
Publié: (2025)

Dynamic Momentum Recalibration in Online Gradient Learning
par: Yao, Zhipeng, et autres
Publié: (2026)

Interactive Double Deep Q-network: Integrating Human Interventions and Evaluative Predictions in Reinforcement Learning of Autonomous Driving
par: Sygkounas, Alkis, et autres
Publié: (2025)

LAP: A Language-Aware Planning Model For Procedure Planning In Instructional Videos
par: Shi, Lei, et autres
Publié: (2026)

Fast Stochastic Policy Gradient: Negative Momentum for Reinforcement Learning
par: Zhang, Haobin, et autres
Publié: (2024)

On the Generalization of Stochastic Gradient Descent with Momentum
par: Ramezani-Kebrya, Ali, et autres
Publié: (2018)

Adaptive Optimization via Momentum on Variance-Normalized Gradients
par: Patitucci, Francisco, et autres
Publié: (2026)

Robust Gradient Descent via Heavy-Ball Momentum with Predictive Extrapolation
par: Ali, Sarwan
Publié: (2025)

Accelerated Policy Gradient: On the Convergence Rates of the Nesterov Momentum for Reinforcement Learning
par: Chen, Yen-Ju, et autres
Publié: (2023)

Efficient Hyperdimensional Computing with Modular Composite Representations
par: Angioli, Marco, et autres
Publié: (2025)

Reinforcement Learning via Value Gradient Flow
par: Xu, Haoran, et autres
Publié: (2026)

Parallel Momentum Methods Under Biased Gradient Estimations
par: Beikmohammadi, Ali, et autres
Publié: (2024)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
par: Zhao, Shen-Yi, et autres
Publié: (2020)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
par: Lei, Yunwen, et autres
Publié: (2026)

Shuffling Momentum Gradient Algorithm for Convex Optimization
par: Tran, Trang H., et autres
Publié: (2024)

Gradient Descent with Polyak's Momentum Finds Flatter Minima via Large Catapults
par: Phunyaphibarn, Prin, et autres
Publié: (2023)

Policy Gradient with Second Order Momentum
par: Sun, Tianyu
Publié: (2025)

Momentum Particle Maximum Likelihood
par: Lim, Jen Ning, et autres
Publié: (2023)

Improving Energy Natural Gradient Descent through Woodbury, Momentum, and Randomization
par: Guzmán-Cordero, Andrés, et autres
Publié: (2025)

Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum
par: Kamo, Keisuke, et autres
Publié: (2025)

Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
par: Zhou, Yuan, et autres
Publié: (2025)

Compressed Decentralized Momentum Stochastic Gradient Methods for Nonconvex Optimization
par: Liu, Wei, et autres
Publié: (2025)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
par: Sato, Naoki, et autres
Publié: (2024)

Keep the Momentum: Conservation Laws beyond Euclidean Gradient Flows
par: Marcotte, Sibylle, et autres
Publié: (2024)

Adaptive Memory Momentum via a Model-Based Framework for Deep Learning Optimization
par: Topollai, Kristi, et autres
Publié: (2025)

Stochastic Momentum Methods for Non-smooth Non-Convex Finite-Sum Coupled Compositional Optimization
par: Chen, Xingyu, et autres
Publié: (2025)

Provable Generalization Bounds for Deep Neural Networks with Momentum-Adaptive Gradient Dropout
par: Safder, Adeel
Publié: (2025)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
par: Lu, Eric
Publié: (2025)

Global Convergence of Natural Policy Gradient with Hessian-aided Momentum Variance Reduction
par: Feng, Jie, et autres
Publié: (2024)

Momentum Approximation in Asynchronous Private Federated Learning
par: Yu, Tao, et autres
Publié: (2024)

HOME-3: High-Order Momentum Estimator with Third-Power Gradient for Convex and Smooth Nonconvex Optimization
par: Zhang, Wei, et autres
Publié: (2025)

Reciprocal Co-Training (RCT): Coupling Gradient-Based and Non-Differentiable Models via Reinforcement Learning
par: Tian, Yunshuo, et autres
Publié: (2026)

Machine Learning: Progress and Prospects
par: Gammerman, Alexander
Publié: (2025)

Grams: Gradient Descent with Adaptive Momentum Scaling
par: Cao, Yang, et autres
Publié: (2024)

Measuring Progress in Dictionary Learning for Language Model Interpretability with Board Game Models
par: Karvonen, Adam, et autres
Publié: (2024)

Reevaluating Policy Gradient Methods for Imperfect-Information Games
par: Rudolph, Max, et autres
Publié: (2025)

Accelerating Byzantine-Robust Distributed Learning with Compressed Communication via Double Momentum and Variance Reduction
par: Li, Yanghao, et autres
Publié: (2026)

Enhanced Momentum with Momentum Transformers
par: Mason, Max, et autres
Publié: (2024)