Cover Image

Parallel Momentum Methods Under Biased Gradient Estimations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Beikmohammadi, Ali, Khirirat, Sarit, Magnússon, Sindri
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Collaborative Value Function Estimation Under Model Mismatch: A Federated Temporal Difference Analysis
by: Beikmohammadi, Ali, et al.
Published: (2025)

On the Convergence of Federated Learning Algorithms without Data Similarity
by: Beikmohammadi, Ali, et al.
Published: (2024)

Compressed Federated Reinforcement Learning with a Generative Model
by: Beikmohammadi, Ali, et al.
Published: (2024)

Human-Inspired Framework to Accelerate Reinforcement Learning
by: Beikmohammadi, Ali, et al.
Published: (2023)

PriPG-RL: Privileged Planner-Guided Reinforcement Learning for Partially Observable Systems with Anytime-Feasible MPC
by: Amiri, Mohsen, et al.
Published: (2026)

Better LMO-based Momentum Methods with Second-Order Information
by: Khirirat, Sarit, et al.
Published: (2025)

A Cost-Sensitive Transformer Model for Prognostics Under Highly Imbalanced Industrial Data
by: Beikmohammadi, Ali, et al.
Published: (2024)

Error Feedback under $(L_0,L_1)$-Smoothness: Normalization and Momentum
by: Khirirat, Sarit, et al.
Published: (2024)

Reinforcement Learning in Switching Non-Stationary Markov Decision Processes: Algorithms and Convergence Analysis
by: Amiri, Mohsen, et al.
Published: (2025)

Improved Convergence in Parameter-Agnostic Error Feedback through Momentum
by: Sadiev, Abdurakhmon, et al.
Published: (2025)

Challenger-Based Combinatorial Bandits for Subcarrier Selection in OFDM Systems
by: Amiri, Mohsen, et al.
Published: (2025)

Smoothed Normalization for Efficient Distributed Private Optimization
by: Shulgin, Egor, et al.
Published: (2025)

First Provable Guarantees for Practical Private FL: Beyond Restrictive Assumptions
by: Shulgin, Egor, et al.
Published: (2025)

Asynchronous Distributed Optimization with Delay-free Parameters
by: Wu, Xuyang, et al.
Published: (2023)

MARBLE: Multi-Armed Restless Bandits in Latent Markovian Environment
by: Amiri, Mohsen, et al.
Published: (2025)

Adaptive Budgeted Multi-Armed Bandits for IoT with Dynamic Resource Constraints
by: Vaishnav, Shubham, et al.
Published: (2025)

Dynamic and Distributed Routing in IoT Networks based on Multi-Objective Q-Learning
by: Vaishnav, Shubham, et al.
Published: (2025)

SCANIA Component X Dataset: A Real-World Multivariate Time Series Dataset for Predictive Maintenance
by: Kharazian, Zahra, et al.
Published: (2024)

A Data Mining-Based Dynamical Anomaly Detection Method for Integrating with an Advance Metering System
by: Maitra, Sarit
Published: (2024)

On the Generalization of Stochastic Gradient Descent with Momentum
by: Ramezani-Kebrya, Ali, et al.
Published: (2018)

Automatic Fused Multimodal Deep Learning for Plant Identification
by: Lapkovskis, Alfreds, et al.
Published: (2024)

Robust Gradient Descent via Heavy-Ball Momentum with Predictive Extrapolation
by: Ali, Sarwan
Published: (2025)

Accelerated Gradient Methods with Biased Gradient Estimates: Risk Sensitivity, High-Probability Guarantees, and Large Deviation Bounds
by: Gürbüzbalaban, Mert, et al.
Published: (2025)

Benchmarking Dynamic SLO Compliance in Distributed Computing Continuum Systems
by: Lapkovskis, Alfreds, et al.
Published: (2025)

Compressed Decentralized Momentum Stochastic Gradient Methods for Nonconvex Optimization
by: Liu, Wei, et al.
Published: (2025)

Optimistic Gradient Learning with Hessian Corrections for High-Dimensional Black-Box Optimization
by: Kfir, Yedidya, et al.
Published: (2025)

Dynamic Momentum Recalibration in Online Gradient Learning
by: Yao, Zhipeng, et al.
Published: (2026)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
by: Lu, Eric
Published: (2025)

Multi-level Monte-Carlo Gradient Methods for Stochastic Optimization with Biased Oracles
by: Hu, Yifan, et al.
Published: (2024)

HOME-3: High-Order Momentum Estimator with Third-Power Gradient for Convex and Smooth Nonconvex Optimization
by: Zhang, Wei, et al.
Published: (2025)

Perfect Parallelization in Mini-Batch SGD with Classical Momentum Acceleration
by: Garg, Sachin, et al.
Published: (2026)

Measuring Learning Progress via Gradient-Momentum Coupling
by: Blad, Samuel, et al.
Published: (2026)

On the Second-Order Convergence of Biased Policy Gradient Algorithms
by: Mu, Siqiao, et al.
Published: (2023)

Fast Stochastic Policy Gradient: Negative Momentum for Reinforcement Learning
by: Zhang, Haobin, et al.
Published: (2024)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
by: Zhao, Shen-Yi, et al.
Published: (2020)

Shuffling Momentum Gradient Algorithm for Convex Optimization
by: Tran, Trang H., et al.
Published: (2024)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
by: Lei, Yunwen, et al.
Published: (2026)

MDN: Parallelizing Stepwise Momentum for Delta Linear Attention
by: Huang, Yulong, et al.
Published: (2026)

Policy Gradient with Second Order Momentum
by: Sun, Tianyu
Published: (2025)

Improving Energy Natural Gradient Descent through Woodbury, Momentum, and Randomization
by: Guzmán-Cordero, Andrés, et al.
Published: (2025)