Cover Image

Beyond Communication Overhead: A Multilevel Monte Carlo Approach for Mitigating Compression Bias in Distributed Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zukerman, Ze'ev, Hamoud, Bassel, Levy, Kfir Y.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Safety in the Face of Adversity: Achieving Zero Constraint Violation in Online Learning with Slowly Changing Constraints
by: Hamoud, Bassel, et al.
Published: (2025)

Local MixVR: Breaking the Communication-Sample Dependence in Distributed Learning
by: Dahan, Tehila, et al.
Published: (2026)

Weight for Robustness: A Comprehensive Approach towards Optimal Fault-Tolerant Asynchronous ML
by: Dahan, Tehila, et al.
Published: (2025)

Fault Tolerant ML: Efficient Meta-Aggregation and Synchronous Training
by: Dahan, Tehila, et al.
Published: (2024)

Private and Federated Stochastic Convex Optimization: Efficient Strategies for Centralized Systems
by: Reshef, Roie, et al.
Published: (2024)

SLowcal-SGD: Slow Query Points Improve Local-SGD for Stochastic Convex Optimization
by: Dahan, Tehila, et al.
Published: (2023)

$μ^2$-SGD: Stable Stochastic Optimization via a Double Momentum Mechanism
by: Dahan, Tehila, et al.
Published: (2023)

Enhancing Parallelism in Decentralized Stochastic Convex Optimization
by: Eisen, Ofri, et al.
Published: (2025)

Dynamic Byzantine-Robust Learning: Adapting to Switching Byzantine Workers
by: Dorfman, Ron, et al.
Published: (2024)

Privacy-Preserving Federated Convex Optimization: Balancing Partial-Participation and Efficiency via Noise Cancellation
by: Reshef, Roie, et al.
Published: (2025)

Multilevel and Sequential Monte Carlo for Training-Free Diffusion Guidance
by: Gleich, Aidan, et al.
Published: (2026)

Prediction-Powered Semi-Supervised Learning with Online Power Tuning
by: Shoham, Noa, et al.
Published: (2025)

Bringing Order to Asynchronous SGD: Towards Optimality under Data-Dependent Delays with Momentum
by: Dahan, Tehila, et al.
Published: (2026)

Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models
by: Reddy, Sohail, et al.
Published: (2024)

A BILDUNG E A TEORIA CRÍTICA NA ERA DA EDUCAÇÃO PÓS-MODERNA
by: Ilan Gur-Ze'ev
Published: (2006)

Lion Cub: Minimizing Communication Overhead in Distributed Lion
by: Ishikawa, Satoki, et al.
Published: (2024)

DE-PADA: Personalized Augmentation and Domain Adaptation for ECG Biometrics Across Physiological States
by: Saleh, Amro Abu, et al.
Published: (2025)

Bayesian computation with generative diffusion models by Multilevel Monte Carlo
by: Haji-Ali, Abdul-Lateef, et al.
Published: (2024)

Langevin Monte Carlo Beyond Lipschitz Gradient Continuity
by: Benko, Matej, et al.
Published: (2024)

A Principled Approach for Data Bias Mitigation
by: Scarone, Bruno, et al.
Published: (2024)

Global Momentum Compression for Sparse Communication in Distributed Learning
by: Shi, Chang-Wei, et al.
Published: (2019)

A Contrastive Learning Approach to Mitigate Bias in Speech Models
by: Koudounas, Alkis, et al.
Published: (2024)

Bring Your Own (Non-Robust) Algorithm to Solve Robust MDPs by Estimating The Worst Kernel
by: Wang, Kaixin, et al.
Published: (2023)

Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach
by: Fernando, Heshan, et al.
Published: (2022)

Accelerating Look-ahead in Bayesian Optimization: Multilevel Monte Carlo is All you Need
by: Yang, Shangda, et al.
Published: (2024)

On the Convergence of Single-Timescale Actor-Critic
by: Kumar, Navdeep, et al.
Published: (2024)

On the Global Convergence of Policy Gradient in Average Reward Markov Decision Processes
by: Kumar, Navdeep, et al.
Published: (2024)

ZeCO: Zero Communication Overhead Sequence Parallelism for Linear Attention
by: Chou, Yuhong, et al.
Published: (2025)

Truncating Trajectories in Monte Carlo Policy Evaluation: an Adaptive Approach
by: Poiani, Riccardo, et al.
Published: (2024)

Hamiltonian Monte Carlo with Asymmetrical Momentum Distributions
by: Ghosh, Soumyadip, et al.
Published: (2021)

Monte Carlo Functional Regularisation for Continual Learning
by: Hao, Pengcheng, et al.
Published: (2025)

Outlier Synthesis via Hamiltonian Monte Carlo for Out-of-Distribution Detection
by: Li, Hengzhuang, et al.
Published: (2025)

Contrastive Distribution Matching for Amortized Sequential Monte Carlo in Discrete Diffusion
by: Kim, Jaihoon, et al.
Published: (2026)

Gradient-Variation Online Adaptivity for Accelerated Optimization with Hölder Smoothness
by: Zhao, Yuheng, et al.
Published: (2025)

Data-Driven Gyroscope Calibration
by: Yampolsky, Zeev, et al.
Published: (2024)

Understanding and Mitigating the Bias in Sample Selection for Learning with Noisy Labels
by: Wei, Qi, et al.
Published: (2024)

Scalable Monte Carlo for Bayesian Learning
by: Fearnhead, Paul, et al.
Published: (2024)

Toward Scalable SDN for LEO Mega-Constellations: A Graph Learning Approach
by: Krishnan, Sivaram, et al.
Published: (2026)

ProbLog4Fairness: A Neurosymbolic Approach to Modeling and Mitigating Bias
by: Adriaensen, Rik, et al.
Published: (2025)

A Fast and Effective Solution to the Problem of Look-ahead Bias in LLMs
by: Merchant, Humzah, et al.
Published: (2025)