Cover Image

On the Convergence and Stability of Distributed Sub-model Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Deng, Yuyang, Qiao, Fuli, Mahdavi, Mehrdad
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees
by: Deng, Yuyang, et al.
Published: (2024)

Merge before Forget: A Single LoRA Continual Learning via Continual Merging
by: Qiao, Fuli, et al.
Published: (2025)

On the Generalization Ability of Unsupervised Pretraining
by: Deng, Yuyang, et al.
Published: (2024)

Low-rank Momentum Factorization for Memory Efficient Training
by: Mahdavinia, Pouria, et al.
Published: (2025)

Understanding Deep Gradient Leakage via Inversion Influence Functions
by: Zhang, Haobo, et al.
Published: (2023)

Harnessing Optimization Dynamics for Curvature-Informed Model Merging
by: Mahdavinia, Pouria, et al.
Published: (2025)

Model Merging via Multi-Teacher Knowledge Distillation
by: Dalili, Seyed Arshan, et al.
Published: (2025)

Collaborative Learning with Different Labeling Functions
by: Deng, Yuyang, et al.
Published: (2024)

Enhancing Distributional Stability among Sub-populations
by: Liu, Jiashuo, et al.
Published: (2022)

On the Generalization Capability of Temporal Graph Learning Algorithms: Theoretical Insights and a Simpler Method
by: Cong, Weilin, et al.
Published: (2024)

Quantum Speedups for Markov Chain Monte Carlo Methods with Application to Optimization
by: Ozgul, Guneykan, et al.
Published: (2025)

Training-Conditional Coverage Bounds under Covariate Shift
by: Pournaderi, Mehrdad, et al.
Published: (2024)

Understanding Generalization from Embedding Dimension and Distributional Convergence
by: Yu, Junjie, et al.
Published: (2026)

Training-Conditional Coverage Bounds for Uniformly Stable Learning Algorithms
by: Pournaderi, Mehrdad, et al.
Published: (2024)

Advantage Shaping as Surrogate Reward Maximization: Unifying Pass@K Policy Gradients
by: Thrampoulidis, Christos, et al.
Published: (2025)

Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routers
by: Ma, Wenhan, et al.
Published: (2025)

Neyman-Pearson Classification under Both Null and Alternative Distributions Shift
by: Kalan, Mohammadreza M., et al.
Published: (2025)

Beyond CVaR: Leveraging Static Spectral Risk Measures for Enhanced Decision-Making in Distributional Reinforcement Learning
by: Moghimi, Mehrdad, et al.
Published: (2025)

Tail Distribution of Regret in Optimistic Reinforcement Learning
by: Khodadadian, Sajad, et al.
Published: (2025)

Product-Stability: Provable Convergence for Gradient Descent on the Edge of Stability
by: Gan, Eric
Published: (2026)

Mixed-Sample SGD: an End-to-end Analysis of Supervised Transfer Learning
by: Deng, Yuyang, et al.
Published: (2025)

On the Convergence of Modified Policy Iteration in Risk Sensitive Exponential Cost Markov Decision Processes
by: Murthy, Yashaswini, et al.
Published: (2023)

Vector-Valued Distributional Reinforcement Learning Policy Evaluation: A Hilbert Space Embedding Approach
by: Mohammadi, Mehrdad, et al.
Published: (2026)

Distributed Gradient Clustering: Convergence and the Effect of Initialization
by: Armacki, Aleksandar, et al.
Published: (2026)

Shock-Aware Physics-Guided Fusion-DeepONet Operator for Rarefied Micro-Nozzle Flows
by: Roohi, Ehsan, et al.
Published: (2025)

SubTrack++ : Gradient Subspace Tracking for Scalable LLM Training
by: Rajabi, Sahar, et al.
Published: (2025)

Memorization Capacity of Multi-Head Attention in Transformers
by: Mahdavi, Sadegh, et al.
Published: (2023)

Stabilizing the Kumaraswamy Distribution
by: Wasserman, Max, et al.
Published: (2024)

On the Maximal Local Disparity of Fairness-Aware Classifiers
by: Jin, Jinqiu, et al.
Published: (2024)

Convergence Theorems for Entropy-Regularized and Distributional Reinforcement Learning
by: Jhaveri, Yash, et al.
Published: (2025)

Convergence Rates for Distribution Matching with Sliced Optimal Transport
by: Thurin, Gauthier, et al.
Published: (2026)

Convergence Guarantees for Federated SARSA with Local Training and Heterogeneous Agents
by: Mangold, Paul, et al.
Published: (2025)

Provably Convergent Subgraph-wise Sampling for Fast GNN Training
by: Wang, Jie, et al.
Published: (2023)

Non-asymptotic Convergence of Training Transformers for Next-token Prediction
by: Huang, Ruiquan, et al.
Published: (2024)

Learning Stable Predictors from Weak Supervision under Distribution Shift
by: Shoeibi, Mehrdad, et al.
Published: (2026)

Stabilizing Transformer Training Through Consensus
by: Venkatasubramanian, Shyam, et al.
Published: (2026)

Stability and Generalization in Free Adversarial Training
by: Cheng, Xiwei, et al.
Published: (2024)

LocalKMeans: Convergence of Lloyd's Algorithm with Distributed Local Iterations
by: Vardhan, Harsh, et al.
Published: (2025)

Risk-sensitive Actor-Critic with Static Spectral Risk Measures for Online and Offline Reinforcement Learning
by: Moghimi, Mehrdad, et al.
Published: (2025)

Offline Constrained RLHF with Multiple Preference Oracles
by: Latham, Brenden, et al.
Published: (2026)