Imagen de Portada

On the Limits of Momentum in Decentralized and Federated Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zaccone, Riccardo, Karimireddy, Sai Praneeth, Masone, Carlo
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Communication-Efficient Heterogeneous Federated Learning with Generalized Heavy-Ball Momentum
por: Zaccone, Riccardo, et al.
Publicado: (2023)

LIA: Privacy-Preserving Data Quality Evaluation in Federated Learning Using a Lazy Influence Approximation
por: Rokvic, Ljubomir, et al.
Publicado: (2022)

Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining
por: Fan, Dongyang, et al.
Publicado: (2025)

Ghosted Layers: Unconstrained Activation Alignment for Recovering Layer-Pruned LLMs
por: Yun, Vincent-Daniel, et al.
Publicado: (2026)

Conformal Prediction Adaptive to Unknown Subpopulation Shifts
por: Wang, Nien-Shao, et al.
Publicado: (2025)

f-INE: A Hypothesis Testing Framework for Estimating Influence under Training Randomness
por: Panda, Subhodip, et al.
Publicado: (2025)

A Closer Look at Personalized Fine-Tuning in Heterogeneous Federated Learning
por: Chen, Minghui, et al.
Publicado: (2025)

Robust Multi-Agent LLMs under Byzantine Faults
por: Lee, Haejoon, et al.
Publicado: (2026)

Reconsidering LLM Uncertainty Estimation Methods in the Wild
por: Bakman, Yavuz, et al.
Publicado: (2025)

Optimization with Access to Auxiliary Information
por: Chayti, El Mahdi, et al.
Publicado: (2022)

Predicting Survival of Hemodialysis Patients using Federated Learning
por: Raju, Abhiram, et al.
Publicado: (2024)

FedMomentum: Preserving LoRA Training Momentum in Federated Fine-Tuning
por: Yan, Peishen, et al.
Publicado: (2026)

Entropy-driven Fair and Effective Federated Learning
por: Wang, Lin, et al.
Publicado: (2023)

EPSVec: Efficient and Private Synthetic Data Generation via Dataset Vectors
por: Banayeeanzade, Amin, et al.
Publicado: (2026)

DeMo: Decoupled Momentum Optimization
por: Peng, Bowen, et al.
Publicado: (2024)

Towards Heterogeneity-Aware and Energy-Efficient Topology Optimization for Decentralized Federated Learning in Edge Environment
por: Liu, Yuze, et al.
Publicado: (2025)

Momentum-Based Federated Reinforcement Learning with Interaction and Communication Efficiency
por: Yue, Sheng, et al.
Publicado: (2024)

Provable Privacy Advantages of Decentralized Federated Learning via Distributed Optimization
por: Yu, Wenrui, et al.
Publicado: (2024)

Byzantine-Robust Aggregation for Securing Decentralized Federated Learning
por: Cajaraville-Aboy, Diego, et al.
Publicado: (2024)

Collaborative Heterogeneous Causal Inference Beyond Meta-analysis
por: Guo, Tianyu, et al.
Publicado: (2024)

PFedDST: Personalized Federated Learning with Decentralized Selection Training
por: Fan, Mengchen, et al.
Publicado: (2025)

UA-PDFL: A Personalized Approach for Decentralized Federated Learning
por: Zhu, Hangyu, et al.
Publicado: (2024)

Federated Domain Generalization with Label Smoothing and Balanced Decentralized Training
por: Soltany, Milad, et al.
Publicado: (2024)

SMMF: Square-Matricized Momentum Factorization for Memory-Efficient Optimization
por: Park, Kwangryeol, et al.
Publicado: (2024)

DMPA: Model Poisoning Attacks on Decentralized Federated Learning for Model Differences
por: Feng, Chao, et al.
Publicado: (2025)

DAVED: Data Acquisition via Experimental Design for Data Markets
por: Lu, Charles, et al.
Publicado: (2024)

Do Data Valuations Make Good Data Prices?
por: Fan, Dongyang, et al.
Publicado: (2025)

Defection-Free Collaboration between Competitors in a Learning System
por: Werner, Mariel, et al.
Publicado: (2024)

TrasMuon: Trust-Region Adaptive Scaling for Orthogonalized Momentum Optimizers
por: Cheng, Peng, et al.
Publicado: (2026)

Momentum Streams for Optimizer-Inspired Transformers
por: Gai, Jingchu, et al.
Publicado: (2026)

Decentralized Online Convex Optimization with Unknown Feedback Delays
por: Qiu, Hao, et al.
Publicado: (2026)

Online Decentralized Federated Multi-task Learning With Trustworthiness in Cyber-Physical Systems
por: Odeyomi, Olusola, et al.
Publicado: (2025)

Load-Aware Training Scheduling for Model Circulation-based Decentralized Federated Learning
por: Kainuma, Haruki, et al.
Publicado: (2025)

Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors
por: Huang, Chun-Yin, et al.
Publicado: (2024)

Centralized vs Decentralized Federated Learning: A trade-off performance analysis
por: Medjadji, Chaimaa, et al.
Publicado: (2026)

Trust and Resilience in Federated Learning Through Smart Contracts Enabled Decentralized Systems
por: Cassano, Lorenzo, et al.
Publicado: (2024)

Decentralized Personalized Federated Learning based on a Conditional Sparse-to-Sparser Scheme
por: Long, Qianyu, et al.
Publicado: (2024)

LML-DAP: Language Model Learning a Dataset for Data-Augmented Prediction
por: Vadlapati, Praneeth
Publicado: (2024)

A Differentially Private Kaplan-Meier Estimator for Privacy-Preserving Survival Analysis
por: Veeraragavan, Narasimha Raghavan, et al.
Publicado: (2024)

MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning
por: Chen, Yupeng, et al.
Publicado: (2024)