Imagen de Portada

A Survey on Efficient Federated Learning Methods for Foundation Model Training

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Woisetschläger, Herbert, Isenko, Alexander, Wang, Shiqiang, Mayer, Ruben, Jacobsen, Hans-Arno
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence Distributed, Parallel, and Cluster Computing I.2.11; C.2
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Federated Fine-Tuning of LLMs on the Very Edge: The Good, the Bad, the Ugly
por: Woisetschläger, Herbert, et al.
Publicado: (2023)

FLEdge: Benchmarking Federated Machine Learning Applications in Edge Computing Systems
por: Woisetschläger, Herbert, et al.
Publicado: (2023)

Federated Learning Priorities Under the European Union Artificial Intelligence Act
por: Woisetschläger, Herbert, et al.
Publicado: (2024)

How Can We Train Deep Learning Models Across Clouds and Continents? An Experimental Study
por: Erben, Alexander, et al.
Publicado: (2023)

Training Diffusion Models with Federated Learning
por: de Goede, Matthijs, et al.
Publicado: (2024)

How Machine Learning-Data Driven Replication Strategies Enhance Fault Tolerance in Large-Scale Distributed Systems
por: Murimi, Almond Kiruthu
Publicado: (2025)

AMP4EC: Adaptive Model Partitioning Framework for Efficient Deep Learning Inference in Edge Computing Environments
por: Zhang, Guilin, et al.
Publicado: (2025)

Asynchronous Byzantine Federated Learning
por: Cox, Bart, et al.
Publicado: (2024)

Aergia: Leveraging Heterogeneity in Federated Learning Systems
por: Cox, Bart, et al.
Publicado: (2022)

Parameterizing Federated Continual Learning for Reproducible Research
por: Cox, Bart, et al.
Publicado: (2024)

AutoDDL: Automatic Distributed Deep Learning with Near-Optimal Bandwidth Cost
por: Chen, Jinfan, et al.
Publicado: (2023)

Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients
por: Zuo, Yuncong, et al.
Publicado: (2024)

Towards Optimal Heterogeneous Client Sampling in Multi-Model Federated Learning
por: Zhang, Haoran, et al.
Publicado: (2025)

Hyper-parameter Optimization for Federated Learning with Step-wise Adaptive Mechanism
por: Saadati, Yasaman, et al.
Publicado: (2024)

HFedATM: Hierarchical Federated Domain Generalization via Optimal Transport and Regularized Mean Aggregation
por: Nguyen, Thinh, et al.
Publicado: (2025)

Comparison of Autoscaling Frameworks for Containerised Machine-Learning-Applications in a Local and Cloud Environment
por: Schroeder, Christian, et al.
Publicado: (2023)

SparkAttention: High-Performance Multi-Head Attention for Large Models on Volta GPU Architecture
por: Xu, Youxuan, et al.
Publicado: (2025)

Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines
por: Li, Shigang, et al.
Publicado: (2021)

FedPLT: Scalable, Resource-Efficient, and Heterogeneity-Aware Federated Learning via Partial Layer Training
por: Dabaja, Ahmad, et al.
Publicado: (2026)

Impact of Network Topology on Byzantine Resilience in Decentralized Federated Learning
por: Bhattacharya, Siddhartha, et al.
Publicado: (2024)

Quantize Once, Train Fast: Allreduce-Compatible Compression with Provable Guarantees
por: Xin, Jihao, et al.
Publicado: (2023)

Accelerating Geo-distributed Machine Learning with Network-Aware Adaptive Tree and Auxiliary Route
por: Li, Zonghang, et al.
Publicado: (2024)

Training LLMs on HPC Systems: Best Practices from the OpenGPT-X Project
por: Penke, Carolin, et al.
Publicado: (2025)

A Full Compression Pipeline for Green Federated Learning in Communication-Constrained Environments
por: Colybes, Elouan, et al.
Publicado: (2026)

TAGC: Optimizing Gradient Communication in Distributed Transformer Training
por: Polyakov, Igor, et al.
Publicado: (2025)

Connecting Large Language Model Agent to High Performance Computing Resource
por: Ma, Heng, et al.
Publicado: (2025)

SI-ChainFL: Shapley-Incentivized Secure Federated Learning for High-Speed Rail Data Sharing
por: Zhao, Mingjie, et al.
Publicado: (2026)

Federated Learning Model Aggregation in Heterogenous Aerial and Space Networks
por: Dong, Fan, et al.
Publicado: (2023)

ADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
por: Wang, Xiaoyu, et al.
Publicado: (2025)

Learning In Chaos: Efficient Autoscaling and Self-Healing for Multi-Party Distributed Training
por: Feng, Wenjiao, et al.
Publicado: (2025)

TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications
por: Bian, Zhuohang, et al.
Publicado: (2025)

Federated Learning with Differential Privacy
por: Banse, Adrien, et al.
Publicado: (2024)

Federated Learning and AI Regulation in the European Union: Who is Responsible? -- An Interdisciplinary Analysis
por: Woisetschläger, Herbert, et al.
Publicado: (2024)

CodeCRDT: Observation-Driven Coordination for Multi-Agent LLM Code Generation
por: Pugachev, Sergey
Publicado: (2025)

Separating Intelligence from Execution: A Workflow Engine for the Model Context Protocol
por: Parmar, Abhinav Singh
Publicado: (2026)

Roadmap for Edge AI: A Dagstuhl Perspective
por: Ding, Aaron Yi, et al.
Publicado: (2021)

SPEAR:Exact Gradient Inversion of Batches in Federated Learning
por: Dimitrov, Dimitar I., et al.
Publicado: (2024)

Near-Optimal Sparse Allreduce for Distributed Deep Learning
por: Li, Shigang, et al.
Publicado: (2022)

A Taxonomy and Resolution Strategy for Client-Level Disagreements in Federated Learning
por: Rosendal, Daan, et al.
Publicado: (2026)

Federated Learning for Traffic Flow Prediction with Synthetic Data Augmentation
por: Orozco, Fermin, et al.
Publicado: (2024)