Cover Image

Optimizing Federated Learning in the Era of LLMs: Message Quantization and Streaming

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Ziyue, Zhang, Zhihong, Roth, Holger R., Chen, Chester, Cheng, Yan, Feng, Andrew
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Secure Federated XGBoost with CUDA-accelerated Homomorphic Encryption via NVIDIA FLARE
by: Xu, Ziyue, et al.
Published: (2025)

Empowering Federated Learning for Massive Models with NVIDIA FLARE
by: Roth, Holger R., et al.
Published: (2024)

Supercharging Federated Learning with Flower and NVIDIA FLARE
by: Roth, Holger R., et al.
Published: (2024)

C-FedRAG: A Confidential Federated Retrieval-Augmented Generation System
by: Addison, Parker, et al.
Published: (2024)

Standardized Methods and Recommendations for Green Federated Learning
by: Tapp, Austin, et al.
Published: (2026)

A Study on Messaging Trade-offs in Data Streaming for Scientific Workflows
by: George, Anjus, et al.
Published: (2025)

FedFQ: Federated Learning with Fine-Grained Quantization
by: Li, Haowei, et al.
Published: (2024)

Energy-Efficient Wireless Federated Learning via Doubly Adaptive Quantization
by: Han, Xuefeng, et al.
Published: (2024)

Structures and Techniques for Streaming Dynamic Graph Processing on Decentralized Message-Driven Systems
by: Chandio, Bibrak Qamar, et al.
Published: (2024)

Bandwidth-Aware Network Topology Optimization for Decentralized Learning
by: Shen, Yipeng, et al.
Published: (2025)

Opt-GPTQ: An Optimized GPTQ Combining Sparse Attention and Quantization Techniques
by: Kong, Jie, et al.
Published: (2025)

Stream-K Optimization and Exploration
by: Rackley, Nick, et al.
Published: (2024)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
by: Li, Rukuo, et al.
Published: (2025)

Multi-Objective Optimization of Consumer Group Autoscaling in Message Broker Systems
by: Landau, Diogo, et al.
Published: (2024)

Analysis and Optimization of Wireless Multimodal Federated Learning on Modal Heterogeneity
by: Han, Xuefeng, et al.
Published: (2025)

Divergence-Based Adaptive Aggregation for Byzantine Robust Federated Learning
by: Xiao, Bingnan, et al.
Published: (2026)

FastGraph: Optimized GPU-Enabled Algorithms for Fast Graph Building and Message Passing
by: Agarwal, Aarush, et al.
Published: (2025)

FedOptimus: Optimizing Vertical Federated Learning for Scalability and Efficiency
by: Shrivastava, Nikita, et al.
Published: (2025)

Totoro$^+$: An Adaptive and Scalable Edge Federated Learning System
by: Ching, Cheng-Wei, et al.
Published: (2026)

Data Heterogeneity-Aware Client Selection for Federated Learning in Wireless Networks
by: Yang, Yanbing, et al.
Published: (2025)

CoEdge-RAG: Optimizing Hierarchical Scheduling for Retrieval-Augmented LLMs in Collaborative Edge Computing
by: Hong, Guihang, et al.
Published: (2025)

Performance Optimization in Stream Processing Systems: Experiment-Driven Configuration Tuning for Kafka Streams
by: Chen, David, et al.
Published: (2026)

Optimization of Federated Learning's Client Selection for Non-IID Data Based on Grey Relational Analysis
by: Chen, Shuaijun, et al.
Published: (2023)

Heterogeneity-Aware Memory Efficient Federated Learning via Progressive Layer Freezing
by: Yebo, Wu, et al.
Published: (2024)

Distributed Inference Performance Optimization for LLMs on CPUs
by: He, Pujiang, et al.
Published: (2024)

Adaptive Weighting Push-SUM for Decentralized Optimization with Statistical Diversity
by: Zhou, Yiming, et al.
Published: (2024)

ORACL: Optimized Reasoning for Autoscaling via Chain of Thought with LLMs for Microservices
by: Bai, Haoyu, et al.
Published: (2026)

DFPL: Decentralized Federated Prototype Learning Across Heterogeneous Data Distributions
by: Zhang, Hongliang, et al.
Published: (2025)

StreamRL: Scalable, Heterogeneous, and Elastic RL for LLMs with Disaggregated Stream Generation
by: Zhong, Yinmin, et al.
Published: (2025)

Dynamic Client Clustering, Bandwidth Allocation, and Workload Optimization for Semi-synchronous Federated Learning
by: Yu, Liangkun, et al.
Published: (2024)

OptimES: Optimizing Federated Learning Using Remote Embeddings for Graph Neural Networks
by: Naman, Pranjal, et al.
Published: (2025)

Byzantine Consensus in Directed Graphs with Message Authentication
by: Vaidya, Nitin H., et al.
Published: (2026)

SoK: Consensus for Fair Message Ordering
by: Li, Zhuolun, et al.
Published: (2024)

Message-Oriented Middleware Systems: Technology Overview
by: Al-Manasrah, Wael, et al.
Published: (2026)

FedClust: Optimizing Federated Learning on Non-IID Data through Weight-Driven Client Clustering
by: Islam, Md Sirajul, et al.
Published: (2024)

QPOPSS: Query and Parallelism Optimized Space-Saving for Finding Frequent Stream Elements
by: Jarlow, Victor, et al.
Published: (2024)

Falafels: A tool for Estimating Federated Learning Energy Consumption via Discrete Simulation
by: de Barochez, Andrew Mary Huet, et al.
Published: (2025)

Federated Learning Using Coupled Tensor Train Decomposition
by: Zhang, Xiangtao, et al.
Published: (2024)

Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks
by: Wang, Shuai, et al.
Published: (2025)

Lessons Learned on the Path to Guaranteeing the Error Bound in Lossy Quantizers
by: Fallin, Alex, et al.
Published: (2024)