Cover Image

Towards Federated Learning with On-device Training and Communication in 8-bit Floating Point

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Bokun, Berg, Axel, Acar, Durmus Alp Emre, Zhou, Chuteng
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training
by: Jia, Jinda, et al.
Published: (2024)

Federated Frank-Wolfe Algorithm
by: Dadras, Ali, et al.
Published: (2024)

Energy-Efficient Quantized Federated Learning for Resource-constrained IoT devices
by: Compaoré, Wilfrid Sougrinoma, et al.
Published: (2025)

Towards Communication-efficient Federated Learning via Sparse and Aligned Adaptive Optimization
by: Deng, Xiumei, et al.
Published: (2024)

FedDD: Toward Communication-efficient Federated Learning with Differential Parameter Dropout
by: Feng, Zhiying, et al.
Published: (2023)

Computation and Communication Efficient Lightweighting Vertical Federated Learning for Smart Building IoT
by: Wang, Heqiang, et al.
Published: (2024)

Bandwidth-Aware and Overlap-Weighted Compression for Communication-Efficient Federated Learning
by: Tang, Zichen, et al.
Published: (2024)

Towards Efficient Replay in Federated Incremental Learning
by: Li, Yichen, et al.
Published: (2024)

Mycroft: Tracing Dependencies in Collective Communication Towards Reliable LLM Training
by: Deng, Yangtao, et al.
Published: (2025)

FedEve: On Bridging the Client Drift and Period Drift for Cross-device Federated Learning
by: Shen, Tao, et al.
Published: (2025)

Towards Client Driven Federated Learning
by: Li, Songze, et al.
Published: (2024)

HiFGL: A Hierarchical Framework for Cross-silo Cross-device Federated Graph Learning
by: Guo, Zhuoning, et al.
Published: (2024)

Masked Random Noise for Communication Efficient Federated Learning
by: Li, Shiwei, et al.
Published: (2024)

Communication-Efficient Device Scheduling for Federated Learning Using Lyapunov Optimization
by: Perazzone, Jake B., et al.
Published: (2025)

CommunityAI: Towards Community-based Federated Learning
by: Murturi, Ilir, et al.
Published: (2023)

Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection
by: Yuan, Liangqi, et al.
Published: (2024)

Communication Efficient and Provable Federated Unlearning
by: Tao, Youming, et al.
Published: (2024)

The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning
by: Li, Shiwei, et al.
Published: (2025)

Initialization Matters: Unraveling the Impact of Pre-Training on Federated Learning
by: Jhunjhunwala, Divyansh, et al.
Published: (2025)

FedBAT: Communication-Efficient Federated Learning via Learnable Binarization
by: Li, Shiwei, et al.
Published: (2024)

Towards cost-effective and resource-aware aggregation at Edge for Federated Learning
by: Khan, Ahmad Faraz, et al.
Published: (2022)

FedTilt: Towards Multi-Level Fairness-Preserving and Robust Federated Learning
by: Zhang, Binghui, et al.
Published: (2025)

FedBiF: Communication-Efficient Federated Learning via Bits Freezing
by: Li, Shiwei, et al.
Published: (2025)

Communication and Computation Efficient Split Federated Learning in O-RAN
by: Gu, Shunxian, et al.
Published: (2025)

Greedy Shapley Client Selection for Communication-Efficient Federated Learning
by: Singhal, Pranava, et al.
Published: (2023)

Ampere: Communication-Efficient and High-Accuracy Split Federated Learning
by: Zhang, Zihan, et al.
Published: (2025)

Adaptive Client Selection with Personalization for Communication Efficient Federated Learning
by: de Souza, Allan M., et al.
Published: (2024)

Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization
by: Li, Jinhao, et al.
Published: (2023)

Breaking the Memory Wall for Heterogeneous Federated Learning via Progressive Training
by: Wu, Yebo, et al.
Published: (2024)

Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data
by: Amalanshu, Avi, et al.
Published: (2024)

Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning
by: Yu, Chong, et al.
Published: (2024)

Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks
by: Wang, Shuai, et al.
Published: (2025)

ParaBlock: Communication-Computation Parallel Block Coordinate Federated Learning for Large Language Models
by: Wang, Yujia, et al.
Published: (2025)

Agglomerative Federated Learning: Empowering Larger Model Training via End-Edge-Cloud Collaboration
by: Wu, Zhiyuan, et al.
Published: (2023)

Communication-Efficient Distributed Deep Learning via Federated Dynamic Averaging
by: Theologitis, Michail, et al.
Published: (2024)

Federated Learning with Integrated Sensing, Communication, and Computation: Frameworks and Performance Analysis
by: Liang, Yipeng, et al.
Published: (2024)

FedQueue: Queue-Aware Federated Learning for Cross-Facility HPC Training
by: Li, Yijiang, et al.
Published: (2026)

Photon: Federated LLM Pre-Training
by: Sani, Lorenzo, et al.
Published: (2024)

Heterogeneity-Aware Cooperative Federated Edge Learning with Adaptive Computation and Communication Compression
by: Zhang, Zhenxiao, et al.
Published: (2024)

Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization
by: Li, Zhe, et al.
Published: (2024)