Image de couverture de livre

Scaling Law Analysis in Federated Learning: How to Select the Optimal Model Size?

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Chen, Xuanyu, Yang, Nan, Wang, Shuai, Yuan, Dong
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Scaling Law for Language Models Training Considering Batch Size
par: Shuai, Xian, et autres
Publié: (2024)

Optimal Look-back Horizon for Time Series Forecasting in Federated Learning
par: Tang, Dahao, et autres
Publié: (2025)

Optimal Batch-Size Control for Low-Latency Federated Learning with Device Heterogeneity
par: Yang, Huiling, et autres
Publié: (2025)

Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling
par: Li, Shuaipeng, et autres
Publié: (2024)

Scaling Laws of Machine Learning for Optimal Power Flow
par: Liu, Xinyi, et autres
Publié: (2026)

Optimal Analysis for Bandit Learning in Matching Markets with Serial Dictatorship
par: Wang, Zilong, et autres
Publié: (2025)

Fast Catch-Up, Late Switching: Optimal Batch Size Scheduling via Functional Scaling Laws
par: Wang, Jinbo, et autres
Publié: (2026)

Scaling Laws for Optimal Data Mixtures
par: Shukor, Mustafa, et autres
Publié: (2025)

EMO: Edge Model Overlays to Scale Model Size in Federated Learning
par: Wu, Di, et autres
Publié: (2025)

Optimal Learning-Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay
par: Li, Binghui, et autres
Publié: (2026)

Decentralized Federated Learning With Energy Harvesting Devices
par: Zhang, Kai, et autres
Publié: (2026)

Federated Learning With Energy Harvesting Devices: An MDP Framework
par: Zhang, Kai, et autres
Publié: (2024)

Unveiling Scaling Behaviors in Molecular Language Models: Effects of Model Size, Data, and Representation
par: Xu, Dong, et autres
Publié: (2026)

Causal Multi-Label Feature Selection in Federated Setting
par: Song, Yukun, et autres
Publié: (2024)

Learning Critically: Selective Self Distillation in Federated Learning on Non-IID Data
par: He, Yuting, et autres
Publié: (2025)

Towards Scaling Law Analysis For Spatiotemporal Weather Data
par: Kiefer, Alexander, et autres
Publié: (2026)

Holistic Scaling Laws for Optimal Mixture-of-Experts Architecture Optimization
par: Wan, Weilin, et autres
Publié: (2026)

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws
par: Sardana, Nikhil, et autres
Publié: (2023)

Parallel Scaling Law for Language Models
par: Chen, Mouxiang, et autres
Publié: (2025)

FedGreen: Carbon-aware Federated Learning with Model Size Adaptation
par: Abbasi, Ali, et autres
Publié: (2024)

Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model
par: Bordelon, Blake, et autres
Publié: (2026)

Transformer Learns Optimal Variable Selection in Group-Sparse Classification
par: Zhang, Chenyang, et autres
Publié: (2025)

FedAPM: Federated Learning via ADMM with Partial Model Personalization
par: Zhu, Shengkun, et autres
Publié: (2025)

Selecting Large Language Model to Fine-tune via Rectified Scaling Law
par: Lin, Haowei, et autres
Publié: (2024)

Adaptive Data Optimization: Dynamic Sample Selection with Scaling Laws
par: Jiang, Yiding, et autres
Publié: (2024)

Navigating Scaling Laws: Compute Optimality in Adaptive Model Training
par: Anagnostidis, Sotiris, et autres
Publié: (2023)

Federated Learning with Enhanced Privacy via Model Splitting and Random Client Participation
par: Li, Yiwei, et autres
Publié: (2025)

How Feature Learning Can Improve Neural Scaling Laws
par: Bordelon, Blake, et autres
Publié: (2024)

Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection
par: Yuan, Liangqi, et autres
Publié: (2024)

How Should LLMs Consume High-Quality Data? Optimal Data Scheduling via Quality-Aware Functional Scaling Laws
par: Zhu, Zhitao, et autres
Publié: (2026)

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
par: Hägele, Alexander, et autres
Publié: (2024)

Optimal Routing for Federated Learning over Dynamic Satellite Networks: Tractable or Not?
par: Zhao, Yi, et autres
Publié: (2026)

Scaling Laws for Uncertainty in Deep Learning
par: Rosso, Mattia, et autres
Publié: (2025)

Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models
par: Wang, Siqi, et autres
Publié: (2024)

Functional Scaling Laws in Kernel Regression: Loss Dynamics and Learning Rate Schedules
par: Li, Binghui, et autres
Publié: (2025)

Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining
par: Li, Houyi, et autres
Publié: (2025)

GuardFed: A Trustworthy Federated Learning Framework Against Dual-Facet Attacks
par: Li, Yanli, et autres
Publié: (2025)

Better and Worse with Scale: How Contextual Entrainment Diverges with Model Size
par: Kukreja, Dikshant, et autres
Publié: (2026)

Scaling Laws of Global Weather Models
par: Yu, Yuejiang, et autres
Publié: (2026)

Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
par: Abnar, Samira, et autres
Publié: (2025)