Review of Mathematical Optimization in Federated Learning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yang, Shusen, Zhao, Fangyuan, Zhou, Zihao, Shi, Liang, Ren, Xuebin, Xu, Zongben
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929610658152448
author Yang, Shusen
Zhao, Fangyuan
Zhou, Zihao
Shi, Liang
Ren, Xuebin
Xu, Zongben
author_facet Yang, Shusen
Zhao, Fangyuan
Zhou, Zihao
Shi, Liang
Ren, Xuebin
Xu, Zongben
contents Federated Learning (FL) has been becoming a popular interdisciplinary research area in both applied mathematics and information sciences. Mathematically, FL aims to collaboratively optimize aggregate objective functions over distributed datasets while satisfying a variety of privacy and system constraints.Different from conventional distributed optimization methods, FL needs to address several specific issues (e.g., non-i.i.d. data distributions and differential private noises), which pose a set of new challenges in the problem formulation, algorithm design, and convergence analysis. In this paper, we will systematically review existing FL optimization research including their assumptions, formulations, methods, and theoretical results. Potential future directions are also discussed.
format Preprint
id arxiv_https___arxiv_org_abs_2412_01630
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Review of Mathematical Optimization in Federated Learning
Yang, Shusen
Zhao, Fangyuan
Zhou, Zihao
Shi, Liang
Ren, Xuebin
Xu, Zongben
Machine Learning
Distributed, Parallel, and Cluster Computing
Federated Learning (FL) has been becoming a popular interdisciplinary research area in both applied mathematics and information sciences. Mathematically, FL aims to collaboratively optimize aggregate objective functions over distributed datasets while satisfying a variety of privacy and system constraints.Different from conventional distributed optimization methods, FL needs to address several specific issues (e.g., non-i.i.d. data distributions and differential private noises), which pose a set of new challenges in the problem formulation, algorithm design, and convergence analysis. In this paper, we will systematically review existing FL optimization research including their assumptions, formulations, methods, and theoretical results. Potential future directions are also discussed.
title Review of Mathematical Optimization in Federated Learning
topic Machine Learning
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2412.01630