General Coded Computing: Adversarial Settings

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Moradi, Parsa, Akbarinodehi, Hanzaleh, Maddah-Ali, Mohammad Ali
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909488589570048
author Moradi, Parsa
Akbarinodehi, Hanzaleh
Maddah-Ali, Mohammad Ali
author_facet Moradi, Parsa
Akbarinodehi, Hanzaleh
Maddah-Ali, Mohammad Ali
contents Conventional coded computing frameworks are predominantly tailored for structured computations, such as matrix multiplication and polynomial evaluation. Such tasks allow the reuse of tools and techniques from algebraic coding theory to improve the reliability of distributed systems in the presence of stragglers and adversarial servers. This paper lays the foundation for general coded computing, which extends the applicability of coded computing to handle a wide class of computations. In addition, it particularly addresses the challenging problem of managing adversarial servers. We demonstrate that, in the proposed scheme, for a system with $N$ servers, where $\mathcal{O}(N^a)$, $a \in [0,1)$, are adversarial, the supremum of the average approximation error over all adversarial strategies decays at a rate of $N^{\frac{6}{5}(a-1)}$, under minimal assumptions on the computing tasks. Furthermore, we show that within a general framework, the proposed scheme achieves optimal adversarial robustness, in terms of maximum number of adversarial servers it can tolerate. This marks a significant step toward practical and reliable general coded computing. Implementation results further validate the effectiveness of the proposed method in handling various computations, including inference in deep neural networks.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08058
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle General Coded Computing: Adversarial Settings
Moradi, Parsa
Akbarinodehi, Hanzaleh
Maddah-Ali, Mohammad Ali
Distributed, Parallel, and Cluster Computing
Machine Learning
Conventional coded computing frameworks are predominantly tailored for structured computations, such as matrix multiplication and polynomial evaluation. Such tasks allow the reuse of tools and techniques from algebraic coding theory to improve the reliability of distributed systems in the presence of stragglers and adversarial servers. This paper lays the foundation for general coded computing, which extends the applicability of coded computing to handle a wide class of computations. In addition, it particularly addresses the challenging problem of managing adversarial servers. We demonstrate that, in the proposed scheme, for a system with $N$ servers, where $\mathcal{O}(N^a)$, $a \in [0,1)$, are adversarial, the supremum of the average approximation error over all adversarial strategies decays at a rate of $N^{\frac{6}{5}(a-1)}$, under minimal assumptions on the computing tasks. Furthermore, we show that within a general framework, the proposed scheme achieves optimal adversarial robustness, in terms of maximum number of adversarial servers it can tolerate. This marks a significant step toward practical and reliable general coded computing. Implementation results further validate the effectiveness of the proposed method in handling various computations, including inference in deep neural networks.
title General Coded Computing: Adversarial Settings
topic Distributed, Parallel, and Cluster Computing
Machine Learning
url https://arxiv.org/abs/2502.08058