Coded Distributed (Batch) Matrix Multiplication over Galois Ring via RMFE
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913593761464320 |
|---|---|
| author | Kuang, Yi Li, Jiang Li, Songsong Xing, Chaoping |
| author_facet | Kuang, Yi Li, Jiang Li, Songsong Xing, Chaoping |
| contents | Coded Distributed Matrix Multiplication (CDMM) is a distributed matrix multiplication (DMM) for large-scale matrices through a coding scheme such that any $R$ worker node among all $N$ worker nodes can recover the final product, where $N$ corresponds to the length of the code and $R\leq N$ is called the recovery threshold. The state-of-art CDMM schemes, such as EP codes for Single DMM and GCAS codes for batch DMM, are defined over a Galois field $\mathsf{GF}(q)$ of size $q\geq N$. These are inefficient for small Galois fields such as $\mathsf{GF}(2)$ and the integer residue ring $\mathbb{Z}_{p^{e}}$ due to the lack of invertible elements for interpolation. DMM over $\mathbb{Z}_{p^{e}}$ (such as $\mathbb{Z}_{2^{64}}$ ) is well-motivated in practice due to their direct compatibility with hardware. In this work, we construct efficient CDMM over the Galois ring $\mathsf{GR}(p^e,d)$ which is an extension ring over $\mathbb{Z}_{p^{e}}$ of degree $d$, particularly, $\mathsf{GR}(p,d)=\mathsf{GF}(p^d)$ is the Galois field and $\mathsf{GR}(p^e,1)=\mathbb{Z}_{p^e}$. We first give a general CDMM framework for the batch of $n$ matrix multiplications via the famous RMFE (Cascudo et al. Crypto'18). Compared with GCSA, our construction has a smaller recovery threshold by a factor of $1/n$. Next, we optimize EP codes via batch preprocessing of the input matrices. We give two types of Single CDMM, which can achieve almost the same performance as EP codes over a Galois field with size $q\geq N$. Finally, we present the experimental analysis of our CDMM on Galois rings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_01172 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Coded Distributed (Batch) Matrix Multiplication over Galois Ring via RMFE Kuang, Yi Li, Jiang Li, Songsong Xing, Chaoping Distributed, Parallel, and Cluster Computing Information Theory Coded Distributed Matrix Multiplication (CDMM) is a distributed matrix multiplication (DMM) for large-scale matrices through a coding scheme such that any $R$ worker node among all $N$ worker nodes can recover the final product, where $N$ corresponds to the length of the code and $R\leq N$ is called the recovery threshold. The state-of-art CDMM schemes, such as EP codes for Single DMM and GCAS codes for batch DMM, are defined over a Galois field $\mathsf{GF}(q)$ of size $q\geq N$. These are inefficient for small Galois fields such as $\mathsf{GF}(2)$ and the integer residue ring $\mathbb{Z}_{p^{e}}$ due to the lack of invertible elements for interpolation. DMM over $\mathbb{Z}_{p^{e}}$ (such as $\mathbb{Z}_{2^{64}}$ ) is well-motivated in practice due to their direct compatibility with hardware. In this work, we construct efficient CDMM over the Galois ring $\mathsf{GR}(p^e,d)$ which is an extension ring over $\mathbb{Z}_{p^{e}}$ of degree $d$, particularly, $\mathsf{GR}(p,d)=\mathsf{GF}(p^d)$ is the Galois field and $\mathsf{GR}(p^e,1)=\mathbb{Z}_{p^e}$. We first give a general CDMM framework for the batch of $n$ matrix multiplications via the famous RMFE (Cascudo et al. Crypto'18). Compared with GCSA, our construction has a smaller recovery threshold by a factor of $1/n$. Next, we optimize EP codes via batch preprocessing of the input matrices. We give two types of Single CDMM, which can achieve almost the same performance as EP codes over a Galois field with size $q\geq N$. Finally, we present the experimental analysis of our CDMM on Galois rings. |
| title | Coded Distributed (Batch) Matrix Multiplication over Galois Ring via RMFE |
| topic | Distributed, Parallel, and Cluster Computing Information Theory |
| url | https://arxiv.org/abs/2412.01172 |