Distributed Memory Approximate Message Passing

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lu, Jun, Liu, Lei, Huang, Shunqi, Wei, Ning, Chen, Xiaoming
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917732817043456
author Lu, Jun
Liu, Lei
Huang, Shunqi
Wei, Ning
Chen, Xiaoming
author_facet Lu, Jun
Liu, Lei
Huang, Shunqi
Wei, Ning
Chen, Xiaoming
contents Approximate message passing (AMP) algorithms are iterative methods for signal recovery in noisy linear systems. In some scenarios, AMP algorithms need to operate within a distributed network. To address this challenge, the distributed extensions of AMP (D-AMP, FD-AMP) and orthogonal/vector AMP (D-OAMP/D-VAMP) were proposed, but they still inherit the limitations of centralized algorithms. In this letter, we propose distributed memory AMP (D-MAMP) to overcome the IID matrix limitation of D-AMP/FD-AMP, as well as the high complexity and heavy communication cost of D-OAMP/D-VAMP. We introduce a matrix-by-vector variant of MAMP tailored for distributed computing. Leveraging this variant, D-MAMP enables each node to execute computations utilizing locally available observation vectors and transform matrices. Meanwhile, global summations of locally updated results are conducted through message interaction among nodes. For acyclic graphs, D-MAMP converges to the same mean square error performance as the centralized MAMP.
format Preprint
id arxiv_https___arxiv_org_abs_2407_17727
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Distributed Memory Approximate Message Passing
Lu, Jun
Liu, Lei
Huang, Shunqi
Wei, Ning
Chen, Xiaoming
Signal Processing
Approximate message passing (AMP) algorithms are iterative methods for signal recovery in noisy linear systems. In some scenarios, AMP algorithms need to operate within a distributed network. To address this challenge, the distributed extensions of AMP (D-AMP, FD-AMP) and orthogonal/vector AMP (D-OAMP/D-VAMP) were proposed, but they still inherit the limitations of centralized algorithms. In this letter, we propose distributed memory AMP (D-MAMP) to overcome the IID matrix limitation of D-AMP/FD-AMP, as well as the high complexity and heavy communication cost of D-OAMP/D-VAMP. We introduce a matrix-by-vector variant of MAMP tailored for distributed computing. Leveraging this variant, D-MAMP enables each node to execute computations utilizing locally available observation vectors and transform matrices. Meanwhile, global summations of locally updated results are conducted through message interaction among nodes. For acyclic graphs, D-MAMP converges to the same mean square error performance as the centralized MAMP.
title Distributed Memory Approximate Message Passing
topic Signal Processing
url https://arxiv.org/abs/2407.17727