Saved in:
Bibliographic Details
Main Authors: Yuan, Yuncheng, Scheepers, Péter, Tasiou, Lydia, Gültekin, Yunus Can, Corradi, Federico, Alvarado, Alex
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.15899
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917224072085504
author Yuan, Yuncheng
Scheepers, Péter
Tasiou, Lydia
Gültekin, Yunus Can
Corradi, Federico
Alvarado, Alex
author_facet Yuan, Yuncheng
Scheepers, Péter
Tasiou, Lydia
Gültekin, Yunus Can
Corradi, Federico
Alvarado, Alex
contents This paper analyzes the design and competitiveness of four neural network (NN) architectures recently proposed as decoders for forward error correction (FEC) codes. We first consider the so-called single-label neural network (SLNN) and the multi-label neural network (MLNN) decoders which have been reported to achieve near maximum likelihood (ML) performance. Here, we show analytically that SLNN and MLNN decoders can always achieve ML performance, regardless of the code dimensions -- although at the cost of computational complexity -- and no training is in fact required. We then turn our attention to two transformer-based decoders: the error correction code transformer (ECCT) and the cross-attention message passing transformer (CrossMPT). We compare their performance against traditional decoders, and show that ordered statistics decoding outperforms these transformer-based decoders. The results in this paper cast serious doubts on the application of NN-based FEC decoders in the short and medium block length regime.
format Preprint
id arxiv_https___arxiv_org_abs_2410_15899
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On the Design and Performance of Machine Learning Based Error Correcting Decoders
Yuan, Yuncheng
Scheepers, Péter
Tasiou, Lydia
Gültekin, Yunus Can
Corradi, Federico
Alvarado, Alex
Signal Processing
Machine Learning
This paper analyzes the design and competitiveness of four neural network (NN) architectures recently proposed as decoders for forward error correction (FEC) codes. We first consider the so-called single-label neural network (SLNN) and the multi-label neural network (MLNN) decoders which have been reported to achieve near maximum likelihood (ML) performance. Here, we show analytically that SLNN and MLNN decoders can always achieve ML performance, regardless of the code dimensions -- although at the cost of computational complexity -- and no training is in fact required. We then turn our attention to two transformer-based decoders: the error correction code transformer (ECCT) and the cross-attention message passing transformer (CrossMPT). We compare their performance against traditional decoders, and show that ordered statistics decoding outperforms these transformer-based decoders. The results in this paper cast serious doubts on the application of NN-based FEC decoders in the short and medium block length regime.
title On the Design and Performance of Machine Learning Based Error Correcting Decoders
topic Signal Processing
Machine Learning
url https://arxiv.org/abs/2410.15899