Simple Finite-Length Achievability and Converse Bounds for the Deletion Channel and the Insertion Channel

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Morozov, Ruslan, Duman, Tolga Mete
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917399148625920
author Morozov, Ruslan
Duman, Tolga Mete
author_facet Morozov, Ruslan
Duman, Tolga Mete
contents We develop upper bounds on code size for an independent and identically distributed deletion and insertion channels for a given code length and target frame error probability. The bounds are obtained as a variation of a general converse bound, which, though available for any channel, is inefficient and not easily computable without a good reference distribution over the output alphabet. We obtain a reference output distribution for a general finite-input finite-output channel and provide a simple formula for the converse bound on the capacity employing this distribution. We then evaluate the bound for the deletion channel with a finite block length, and show that the resulting upper bound on the code size is tighter than that for a binary erasure channel, which is the only alternative converse bound for the finite-length setting. We also provide similar results for the insertion channel. Furthermore, we present a simple algorithm for computing an achievability bound for a general discrete-input discrete-output channel. Although the algorithm has exponential complexity, it is useful for comparison purposes.
format Preprint
id arxiv_https___arxiv_org_abs_2504_20961
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Simple Finite-Length Achievability and Converse Bounds for the Deletion Channel and the Insertion Channel
Morozov, Ruslan
Duman, Tolga Mete
Information Theory
94B70
We develop upper bounds on code size for an independent and identically distributed deletion and insertion channels for a given code length and target frame error probability. The bounds are obtained as a variation of a general converse bound, which, though available for any channel, is inefficient and not easily computable without a good reference distribution over the output alphabet. We obtain a reference output distribution for a general finite-input finite-output channel and provide a simple formula for the converse bound on the capacity employing this distribution. We then evaluate the bound for the deletion channel with a finite block length, and show that the resulting upper bound on the code size is tighter than that for a binary erasure channel, which is the only alternative converse bound for the finite-length setting. We also provide similar results for the insertion channel. Furthermore, we present a simple algorithm for computing an achievability bound for a general discrete-input discrete-output channel. Although the algorithm has exponential complexity, it is useful for comparison purposes.
title Simple Finite-Length Achievability and Converse Bounds for the Deletion Channel and the Insertion Channel
topic Information Theory
94B70
url https://arxiv.org/abs/2504.20961