Large and Small Deviations for Statistical Sequence Matching

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Lin, Wang, Qianyun, Wang, Jingjing, Bai, Lin, Hero, Alfred O.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914857404596224
author Zhou, Lin
Wang, Qianyun
Wang, Jingjing
Bai, Lin
Hero, Alfred O.
author_facet Zhou, Lin
Wang, Qianyun
Wang, Jingjing
Bai, Lin
Hero, Alfred O.
contents We revisit the problem of statistical sequence matching between two databases of sequences initiated by Unnikrishnan (TIT 2015) and derive theoretical performance guarantees for the generalized likelihood ratio test (GLRT). We first consider the case where the number of matched pairs of sequences between the databases is known. In this case, the task is to accurately find the matched pairs of sequences among all possible matches between the sequences in the two databases. We analyze the performance of the GLRT by Unnikrishnan and explicitly characterize the tradeoff between the mismatch and false reject probabilities under each hypothesis in both large and small deviations regimes. Furthermore, we demonstrate the optimality of Unnikrishnan's GLRT test under the generalized Neyman-Person criterion for both regimes and illustrate our theoretical results via numerical examples. Subsequently, we generalize our achievability analyses to the case where the number of matched pairs is unknown, and an additional error probability needs to be considered. When one of the two databases contains a single sequence, the problem of statistical sequence matching specializes to the problem of multiple classification introduced by Gutman (TIT 1989). For this special case, our result for the small deviations regime strengthens previous result of Zhou, Tan and Motani (Information and Inference 2020) by removing unnecessary conditions on the generating distributions.
format Preprint
id arxiv_https___arxiv_org_abs_2407_02816
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Large and Small Deviations for Statistical Sequence Matching
Zhou, Lin
Wang, Qianyun
Wang, Jingjing
Bai, Lin
Hero, Alfred O.
Information Theory
Signal Processing
Statistics Theory
We revisit the problem of statistical sequence matching between two databases of sequences initiated by Unnikrishnan (TIT 2015) and derive theoretical performance guarantees for the generalized likelihood ratio test (GLRT). We first consider the case where the number of matched pairs of sequences between the databases is known. In this case, the task is to accurately find the matched pairs of sequences among all possible matches between the sequences in the two databases. We analyze the performance of the GLRT by Unnikrishnan and explicitly characterize the tradeoff between the mismatch and false reject probabilities under each hypothesis in both large and small deviations regimes. Furthermore, we demonstrate the optimality of Unnikrishnan's GLRT test under the generalized Neyman-Person criterion for both regimes and illustrate our theoretical results via numerical examples. Subsequently, we generalize our achievability analyses to the case where the number of matched pairs is unknown, and an additional error probability needs to be considered. When one of the two databases contains a single sequence, the problem of statistical sequence matching specializes to the problem of multiple classification introduced by Gutman (TIT 1989). For this special case, our result for the small deviations regime strengthens previous result of Zhou, Tan and Motani (Information and Inference 2020) by removing unnecessary conditions on the generating distributions.
title Large and Small Deviations for Statistical Sequence Matching
topic Information Theory
Signal Processing
Statistics Theory
url https://arxiv.org/abs/2407.02816