Non-Asymptotic Error Bounds for Causally Conditioned Directed Information Rates of Gaussian Sequences

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zheng, Yuping, Lamperski, Andrew
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917501601841152
author Zheng, Yuping
Lamperski, Andrew
author_facet Zheng, Yuping
Lamperski, Andrew
contents Directed information and its causally conditioned variations are often used to measure causal influences between random processes. In practice, these quantities must be measured from data. Non-asymptotic error bounds for these estimates are known for sequences over finite alphabets, but less is known for real-valued data. This paper examines the case in which the data are sequences of Gaussian vectors. We provide an explicit formula for causally conditioned directed information rate based on optimal prediction and define an estimator based on this formula. We show that our estimator gives an error of order $O\left(N^{-1/2}\log(N)\right)$ with high probability, where $N$ is the total sample size.
format Preprint
id arxiv_https___arxiv_org_abs_2512_06238
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Non-Asymptotic Error Bounds for Causally Conditioned Directed Information Rates of Gaussian Sequences
Zheng, Yuping
Lamperski, Andrew
Information Theory
Statistics Theory
Directed information and its causally conditioned variations are often used to measure causal influences between random processes. In practice, these quantities must be measured from data. Non-asymptotic error bounds for these estimates are known for sequences over finite alphabets, but less is known for real-valued data. This paper examines the case in which the data are sequences of Gaussian vectors. We provide an explicit formula for causally conditioned directed information rate based on optimal prediction and define an estimator based on this formula. We show that our estimator gives an error of order $O\left(N^{-1/2}\log(N)\right)$ with high probability, where $N$ is the total sample size.
title Non-Asymptotic Error Bounds for Causally Conditioned Directed Information Rates of Gaussian Sequences
topic Information Theory
Statistics Theory
url https://arxiv.org/abs/2512.06238