Approximating the Total Variation Distance between Gaussians

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Bhattacharyya, Arnab, Feng, Weiming, Srivastava, Piyush
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912274279563264
author Bhattacharyya, Arnab
Feng, Weiming
Srivastava, Piyush
author_facet Bhattacharyya, Arnab
Feng, Weiming
Srivastava, Piyush
contents The total variation distance is a metric of central importance in statistics and probability theory. However, somewhat surprisingly, questions about computing it algorithmically appear not to have been systematically studied until very recently. In this paper, we contribute to this line of work by studying this question in the important special case of multivariate Gaussians. More formally, we consider the problem of approximating the total variation distance between two multivariate Gaussians to within an $ε$-relative error. Previous works achieved a fixed constant relative error approximation via closed-form formulas. In this work, we give algorithms that given any two $n$-dimensional Gaussians $D_1,D_2$, and any error bound $ε> 0$, approximate the total variation distance $D := d_{TV}(D_1,D_2)$ to $ε$-relative accuracy in $\text{poly}(n,\frac{1}ε,\log \frac{1}{D})$ operations. The main technical tool in our work is a reduction that helps us extend the recent progress on computing the TV-distance between discrete random variables to our continuous setting.
format Preprint
id arxiv_https___arxiv_org_abs_2503_11099
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Approximating the Total Variation Distance between Gaussians
Bhattacharyya, Arnab
Feng, Weiming
Srivastava, Piyush
Data Structures and Algorithms
Machine Learning
Probability
The total variation distance is a metric of central importance in statistics and probability theory. However, somewhat surprisingly, questions about computing it algorithmically appear not to have been systematically studied until very recently. In this paper, we contribute to this line of work by studying this question in the important special case of multivariate Gaussians. More formally, we consider the problem of approximating the total variation distance between two multivariate Gaussians to within an $ε$-relative error. Previous works achieved a fixed constant relative error approximation via closed-form formulas. In this work, we give algorithms that given any two $n$-dimensional Gaussians $D_1,D_2$, and any error bound $ε> 0$, approximate the total variation distance $D := d_{TV}(D_1,D_2)$ to $ε$-relative accuracy in $\text{poly}(n,\frac{1}ε,\log \frac{1}{D})$ operations. The main technical tool in our work is a reduction that helps us extend the recent progress on computing the TV-distance between discrete random variables to our continuous setting.
title Approximating the Total Variation Distance between Gaussians
topic Data Structures and Algorithms
Machine Learning
Probability
url https://arxiv.org/abs/2503.11099