Discrete Bridges for Mutual Information Estimation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914315874861056 |
|---|---|
| author | Zabarianska, Iryna Kholkin, Sergei Ksenofontov, Grigoriy Butakov, Ivan Korotin, Alexander |
| author_facet | Zabarianska, Iryna Kholkin, Sergei Ksenofontov, Grigoriy Butakov, Ivan Korotin, Alexander |
| contents | Diffusion bridge models in both continuous and discrete state spaces have recently become powerful tools in the field of generative modeling. In this work, we leverage the discrete state space formulation of bridge matching models to address another important problem in machine learning and information theory: the estimation of the mutual information (MI) between discrete random variables. By neatly framing MI estimation as a domain transfer problem, we construct a Discrete Bridge Mutual Information (DBMI) estimator suitable for discrete data, which poses difficulties for conventional MI estimators. We showcase the performance of our estimator on two MI estimation settings: low-dimensional and image-based. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_08894 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Discrete Bridges for Mutual Information Estimation Zabarianska, Iryna Kholkin, Sergei Ksenofontov, Grigoriy Butakov, Ivan Korotin, Alexander Machine Learning Diffusion bridge models in both continuous and discrete state spaces have recently become powerful tools in the field of generative modeling. In this work, we leverage the discrete state space formulation of bridge matching models to address another important problem in machine learning and information theory: the estimation of the mutual information (MI) between discrete random variables. By neatly framing MI estimation as a domain transfer problem, we construct a Discrete Bridge Mutual Information (DBMI) estimator suitable for discrete data, which poses difficulties for conventional MI estimators. We showcase the performance of our estimator on two MI estimation settings: low-dimensional and image-based. |
| title | Discrete Bridges for Mutual Information Estimation |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2602.08894 |