Orthogonal Decomposition of Discretization-Induced Transport-Information Cost under Rank-Deficient Parametrizations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Yuge, Koretaka
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916052084981760
author Yuge, Koretaka
author_facet Yuge, Koretaka
contents When we consider discretization of continuous probability distributions, it inevitably induces irreversible geometric distortion of local measure on the discretized support. While such discretziation-induced distortion is extrinsic to information geometry (IG) alone, we recently demonstrate that the discretization cost can be naturally characterized by the standard Kullback-Leibler (KL) divergence between continuous distributions as expectation of their infinitesimal parameter variations. The framework is based on the correspondence between optimal transport (OT) and IG, primarily requring the selected parameters directly identifiable with support coordinates. The present work extends the framework to more generalized parametrization theta, particularly the Jacobian between theta and support coordinates is rank-deficient, which generally results in breaking down the interpretation of the discretization-induced costs as information-geometric quantities. To address the problem, we here introduce an orthogonal decomposition of the second-moment tensor onto linear subspace for the covariance matrices generated by parameter fluctuations, based on Frobenius projection. The decomposition naturally separates the discretization cost into observable and unobservable components relative to the chosen parametrization. The present formulation provides a geometric framework for analyzing partial observability of discretization-induced transport-information costs. In particular, we show that the cross-interference cost vanishes identically when the parametrization projection commutes with the Fisher information metric, establishing that this term rigorously quantifies the geometric mismatch between the chosen parametrization and the intrinsic distinguishability of the statistical manifold. The present framework thus clarifies the role of parametrization-dependent information loss.
format Preprint
id arxiv_https___arxiv_org_abs_2605_19505
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Orthogonal Decomposition of Discretization-Induced Transport-Information Cost under Rank-Deficient Parametrizations
Yuge, Koretaka
Statistical Mechanics
When we consider discretization of continuous probability distributions, it inevitably induces irreversible geometric distortion of local measure on the discretized support. While such discretziation-induced distortion is extrinsic to information geometry (IG) alone, we recently demonstrate that the discretization cost can be naturally characterized by the standard Kullback-Leibler (KL) divergence between continuous distributions as expectation of their infinitesimal parameter variations. The framework is based on the correspondence between optimal transport (OT) and IG, primarily requring the selected parameters directly identifiable with support coordinates. The present work extends the framework to more generalized parametrization theta, particularly the Jacobian between theta and support coordinates is rank-deficient, which generally results in breaking down the interpretation of the discretization-induced costs as information-geometric quantities. To address the problem, we here introduce an orthogonal decomposition of the second-moment tensor onto linear subspace for the covariance matrices generated by parameter fluctuations, based on Frobenius projection. The decomposition naturally separates the discretization cost into observable and unobservable components relative to the chosen parametrization. The present formulation provides a geometric framework for analyzing partial observability of discretization-induced transport-information costs. In particular, we show that the cross-interference cost vanishes identically when the parametrization projection commutes with the Fisher information metric, establishing that this term rigorously quantifies the geometric mismatch between the chosen parametrization and the intrinsic distinguishability of the statistical manifold. The present framework thus clarifies the role of parametrization-dependent information loss.
title Orthogonal Decomposition of Discretization-Induced Transport-Information Cost under Rank-Deficient Parametrizations
topic Statistical Mechanics
url https://arxiv.org/abs/2605.19505