Constructive Disintegration and Conditional Modes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Da Costa, Nathaël, Pförtner, Marvin, Cockayne, Jon
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918110067425280
author Da Costa, Nathaël
Pförtner, Marvin
Cockayne, Jon
author_facet Da Costa, Nathaël
Pförtner, Marvin
Cockayne, Jon
contents Conditioning, the central operation in Bayesian statistics, is formalised by the notion of disintegration of measures. However, due to the implicit nature of their definition, constructing disintegrations is often difficult. A folklore result in machine learning conflates the construction of a disintegration with the restriction of probability density functions onto the subset of events that are consistent with a given observation. We provide a comprehensive set of mathematical tools which can be used to construct disintegrations and apply these to find densities of disintegrations on differentiable manifolds. Using our results, we provide a disturbingly simple example in which the restricted density and the disintegration density drastically disagree. Motivated by applications in approximate Bayesian inference and Bayesian inverse problems, we further study the modes of disintegrations. We show that the recently introduced notion of a "conditional mode" does not coincide in general with the modes of the conditional measure obtained through disintegration, but rather the modes of the restricted measure. We also discuss the implications of the discrepancy between the two measures in practice, advocating for the utility of both approaches depending on the modelling context.
format Preprint
id arxiv_https___arxiv_org_abs_2508_00617
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Constructive Disintegration and Conditional Modes
Da Costa, Nathaël
Pförtner, Marvin
Cockayne, Jon
Statistics Theory
Machine Learning
Probability
Conditioning, the central operation in Bayesian statistics, is formalised by the notion of disintegration of measures. However, due to the implicit nature of their definition, constructing disintegrations is often difficult. A folklore result in machine learning conflates the construction of a disintegration with the restriction of probability density functions onto the subset of events that are consistent with a given observation. We provide a comprehensive set of mathematical tools which can be used to construct disintegrations and apply these to find densities of disintegrations on differentiable manifolds. Using our results, we provide a disturbingly simple example in which the restricted density and the disintegration density drastically disagree. Motivated by applications in approximate Bayesian inference and Bayesian inverse problems, we further study the modes of disintegrations. We show that the recently introduced notion of a "conditional mode" does not coincide in general with the modes of the conditional measure obtained through disintegration, but rather the modes of the restricted measure. We also discuss the implications of the discrepancy between the two measures in practice, advocating for the utility of both approaches depending on the modelling context.
title Constructive Disintegration and Conditional Modes
topic Statistics Theory
Machine Learning
Probability
url https://arxiv.org/abs/2508.00617