Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wald, Christian, Steidl, Gabriele
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910161057087488
author Wald, Christian
Steidl, Gabriele
author_facet Wald, Christian
Steidl, Gabriele
contents Among generative neural models, flow matching techniques stand out for their simple applicability and good scaling properties. Here, velocity fields of curves connecting a simple latent and a target distribution are learned. Then the corresponding ordinary differential equation can be used to sample from a target distribution, starting in samples from the latent one. This paper reviews from a mathematical point of view different techniques to learn the velocity fields of absolutely continuous curves in the Wasserstein geometry. We show how the velocity fields can be characterized and learned via i) transport plans (couplings) between latent and target distributions, ii) Markov kernels and iii) stochastic processes, where the latter two include the coupling approach, but are in general broader. Besides this main goal, we show how flow matching can be used for solving Bayesian inverse problems, where the definition of conditional Wasserstein distances plays a central role. Finally, we briefly address continuous normalizing flows and score matching techniques, which approach the learning of velocity fields of curves from other directions.
format Preprint
id arxiv_https___arxiv_org_abs_2501_16839
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
Wald, Christian
Steidl, Gabriele
Machine Learning
Probability
Among generative neural models, flow matching techniques stand out for their simple applicability and good scaling properties. Here, velocity fields of curves connecting a simple latent and a target distribution are learned. Then the corresponding ordinary differential equation can be used to sample from a target distribution, starting in samples from the latent one. This paper reviews from a mathematical point of view different techniques to learn the velocity fields of absolutely continuous curves in the Wasserstein geometry. We show how the velocity fields can be characterized and learned via i) transport plans (couplings) between latent and target distributions, ii) Markov kernels and iii) stochastic processes, where the latter two include the coupling approach, but are in general broader. Besides this main goal, we show how flow matching can be used for solving Bayesian inverse problems, where the definition of conditional Wasserstein distances plays a central role. Finally, we briefly address continuous normalizing flows and score matching techniques, which approach the learning of velocity fields of curves from other directions.
title Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
topic Machine Learning
Probability
url https://arxiv.org/abs/2501.16839