Control, Optimal Transport and Neural Differential Equations in Supervised Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Phung, Minh-Nhat, Tran, Minh-Binh
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910237465772032
author Phung, Minh-Nhat
Tran, Minh-Binh
author_facet Phung, Minh-Nhat
Tran, Minh-Binh
contents We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal transport (UOT) in the continuum using Neural ODEs. By generalizing a discrete UOT problem with Pearson divergence, we constructively design vector fields for Neural ODEs that converge to the true UOT dynamics, thereby advancing the mathematical foundations of computational transport and machine learning. To this end, we design a numerical scheme inspired by the Sinkhorn algorithm to solve the corresponding minimization problem and rigorously prove its convergence, providing explicit error estimates. From the obtained numerical solutions, we derive vector fields defining the transport dynamics and construct the corresponding transport equation. Finally, from the numerically obtained transport equation, we construct a neural differential equation whose flow converges to the true transport dynamics in an appropriate limiting regime.
format Preprint
id arxiv_https___arxiv_org_abs_2503_15105
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Control, Optimal Transport and Neural Differential Equations in Supervised Learning
Phung, Minh-Nhat
Tran, Minh-Binh
Numerical Analysis
Machine Learning
Optimization and Control
We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal transport (UOT) in the continuum using Neural ODEs. By generalizing a discrete UOT problem with Pearson divergence, we constructively design vector fields for Neural ODEs that converge to the true UOT dynamics, thereby advancing the mathematical foundations of computational transport and machine learning. To this end, we design a numerical scheme inspired by the Sinkhorn algorithm to solve the corresponding minimization problem and rigorously prove its convergence, providing explicit error estimates. From the obtained numerical solutions, we derive vector fields defining the transport dynamics and construct the corresponding transport equation. Finally, from the numerically obtained transport equation, we construct a neural differential equation whose flow converges to the true transport dynamics in an appropriate limiting regime.
title Control, Optimal Transport and Neural Differential Equations in Supervised Learning
topic Numerical Analysis
Machine Learning
Optimization and Control
url https://arxiv.org/abs/2503.15105