Log-Averaged Mirror Prox for Fast, Large-Scale Optimal Transport in Linear Space

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Burns, Matthew X., Liang, Jiaming
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914553212698624
author Burns, Matthew X.
Liang, Jiaming
author_facet Burns, Matthew X.
Liang, Jiaming
contents We propose Log-Averaged Mirror Prox (LAMP), a linear-space primal-dual method for large-scale optimal transport. LAMP implements primal mirror prox updates by tracking an averaged dual sequence, reducing storage complexity from ${O}(nm)$ to $O(n+m)$ while preserving dense, GPU-friendly reductions. Consequently, LAMP preserves the last-iterate $\widetilde{O}( nm\varepsilon^{-1})$ arithmetic complexity of conservatively parameterized primal-dual mirror prox. We further analyze LAMP as a direct optimal transport solver in a more performant parameter regime, providing a last-iterate sub-optimality certificate dependent on infeasibility and an explicit $O(1/t)$ term. Moreover, we give a computable sufficient condition for best-iterate convergence to a saddle-point. Numerical experiments with an optimized CUDA implementation show that LAMP outperforms first-order baselines in several high-accuracy (entropic) optimal transport problems. LAMP is further shown to scale up to problems with $n=m=2^{18}$ marginal supports, which were previously beyond the reach of primal-dual first-order methods.
format Preprint
id arxiv_https___arxiv_org_abs_2511_11359
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Log-Averaged Mirror Prox for Fast, Large-Scale Optimal Transport in Linear Space
Burns, Matthew X.
Liang, Jiaming
Optimization and Control
Data Structures and Algorithms
49Q22, 49M37, 65K05, 68Q25, 90C25
We propose Log-Averaged Mirror Prox (LAMP), a linear-space primal-dual method for large-scale optimal transport. LAMP implements primal mirror prox updates by tracking an averaged dual sequence, reducing storage complexity from ${O}(nm)$ to $O(n+m)$ while preserving dense, GPU-friendly reductions. Consequently, LAMP preserves the last-iterate $\widetilde{O}( nm\varepsilon^{-1})$ arithmetic complexity of conservatively parameterized primal-dual mirror prox. We further analyze LAMP as a direct optimal transport solver in a more performant parameter regime, providing a last-iterate sub-optimality certificate dependent on infeasibility and an explicit $O(1/t)$ term. Moreover, we give a computable sufficient condition for best-iterate convergence to a saddle-point. Numerical experiments with an optimized CUDA implementation show that LAMP outperforms first-order baselines in several high-accuracy (entropic) optimal transport problems. LAMP is further shown to scale up to problems with $n=m=2^{18}$ marginal supports, which were previously beyond the reach of primal-dual first-order methods.
title Log-Averaged Mirror Prox for Fast, Large-Scale Optimal Transport in Linear Space
topic Optimization and Control
Data Structures and Algorithms
49Q22, 49M37, 65K05, 68Q25, 90C25
url https://arxiv.org/abs/2511.11359