Sharpen Your Flow: Sharpness-Aware Sampling for Flow Matching

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gupta, Aditi, Lim, Soon Hoe, Yu, Annan, Erichson, N. Benjamin
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911673009307648
author Gupta, Aditi
Lim, Soon Hoe
Yu, Annan
Erichson, N. Benjamin
author_facet Gupta, Aditi
Lim, Soon Hoe
Yu, Annan
Erichson, N. Benjamin
contents Flow matching models generate samples by numerically integrating a learned velocity field, with each integration step requiring a neural network evaluation. Fast generation therefore requires using a small fixed evaluation budget effectively: the key question is not only how to integrate the flow, but where the sampler should spend its steps. We propose SharpEuler, a training-free sampler that profiles a pretrained model offline by estimating where the learned velocity field changes most rapidly along calibration trajectories. This finite-difference estimate defines a solver-aware sharpness profile, which is smoothed and converted by a quantile transform into a timestep grid for any desired inference budget. At test time, sampling remains ordinary Euler integration with the same number of model evaluations as a uniform schedule. We justify SharpEuler using three principles: a numerical principle identifying trajectory acceleration as the leading source of Euler discretization error, a variational principle deriving sharpness-based power-law timestep densities, and a statistical guarantee showing that the finite-sample calibrated sampler is stable at the terminal distribution level. Our experiments show that SharpEuler improves sample quality at fixed budgets, reducing inter-mode leakage and increasing mode coverage.
format Preprint
id arxiv_https___arxiv_org_abs_2605_11547
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Sharpen Your Flow: Sharpness-Aware Sampling for Flow Matching
Gupta, Aditi
Lim, Soon Hoe
Yu, Annan
Erichson, N. Benjamin
Machine Learning
Artificial Intelligence
Flow matching models generate samples by numerically integrating a learned velocity field, with each integration step requiring a neural network evaluation. Fast generation therefore requires using a small fixed evaluation budget effectively: the key question is not only how to integrate the flow, but where the sampler should spend its steps. We propose SharpEuler, a training-free sampler that profiles a pretrained model offline by estimating where the learned velocity field changes most rapidly along calibration trajectories. This finite-difference estimate defines a solver-aware sharpness profile, which is smoothed and converted by a quantile transform into a timestep grid for any desired inference budget. At test time, sampling remains ordinary Euler integration with the same number of model evaluations as a uniform schedule. We justify SharpEuler using three principles: a numerical principle identifying trajectory acceleration as the leading source of Euler discretization error, a variational principle deriving sharpness-based power-law timestep densities, and a statistical guarantee showing that the finite-sample calibrated sampler is stable at the terminal distribution level. Our experiments show that SharpEuler improves sample quality at fixed budgets, reducing inter-mode leakage and increasing mode coverage.
title Sharpen Your Flow: Sharpness-Aware Sampling for Flow Matching
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2605.11547