Letting Trajectories Spread: Quality-Preserving Control for Diverse Flow Matching

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Jingxuan, Wan, Zhenglin, Yu, Xingrui, Yang, Yuzhe, An, Bo, Tsang, Ivor, You, Yang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916029603512320
author Wu, Jingxuan
Wan, Zhenglin
Yu, Xingrui
Yang, Yuzhe
An, Bo
Tsang, Ivor
You, Yang
author_facet Wu, Jingxuan
Wan, Zhenglin
Yu, Xingrui
Yang, Yuzhe
An, Bo
Tsang, Ivor
You, Yang
contents Flow-based text-to-image models follow deterministic trajectories, making it costly to explore diverse modes under limited sampling budgets. Existing approaches to improving diversity often rely on retraining or degrade image fidelity. To address this limitation, we present a training-free, inference-time control mechanism that makes the flow itself diversity-aware. Our core insight is to encourage diversity through guidance that is geometrically decoupled from the mode's quality-seeking direction. Our method simultaneously encourages lateral spread among trajectories via a feature-space objective and reintroduces uncertainty through a time-scheduled stochastic perturbation. Crucially, this perturbation is projected to be orthogonal to the generation flow, a geometric constraint that allows it to boost variation without degrading image details or prompt fidelity. Theoretically, we show that this design monotonically increases a volume surrogate while approximately preserving the marginal distribution, providing a principled explanation for the robustness of generation quality. Empirically, across multiple text-to-image settings under fixed sampling budgets, our method consistently improves diversity metrics such as the Vendi Score and Brisque over strong baselines, while upholding image quality and alignment.
format Preprint
id arxiv_https___arxiv_org_abs_2510_09060
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Letting Trajectories Spread: Quality-Preserving Control for Diverse Flow Matching
Wu, Jingxuan
Wan, Zhenglin
Yu, Xingrui
Yang, Yuzhe
An, Bo
Tsang, Ivor
You, Yang
Artificial Intelligence
Computer Vision and Pattern Recognition
Flow-based text-to-image models follow deterministic trajectories, making it costly to explore diverse modes under limited sampling budgets. Existing approaches to improving diversity often rely on retraining or degrade image fidelity. To address this limitation, we present a training-free, inference-time control mechanism that makes the flow itself diversity-aware. Our core insight is to encourage diversity through guidance that is geometrically decoupled from the mode's quality-seeking direction. Our method simultaneously encourages lateral spread among trajectories via a feature-space objective and reintroduces uncertainty through a time-scheduled stochastic perturbation. Crucially, this perturbation is projected to be orthogonal to the generation flow, a geometric constraint that allows it to boost variation without degrading image details or prompt fidelity. Theoretically, we show that this design monotonically increases a volume surrogate while approximately preserving the marginal distribution, providing a principled explanation for the robustness of generation quality. Empirically, across multiple text-to-image settings under fixed sampling budgets, our method consistently improves diversity metrics such as the Vendi Score and Brisque over strong baselines, while upholding image quality and alignment.
title Letting Trajectories Spread: Quality-Preserving Control for Diverse Flow Matching
topic Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.09060