A Theoretical Analysis of Discrete Flow Matching Generative Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911178748329984 |
|---|---|
| author | Su, Maojiang Lu, Mingcheng Hu, Jerry Yao-Chieh Wu, Shang Song, Zhao Reneau, Alex Liu, Han |
| author_facet | Su, Maojiang Lu, Mingcheng Hu, Jerry Yao-Chieh Wu, Shang Song, Zhao Reneau, Alex Liu, Han |
| contents | We provide a theoretical analysis for end-to-end training Discrete Flow Matching (DFM) generative models. DFM is a promising discrete generative modeling framework that learns the underlying generative dynamics by training a neural network to approximate the transformative velocity field. Our analysis establishes a clear chain of guarantees by decomposing the final distribution estimation error. We first prove that the total variation distance between the generated and target distributions is controlled by the risk of the learned velocity field. We then bound this risk by analyzing its two primary sources: (i) Approximation Error, where we quantify the capacity of the Transformer architecture to represent the true velocity, and (ii) Estimation Error, where we derive statistical convergence rates that bound the error from training on a finite dataset. By composing these results, we provide the first formal proof that the distribution generated by a trained DFM model provably converges to the true data distribution as the training set size increases. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_22623 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Theoretical Analysis of Discrete Flow Matching Generative Models Su, Maojiang Lu, Mingcheng Hu, Jerry Yao-Chieh Wu, Shang Song, Zhao Reneau, Alex Liu, Han Machine Learning Artificial Intelligence We provide a theoretical analysis for end-to-end training Discrete Flow Matching (DFM) generative models. DFM is a promising discrete generative modeling framework that learns the underlying generative dynamics by training a neural network to approximate the transformative velocity field. Our analysis establishes a clear chain of guarantees by decomposing the final distribution estimation error. We first prove that the total variation distance between the generated and target distributions is controlled by the risk of the learned velocity field. We then bound this risk by analyzing its two primary sources: (i) Approximation Error, where we quantify the capacity of the Transformer architecture to represent the true velocity, and (ii) Estimation Error, where we derive statistical convergence rates that bound the error from training on a finite dataset. By composing these results, we provide the first formal proof that the distribution generated by a trained DFM model provably converges to the true data distribution as the training set size increases. |
| title | A Theoretical Analysis of Discrete Flow Matching Generative Models |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2509.22623 |