Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2605.14531 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917498719305728 |
|---|---|
| author | Dong, ZiYi Huang, Yuliang Deng, Weijian Ji, Xiangyang Lin, Liang Wei, Pengxu |
| author_facet | Dong, ZiYi Huang, Yuliang Deng, Weijian Ji, Xiangyang Lin, Liang Wei, Pengxu |
| contents | This work reformulates language generation as a stochastic optimal control problem, providing a unified theoretical perspective to analyze autoregressive and diffusion models and explain their limitations (Efficiency-Fidelity Paradox, Irreversibility Error Propagation, Optimization Tractability and Fidelity) in terms of combination of trajectory singularity, adjoint state vanishing, and gradient absence. To address these issues, we approximate the solution to the Hamilton-Jacobi-Bellman (HJB) equation, yielding an optimal policy that acts as a closed-loop controller. To bypass the intractability of directly solving the HJB PDE, we employ Flow Matching as the optimal trajectory solver within the rectified latent control space. This allows our Manta-LM with Global Integral Operator to approximate the global vector field, effectively realizing a model that simultaneously achieves high-fidelity text generation and efficient, low-cost parallel sampling. Empirically, our method achieves strong performance on language modeling and conditional generation tasks, while exhibiting improved stability, efficiency, and controllability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_14531 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Language Generation as Optimal Control: Closed-Loop Diffusion in Latent Control Space Dong, ZiYi Huang, Yuliang Deng, Weijian Ji, Xiangyang Lin, Liang Wei, Pengxu Computation and Language This work reformulates language generation as a stochastic optimal control problem, providing a unified theoretical perspective to analyze autoregressive and diffusion models and explain their limitations (Efficiency-Fidelity Paradox, Irreversibility Error Propagation, Optimization Tractability and Fidelity) in terms of combination of trajectory singularity, adjoint state vanishing, and gradient absence. To address these issues, we approximate the solution to the Hamilton-Jacobi-Bellman (HJB) equation, yielding an optimal policy that acts as a closed-loop controller. To bypass the intractability of directly solving the HJB PDE, we employ Flow Matching as the optimal trajectory solver within the rectified latent control space. This allows our Manta-LM with Global Integral Operator to approximate the global vector field, effectively realizing a model that simultaneously achieves high-fidelity text generation and efficient, low-cost parallel sampling. Empirically, our method achieves strong performance on language modeling and conditional generation tasks, while exhibiting improved stability, efficiency, and controllability. |
| title | Language Generation as Optimal Control: Closed-Loop Diffusion in Latent Control Space |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2605.14531 |