Imagen de Portada

DiFFPO: Training Diffusion LLMs to Reason Fast and Furious via Reinforcement Learning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhao, Hanyang, Liang, Dawen, Tang, Wenpin, Yao, David, Kallus, Nathan
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Score as Action: Fine-Tuning Diffusion Generative Models by Continuous-time Reinforcement Learning
por: Zhao, Hanyang, et al.
Publicado: (2025)

Understanding Sampler Stochasticity in Training Diffusion Models for RLHF
por: Sheng, Jiayuan, et al.
Publicado: (2025)

MallowsPO: Fine-Tune Your LLM with Preference Dispersions
por: Chen, Haoxian, et al.
Publicado: (2024)

Scores as Actions: a framework of fine-tuning diffusion models by continuous-time reinforcement learning
por: Zhao, Hanyang, et al.
Publicado: (2024)

OPD+: Rethinking the Advantage Design for On-Policy Distillation
por: Zhao, Hanyang, et al.
Publicado: (2026)

ART for Diffusion Sampling: A Reinforcement Learning Approach to Timestep Schedule
por: Huang, Yilie, et al.
Publicado: (2026)

Semiparametric Preference Optimization: Your Language Model is Secretly a Single-Index Model
por: Kallus, Nathan
Publicado: (2025)

Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial
por: Tang, Wenpin, et al.
Publicado: (2024)

Diffusion Generative Models Meet Compressed Sensing, with Applications to Imaging and Finance
por: Guo, Zhengyi, et al.
Publicado: (2025)

RPO: Fine-Tuning Visual Generative Models via Rich Vision-Language Preferences
por: Zhao, Hanyang, et al.
Publicado: (2025)

Contractive Diffusion Probabilistic Models
por: Tang, Wenpin, et al.
Publicado: (2024)

A Reductions Approach to Risk-Sensitive Reinforcement Learning with Optimized Certainty Equivalents
por: Wang, Kaiwen, et al.
Publicado: (2024)

LaDi-RL: Latent Diffusion Reasoning Prevents Entropy Collapse in Reinforcement Learning
por: Kang, Haoqiang, et al.
Publicado: (2026)

TimeMaster: Training Time-Series Multimodal LLMs to Reason via Reinforcement Learning
por: Zhang, Junru, et al.
Publicado: (2025)

The Context Gathering Decision Process: A POMDP Framework for Agentic Search
por: Kausik, Chinmaya, et al.
Publicado: (2026)

Low-Rank MDPs with Continuous Action Spaces
por: Bennett, Andrew, et al.
Publicado: (2023)

LaDiR: Latent Diffusion Enhances LLMs for Text Reasoning
por: Kang, Haoqiang, et al.
Publicado: (2025)

KDRL: Post-Training Reasoning LLMs via Unified Knowledge Distillation and Reinforcement Learning
por: Xu, Hongling, et al.
Publicado: (2025)

DiRL: An Efficient Post-Training Framework for Diffusion Language Models
por: Zhu, Ying, et al.
Publicado: (2025)

dUltra: Ultra-Fast Diffusion Language Models via Reinforcement Learning
por: Chen, Shirui, et al.
Publicado: (2025)

LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers
por: Shen, Xuan, et al.
Publicado: (2024)

Fast Value Tracking for Deep Reinforcement Learning
por: Shih, Frank, et al.
Publicado: (2024)

Smoothing DiLoCo with Primal Averaging for Faster Training of LLMs
por: Defazio, Aaron, et al.
Publicado: (2025)

Fine-Tuning Diffusion Models for Molecular Generation via Reinforcement Learning and Fast Sampling
por: Lin, Guang, et al.
Publicado: (2026)

ADORA: Training Reasoning Models with Dynamic Advantage Estimation on Reinforcement Learning
por: Ren, Qingnan, et al.
Publicado: (2026)

Unlocking Reasoning Capabilities in LLMs via Reinforcement Learning Exploration
por: Deng, Wenhao, et al.
Publicado: (2025)

On Statistical Rates and Provably Efficient Criteria of Latent Diffusion Transformers (DiTs)
por: Hu, Jerry Yao-Chieh, et al.
Publicado: (2024)

DOTS: Learning to Reason Dynamically in LLMs via Optimal Reasoning Trajectories Search
por: Yue, Murong, et al.
Publicado: (2024)

h1: Bootstrapping LLMs to Reason over Longer Horizons via Reinforcement Learning
por: Motwani, Sumeet Ramesh, et al.
Publicado: (2025)

Can LLMs Guide Their Own Exploration? Gradient-Guided Reinforcement Learning for LLM Reasoning
por: Liang, Zhenwen, et al.
Publicado: (2025)

Adjusting Regression Models for Conditional Uncertainty Calibration
por: Gao, Ruijiang, et al.
Publicado: (2024)

xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learning
por: Qian, Cheng, et al.
Publicado: (2025)

Preference Tuning with Human Feedback on Language, Speech, and Vision Tasks: A Survey
por: Winata, Genta Indra, et al.
Publicado: (2024)

DiNO-Diffusion. Scaling Medical Diffusion via Self-Supervised Pre-Training
por: Jimenez-Perez, Guillermo, et al.
Publicado: (2024)

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
por: DeepSeek-AI, et al.
Publicado: (2025)

G1: Teaching LLMs to Reason on Graphs with Reinforcement Learning
por: Guo, Xiaojun, et al.
Publicado: (2025)

SATURN: SAT-based Reinforcement Learning to Unleash LLMs Reasoning
por: Liu, Huanyu, et al.
Publicado: (2025)

RainbowPO: A Unified Framework for Combining Improvements in Preference Optimization
por: Zhao, Hanyang, et al.
Publicado: (2024)

Efficient and Sharp Off-Policy Evaluation in Robust Markov Decision Processes
por: Bennett, Andrew, et al.
Publicado: (2024)

Reinforcing Numerical Reasoning in LLMs for Tabular Prediction via Structural Priors
por: Cai, Pengxiang, et al.
Publicado: (2025)