Copertina

A Survey of Direct Preference Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Shunyu, Fang, Wenkai, Hu, Zetian, Zhang, Junjie, Zhou, Yang, Zhang, Kongcheng, Tu, Rongcheng, Lin, Ting-En, Huang, Fei, Song, Mingli, Li, Yongbin, Tao, Dacheng
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SeRL: Self-Play Reinforcement Learning for Large Language Models with Limited Data
di: Fang, Wenkai, et al.
Pubblicazione: (2025)

Reasoning with Reinforced Functional Token Tuning
di: Zhang, Kongcheng, et al.
Pubblicazione: (2025)

STRIDE: Learnable Stepwise Language Feedback for LLM Reasoning
di: Zhang, Junjie, et al.
Pubblicazione: (2026)

Supervised Optimism Correction: Be Confident When LLMs Are Sure
di: Zhang, Junjie, et al.
Pubblicazione: (2025)

A Simple "Motivation" Can Enhance Reinforcement Finetuning of Large Reasoning Models
di: Zhang, Junjie, et al.
Pubblicazione: (2025)

Odyssey: Empowering Minecraft Agents with Open-World Skills
di: Liu, Shunyu, et al.
Pubblicazione: (2024)

Consistent Paths Lead to Truth: Self-Rewarding Reinforcement Learning for LLM Reasoning
di: Zhang, Kongcheng, et al.
Pubblicazione: (2025)

Replay Failures as Successes: Sample-Efficient Reinforcement Learning for Instruction Following
di: Zhang, Kongcheng, et al.
Pubblicazione: (2025)

Reverse Preference Optimization for Complex Instruction Following
di: Huang, Xiang, et al.
Pubblicazione: (2025)

Lightning Fast Caching-based Parallel Denoising Prediction for Accelerating Talking Head Generation
di: Long, Jianzhi, et al.
Pubblicazione: (2025)

A Survey on Self-Evolution of Large Language Models
di: Tao, Zhengwei, et al.
Pubblicazione: (2024)

A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Models
di: Shuai, Xincheng, et al.
Pubblicazione: (2024)

Is On-Policy Data always the Best Choice for Direct Preference Optimization-based LM Alignment?
di: Sun, Zetian, et al.
Pubblicazione: (2025)

Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for General LLM Reasoning
di: Zhou, Yang, et al.
Pubblicazione: (2025)

Improving Factual Consistency of News Summarization by Contrastive Preference Optimization
di: Feng, Huawen, et al.
Pubblicazione: (2023)

T2V-OptJail: Discrete Prompt Optimization for Text-to-Video Jailbreak Attacks
di: Liu, Jiayang, et al.
Pubblicazione: (2025)

Tree of Preferences for Diversified Recommendation
di: Yuan, Hanyang, et al.
Pubblicazione: (2025)

IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization
di: Zhang, Xinghua, et al.
Pubblicazione: (2024)

Preference Ranking Optimization for Human Alignment
di: Song, Feifan, et al.
Pubblicazione: (2023)

A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges
di: Qing, Yunpeng, et al.
Pubblicazione: (2022)

T2VShield: Model-Agnostic Jailbreak Defense for Text-to-Video Models
di: Liang, Siyuan, et al.
Pubblicazione: (2025)

GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Rendering
di: Shuai, Xincheng, et al.
Pubblicazione: (2026)

SDPO: Segment-Level Direct Preference Optimization for Social Agents
di: Kong, Aobo, et al.
Pubblicazione: (2025)

R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimization
di: Zhang, Jingyi, et al.
Pubblicazione: (2025)

A Survey on Agentic Multimodal Large Language Models
di: Yao, Huanjin, et al.
Pubblicazione: (2025)

Bi-level Mean Field: Dynamic Grouping for Large-Scale MARL
di: Zheng, Yuxuan, et al.
Pubblicazione: (2025)

Event-based Simultaneous Localization and Mapping: A Comprehensive Survey
di: Huang, Kunping, et al.
Pubblicazione: (2023)

Advances in photosynthesis research: Unlocking the potential for food security, renewable energy, and environmental sustainability
di: Wenqiang Yang, et al.
Pubblicazione: (2025)

Topology-aware Generalization of Decentralized SGD
di: Zhu, Tongtian, et al.
Pubblicazione: (2022)

Intra-Trajectory Consistency for Reward Modeling
di: Zhou, Chaoyang, et al.
Pubblicazione: (2025)

A Comprehensive Survey of Direct Preference Optimization: Datasets, Theories, Variants, and Applications
di: Xiao, Wenyi, et al.
Pubblicazione: (2024)

Diffusion Model-Based Video Editing: A Survey
di: Sun, Wenhao, et al.
Pubblicazione: (2024)

Temporal Prototype-Aware Learning for Active Voltage Control on Power Distribution Networks
di: Xu, Feiyang, et al.
Pubblicazione: (2024)

A2PO: Towards Effective Offline Reinforcement Learning from an Advantage-aware Perspective
di: Qing, Yunpeng, et al.
Pubblicazione: (2024)

Unveiling Global Interactive Patterns across Graphs: Towards Interpretable Graph Neural Networks
di: Wang, Yuwen, et al.
Pubblicazione: (2024)

COLA: Cross-city Mobility Transformer for Human Trajectory Simulation
di: Wang, Yu, et al.
Pubblicazione: (2024)

Parallelized Planning-Acting for Efficient LLM-based Multi-Agent Systems in Minecraft
di: Li, Yaoru, et al.
Pubblicazione: (2025)

Learning a Mini-batch Graph Transformer via Two-stage Interaction Augmentation
di: Li, Wenda, et al.
Pubblicazione: (2024)

Experience is the Best Teacher: Motivating Effective Exploration in Reinforcement Learning for LLMs
di: Zhang, Wenjian, et al.
Pubblicazione: (2026)

Reinforced Model Merging
di: Han, Jiaqi, et al.
Pubblicazione: (2025)