Image de couverture de livre

2D-DPO: Scaling Direct Preference Optimization with 2-Dimensional Supervision

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Shilong, He, Yancheng, Huang, Hui, Bu, Xingyuan, Liu, Jiaheng, Guo, Hangyu, Wang, Weixun, Gu, Jihao, Su, Wenbo, Zheng, Bo
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning?
par: He, Yancheng, et autres
Publié: (2025)

Token Preference Optimization with Self-Calibrated Visual-Anchored Rewards for Hallucination Mitigation
par: Gu, Jihao, et autres
Publié: (2024)

GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models
par: Li, Shilong, et autres
Publié: (2024)

Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models
par: He, Yancheng, et autres
Publié: (2024)

2D-Curri-DPO: Two-Dimensional Curriculum Learning for Direct Preference Optimization
par: Li, Mengyang, et autres
Publié: (2025)

AIR: Complex Instruction Generation via Automatic Iterative Refinement
par: Liu, Wei, et autres
Publié: (2025)

Think-J: Learning to Think for Generative LLM-as-a-Judge
par: Huang, Hui, et autres
Publié: (2025)

DREAM: Disentangling Risks to Enhance Safety Alignment in Multimodal Large Language Models
par: Liu, Jianyu, et autres
Publié: (2025)

ProgCo: Program Helps Self-Correction of Large Language Models
par: Song, Xiaoshuai, et autres
Publié: (2025)

C2-DPO: Constrained Controlled Direct Preference Optimization
par: Asadi, Kavosh, et autres
Publié: (2025)

MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
par: Bai, Ge, et autres
Publié: (2024)

$β$-DPO: Direct Preference Optimization with Dynamic $β$
par: Wu, Junkang, et autres
Publié: (2024)

CE-RM: A Pointwise Generative Reward Model Optimized via Two-Stage Rollout and Unified Criteria
par: Hu, Xinyu, et autres
Publié: (2026)

Iterative Length-Regularized Direct Preference Optimization: A Case Study on Improving 7B Language Models to GPT-4 Level
par: Liu, Jie, et autres
Publié: (2024)

AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
par: Wu, Junkang, et autres
Publié: (2024)

Deconstructing Long Chain-of-Thought: A Structured Reasoning Optimization Framework for Long CoT Distillation
par: Luo, Yijia, et autres
Publié: (2025)

DPO-Shift: Shifting the Distribution of Direct Preference Optimization
par: Yang, Xiliang, et autres
Publié: (2025)

SEE-DPO: Self Entropy Enhanced Direct Preference Optimization
par: Shekhar, Shivanshu, et autres
Publié: (2024)

TUR-DPO: Topology- and Uncertainty-Aware Direct Preference Optimization
par: Abdullah, Abdulhady Abas, et autres
Publié: (2026)

DeDPO: Debiased Direct Preference Optimization for Diffusion Models
par: Pham, Khiem, et autres
Publié: (2026)

Asymmetric Proximal Policy Optimization: mini-critics boost LLM reasoning
par: Liu, Jiashun, et autres
Publié: (2025)

DreamDPO: Aligning Text-to-3D Generation with Human Preferences via Direct Preference Optimization
par: Zhou, Zhenglin, et autres
Publié: (2025)

Equilibrate RLHF: Towards Balancing Helpfulness-Safety Trade-off in Large Language Models
par: Tan, Yingshui, et autres
Publié: (2025)

$ξ$-DPO: Direct Preference Optimization via Ratio Reward Margin
par: Fan, Zhengyuan, et autres
Publié: (2026)

Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing
par: Qi, Biqing, et autres
Publié: (2024)

GroupDPO: Memory efficient Group-wise Direct Preference Optimization
par: Leng, Jixuan, et autres
Publié: (2026)

ActiveDPO: Active Direct Preference Optimization for Sample-Efficient Alignment
par: Lin, Xiaoqiang, et autres
Publié: (2025)

Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignment
par: Xiao, Teng, et autres
Publié: (2024)

AnnoDPO: Protein Functional Annotation Learning with Direct Preference Optimization
par: Jiang, Zixuan, et autres
Publié: (2025)

AVC-DPO: Aligned Video Captioning via Direct Preference Optimization
par: Tang, Jiyang, et autres
Publié: (2025)

EnerBridge-DPO: Energy-Guided Protein Inverse Folding with Markov Bridges and Direct Preference Optimization
par: Rong, Dingyi, et autres
Publié: (2025)

WiS Platform: Enhancing Evaluation of LLM-Based Multi-Agent Systems Through Game-Based Analysis
par: Hu, Chengwei, et autres
Publié: (2024)

TPMM-DPO: Trajectory-aware Preference-guided Model Merging for Iterative Direct Preference Optimization
par: Fu, Lingling, et autres
Publié: (2026)

BiasDPO: Mitigating Bias in Language Models through Direct Preference Optimization
par: Allam, Ahmed
Publié: (2024)

AdaDPO: Self-Adaptive Direct Preference Optimization with Balanced Gradient Updates
par: Chen, Shaolong, et autres
Publié: (2026)

CompassDPO: Dynamics-Controlled Direct Preference Optimization for Robust Safety Alignment
par: Liu, Jilong, et autres
Publié: (2026)

DreamBoothDPO: Improving Personalized Generation using Direct Preference Optimization
par: Ayupov, Shamil, et autres
Publié: (2025)

SafeDPO: A Simple Approach to Direct Preference Optimization with Enhanced Safety
par: Kim, Geon-Hyeong, et autres
Publié: (2025)

Emo-DPO: Controllable Emotional Speech Synthesis through Direct Preference Optimization
par: Gao, Xiaoxue, et autres
Publié: (2024)

"See the World, Discover Knowledge": A Chinese Factuality Evaluation for Large Vision Language Models
par: Gu, Jihao, et autres
Publié: (2025)