Imagen de Portada

Distributed Direct Preference Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Jiang, Zhanhong
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Direct Preference Optimization With Unobserved Preference Heterogeneity: The Necessity of Ternary Preferences
por: Chidambaram, Keertana, et al.
Publicado: (2024)

Gradient Imbalance in Direct Preference Optimization
por: Ma, Qinwei, et al.
Publicado: (2025)

Active Learning for Direct Preference Optimization
por: Kveton, Branislav, et al.
Publicado: (2025)

Lightweight Robust Direct Preference Optimization
por: Kim, Cheol Woo, et al.
Publicado: (2025)

A Survey of Direct Preference Optimization
por: Liu, Shunyu, et al.
Publicado: (2025)

Robust LLM Alignment via Distributionally Robust Direct Preference Optimization
por: Xu, Zaiyan, et al.
Publicado: (2025)

Asynchronous Training Schemes in Distributed Learning with Time Delay
por: Wang, Haoxiang, et al.
Publicado: (2022)

Differential Information Distribution: A Bayesian Perspective on Direct Preference Optimization
por: Won, Yunjae, et al.
Publicado: (2025)

Continuous-Utility Direct Preference Optimization
por: Mohsin, Muhammad Ahmed, et al.
Publicado: (2026)

ADPO: Anchored Direct Preference Optimization
por: Zixian, Wang
Publicado: (2025)

Length Desensitization in Direct Preference Optimization
por: Liu, Wei, et al.
Publicado: (2024)

Direct Preference Optimization for Adaptive Concept-based Explanations
por: Teneggi, Jacopo, et al.
Publicado: (2025)

Understanding the Impact of Sampling Quality in Direct Preference Optimization
por: Kim, Kyung Rok, et al.
Publicado: (2025)

Filtered Direct Preference Optimization
por: Morimura, Tetsuro, et al.
Publicado: (2024)

Direct Preference Optimization with an Offset
por: Amini, Afra, et al.
Publicado: (2024)

Right Now, Wrong Then: Non-Stationary Direct Preference Optimization under Preference Drift
por: Son, Seongho, et al.
Publicado: (2024)

Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization
por: Wu, Junkang, et al.
Publicado: (2024)

Uncertainty-Penalized Direct Preference Optimization
por: Houliston, Sam, et al.
Publicado: (2024)

Understanding Reference Policies in Direct Preference Optimization
por: Liu, Yixin, et al.
Publicado: (2024)

Aligning CodeLLMs with Direct Preference Optimization
por: Miao, Yibo, et al.
Publicado: (2024)

Accelerating Direct Preference Optimization with Prefix Sharing
por: Wang, Franklin, et al.
Publicado: (2024)

ADKO: Agentic Decentralized Knowledge Optimization
por: Rillo, Lucas Nerone, et al.
Publicado: (2026)

Latent Safety-Constrained Policy Approach for Safe Offline Reinforcement Learning
por: Koirala, Prajwal, et al.
Publicado: (2024)

FAWAC: Feasibility Informed Advantage Weighted Regression for Persistent Safety in Offline Reinforcement Learning
por: Koirala, Prajwal, et al.
Publicado: (2024)

Entropy Controllable Direct Preference Optimization
por: Omura, Motoki, et al.
Publicado: (2024)

Orthogonal Finetuning for Direct Preference Optimization
por: Yang, Chenxu, et al.
Publicado: (2024)

Direct Preference Optimization with Rating Information: Practical Algorithms and Provable Gains
por: Viano, Luca, et al.
Publicado: (2026)

Direct Multi-Turn Preference Optimization for Language Agents
por: Shi, Wentao, et al.
Publicado: (2024)

$β$-DPO: Direct Preference Optimization with Dynamic $β$
por: Wu, Junkang, et al.
Publicado: (2024)

The Crucial Role of Samplers in Online Direct Preference Optimization
por: Shi, Ruizhe, et al.
Publicado: (2024)

Disentangling Length from Quality in Direct Preference Optimization
por: Park, Ryan, et al.
Publicado: (2024)

Decomposed Direct Preference Optimization for Structure-Based Drug Design
por: Cheng, Xiwei, et al.
Publicado: (2024)

Preference as Reward, Maximum Preference Optimization with Importance Sampling
por: Jiang, Zaifan, et al.
Publicado: (2023)

Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
por: Zhou, Zhanhui, et al.
Publicado: (2023)

COOPO: Cyclic Offline-Online Policy Optimization Algorithm
por: Liu, Qisai, et al.
Publicado: (2026)

CompassDPO: Dynamics-Controlled Direct Preference Optimization for Robust Safety Alignment
por: Liu, Jilong, et al.
Publicado: (2026)

Direct Preference Optimization for Primitive-Enabled Hierarchical RL: A Bilevel Approach
por: Singh, Utsav, et al.
Publicado: (2024)

DIPPER: Direct Preference Optimization to Accelerate Primitive-Enabled Hierarchical Reinforcement Learning
por: Singh, Utsav, et al.
Publicado: (2024)

Adaptive Batch-Wise Sample Scheduling for Direct Preference Optimization
por: Huang, Zixuan, et al.
Publicado: (2025)

KL Penalty Control via Perturbation for Direct Preference Optimization
por: Lee, Sangkyu, et al.
Publicado: (2025)