Disentangling Length from Quality in Direct Preference Optimization

Documenti analoghi

• Direct Preference Optimization: Your Language Model is Secretly a Reward Model
  di: Rafailov, Rafael, et al.
  Pubblicazione: (2023)
• Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  di: Zhou, Yiyang, et al.
  Pubblicazione: (2024)
• Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms
  di: Rafailov, Rafael, et al.
  Pubblicazione: (2024)
• FSPO: Few-Shot Optimization of Synthetic Preferences Personalizes to Real Users
  di: Singh, Anikait, et al.
  Pubblicazione: (2025)
• Length Desensitization in Direct Preference Optimization
  di: Liu, Wei, et al.
  Pubblicazione: (2024)