$β$-DPO: Direct Preference Optimization with Dynamic $β$

Documenti analoghi

• AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
  di: Wu, Junkang, et al.
  Pubblicazione: (2024)
• Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization
  di: Wu, Junkang, et al.
  Pubblicazione: (2024)
• RePO: Understanding Preference Learning Through ReLU-Based Optimization
  di: Wu, Junkang, et al.
  Pubblicazione: (2025)
• Larger or Smaller Reward Margins to Select Preferences for Alignment?
  di: Huang, Kexin, et al.
  Pubblicazione: (2025)
• Quantile Advantage Estimation: Stabilizing RLVR for LLM Reasoning
  di: Wu, Junkang, et al.
  Pubblicazione: (2025)