Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data

Documenti analoghi

• Direct Preference Optimization: Your Language Model is Secretly a Reward Model
  di: Rafailov, Rafael, et al.
  Pubblicazione: (2023)
• Disentangling Length from Quality in Direct Preference Optimization
  di: Park, Ryan, et al.
  Pubblicazione: (2024)
• FSPO: Few-Shot Optimization of Synthetic Preferences Personalizes to Real Users
  di: Singh, Anikait, et al.
  Pubblicazione: (2025)
• Personalized Preference Fine-tuning of Diffusion Models
  di: Dang, Meihua, et al.
  Pubblicazione: (2025)
• Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation
  di: Manvi, Rohin, et al.
  Pubblicazione: (2024)