Why is Your Language Model a Poor Implicit Reward Model?

Documenti analoghi

• What Makes a Reward Model a Good Teacher? An Optimization Perspective
  di: Razin, Noam, et al.
  Pubblicazione: (2025)
• Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  di: Razin, Noam, et al.
  Pubblicazione: (2024)
• When Errors Can Be Beneficial: A Categorization of Imperfect Rewards for Policy Gradient
  di: Shang, Shuning, et al.
  Pubblicazione: (2026)
• Vanishing Gradients in Reinforcement Finetuning of Language Models
  di: Razin, Noam, et al.
  Pubblicazione: (2023)
• Direct Preference Optimization: Your Language Model is Secretly a Reward Model
  di: Rafailov, Rafael, et al.
  Pubblicazione: (2023)