Mitigating Preference Hacking in Policy Optimization with Pessimism

Documenti analoghi

• Design Considerations in Offline Preference-based RL
  di: Agarwal, Alekh, et al.
  Pubblicazione: (2025)
• Non-Linear Reinforcement Learning in Large Action Spaces: Structural Conditions and Sample-efficiency of Posterior Sampling
  di: Agarwal, Alekh, et al.
  Pubblicazione: (2022)
• From Curiosity to Caution: Mitigating Reward Hacking for Best-of-N with Pessimism
  di: Yu, Zhuohao, et al.
  Pubblicazione: (2026)
• Can RLHF be More Efficient with Imperfect Reward Models? A Policy Coverage Perspective
  di: Huang, Jiawei, et al.
  Pubblicazione: (2025)
• Unified PAC-Bayesian Study of Pessimism for Offline Policy Learning with Regularized Importance Sampling
  di: Aouali, Imad, et al.
  Pubblicazione: (2024)