Copertina

Preference as Reward, Maximum Preference Optimization with Importance Sampling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Jiang, Zaifan, Huang, Xing, Wei, Chao
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

In-Context Reward Adaptation for Robust Preference Modeling
di: Sun, Zhenyu, et al.
Pubblicazione: (2026)

Sample-Efficient Preference-based Reinforcement Learning with Dynamics Aware Rewards
di: Metcalf, Katherine, et al.
Pubblicazione: (2024)

Adaptive Batch-Wise Sample Scheduling for Direct Preference Optimization
di: Huang, Zixuan, et al.
Pubblicazione: (2025)

Reward Learning From Preference With Ties
di: Liu, Jinsong, et al.
Pubblicazione: (2024)

$ξ$-DPO: Direct Preference Optimization via Ratio Reward Margin
di: Fan, Zhengyuan, et al.
Pubblicazione: (2026)

PerPO: Perceptual Preference Optimization via Discriminative Rewarding
di: Zhu, Zining, et al.
Pubblicazione: (2025)

IRPM: Intergroup Relative Preference Modeling for Pointwise Generative Reward Models
di: Song, Haonan, et al.
Pubblicazione: (2026)

T-REG: Preference Optimization with Token-Level Reward Regularization
di: Zhou, Wenxuan, et al.
Pubblicazione: (2024)

Selective Preference Optimization via Token-Level Reward Function Estimation
di: Yang, Kailai, et al.
Pubblicazione: (2024)

Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
di: Zhou, Zhanhui, et al.
Pubblicazione: (2023)

Margin Adaptive DPO: Leveraging Reward Model for Granular Control in Preference Optimization
di: Rho, Hyung Gyu
Pubblicazione: (2025)

Capturing Individual Human Preferences with Reward Features
di: Barreto, André, et al.
Pubblicazione: (2025)

Preference Elicitation for Multi-objective Combinatorial Optimization with Active Learning and Maximum Likelihood Estimation
di: Defresne, Marianne, et al.
Pubblicazione: (2025)

AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
di: Wu, Junkang, et al.
Pubblicazione: (2024)

Hindsight Preference Optimization for Financial Time Series Advisory
di: Cui, Yanwei, et al.
Pubblicazione: (2026)

PROF: An LLM-based Reward Code Preference Optimization Framework for Offline Imitation Learning
di: Sun, Shengjie, et al.
Pubblicazione: (2025)

$i$REPO: $i$mplicit Reward Pairwise Difference based Empirical Preference Optimization
di: Le, Long Tan, et al.
Pubblicazione: (2024)

Active Preference Optimization for Sample Efficient RLHF
di: Das, Nirjhar, et al.
Pubblicazione: (2024)

Thinking Preference Optimization
di: Yang, Wang, et al.
Pubblicazione: (2025)

Rectifying Shortcut Behaviors in Preference-based Reward Learning
di: Ye, Wenqian, et al.
Pubblicazione: (2025)

Exploring and Addressing Reward Confusion in Offline Preference Learning
di: Chen, Xin, et al.
Pubblicazione: (2024)

Clear Preferences Leave Traces: Reference Model-Guided Sampling for Preference Learning
di: Diwan, Nirav, et al.
Pubblicazione: (2025)

Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards
di: Wang, Haoxiang, et al.
Pubblicazione: (2024)

ActiveDPO: Active Direct Preference Optimization for Sample-Efficient Alignment
di: Lin, Xiaoqiang, et al.
Pubblicazione: (2025)

On the Role of Preference Variance in Preference Optimization
di: Guo, Jiacheng, et al.
Pubblicazione: (2025)

AMoPO: Adaptive Multi-objective Preference Optimization without Reward Models and Reference Models
di: Liu, Qi, et al.
Pubblicazione: (2025)

Latent Adversarial Regularization for Offline Preference Optimization
di: Jiang, Enyi, et al.
Pubblicazione: (2026)

Optimal Transport for LLM Reward Modeling from Noisy Preference
di: Pan, Licheng, et al.
Pubblicazione: (2026)

From Demonstrations to Rewards: Alignment Without Explicit Human Preferences
di: Zeng, Siliang, et al.
Pubblicazione: (2025)

Reward-Augmented Data Enhances Direct Preference Alignment of LLMs
di: Zhang, Shenao, et al.
Pubblicazione: (2024)

Listwise Reward Estimation for Offline Preference-based Reinforcement Learning
di: Choi, Heewoong, et al.
Pubblicazione: (2024)

Larger or Smaller Reward Margins to Select Preferences for Alignment?
di: Huang, Kexin, et al.
Pubblicazione: (2025)

ESPO: Entropy Importance Sampling Policy Optimization
di: Sheng, Yuepeng, et al.
Pubblicazione: (2025)

Residual Reward Models for Preference-based Reinforcement Learning
di: Cao, Chenyang, et al.
Pubblicazione: (2025)

PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Model
di: Lin, Baijiong, et al.
Pubblicazione: (2025)

Direct Preference Optimization: Your Language Model is Secretly a Reward Model
di: Rafailov, Rafael, et al.
Pubblicazione: (2023)

TGDPO: Harnessing Token-Level Reward Guidance for Enhancing Direct Preference Optimization
di: Zhu, Mingkang, et al.
Pubblicazione: (2025)

Preference Poisoning Attacks on Reward Model Learning
di: Wu, Junlin, et al.
Pubblicazione: (2024)

Similarity as Reward Alignment: Robust and Versatile Preference-based Reinforcement Learning
di: Rajaram, Sara, et al.
Pubblicazione: (2025)

SSPO: Self-traced Step-wise Preference Optimization for Process Supervision and Reasoning Compression
di: Xu, Yuyang, et al.
Pubblicazione: (2025)