Imagen de Portada

Bayesian Preference Learning for Test-Time Steerable Reward Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hong, Jiwoo, Tang, Shao, Wang, Zhipeng
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

On the Robustness of Reward Models for Language Model Alignment
por: Hong, Jiwoo, et al.
Publicado: (2025)

Preference Poisoning Attacks on Reward Model Learning
por: Wu, Junlin, et al.
Publicado: (2024)

Generalizing Reward Modeling for Out-of-Distribution Preference Learning
por: Jia, Chen
Publicado: (2024)

Duel-Evolve: Reward-Free Test-Time Scaling via LLM Self-Preferences
por: Karlekar, Sweta, et al.
Publicado: (2026)

Pragmatic Feature Preferences: Learning Reward-Relevant Preferences from Human Input
por: Peng, Andi, et al.
Publicado: (2024)

Deep Bayesian Active Learning for Preference Modeling in Large Language Models
por: Melo, Luckeciano C., et al.
Publicado: (2024)

Robust Preference Optimization through Reward Model Distillation
por: Fisch, Adam, et al.
Publicado: (2024)

Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts
por: Wang, Haoxiang, et al.
Publicado: (2024)

Adaptive Test-Time Reasoning via Reward-Guided Dual-Phase Search
por: Cui, Yingqian, et al.
Publicado: (2025)

On the Limited Generalization Capability of the Implicit Reward Model Induced by Direct Preference Optimization
por: Lin, Yong, et al.
Publicado: (2024)

Reward-aware Preference Optimization: A Unified Mathematical Framework for Model Alignment
por: Sun, Shengyang, et al.
Publicado: (2025)

RFG: Test-Time Scaling for Diffusion Large Language Model Reasoning with Reward-Free Guidance
por: Chen, Tianlang, et al.
Publicado: (2025)

C2: Scalable Rubric-Augmented Reward Modeling from Binary Preferences
por: Kawabata, Akira, et al.
Publicado: (2026)

Simultaneous Reward Distillation and Preference Learning: Get You a Language Model Who Can Do Both
por: Nath, Abhijnan, et al.
Publicado: (2024)

Beyond Scalar Reward Model: Learning Generative Judge from Preference Data
por: Ye, Ziyi, et al.
Publicado: (2024)

Group Robust Preference Optimization in Reward-free RLHF
por: Ramesh, Shyam Sundhar, et al.
Publicado: (2024)

Exploring Chain-of-Thought Reasoning for Steerable Pluralistic Alignment
por: Zhang, Yunfan, et al.
Publicado: (2025)

EVALUESTEER: Measuring Reward Model Steerability Towards Values and Preferences
por: Ghate, Kshitish, et al.
Publicado: (2025)

Entropy Centroids as Intrinsic Rewards for Test-Time Scaling
por: Zhao, Wenshuo, et al.
Publicado: (2026)

When In-Distribution Gains Fail: Evaluating Weak-to-Strong Reward Models under Preference Shift
por: Le, Khoi, et al.
Publicado: (2026)

Sentence-level Reward Model can Generalize Better for Aligning LLM from Human Preference
por: Qiu, Wenjie, et al.
Publicado: (2025)

West-of-N: Synthetic Preferences for Self-Improving Reward Models
por: Pace, Alizée, et al.
Publicado: (2024)

Larger or Smaller Reward Margins to Select Preferences for Alignment?
por: Huang, Kexin, et al.
Publicado: (2025)

On the Power of (Approximate) Reward Models for Inference-Time Scaling
por: Zhu, Youheng, et al.
Publicado: (2026)

SimPO: Simple Preference Optimization with a Reference-Free Reward
por: Meng, Yu, et al.
Publicado: (2024)

AutoRule: Reasoning Chain-of-thought Extracted Rule-based Rewards Improve Preference Learning
por: Wang, Tevin, et al.
Publicado: (2025)

The Geometric Canary: Predicting Steerability and Detecting Drift via Representational Stability
por: Raju, Prashant C.
Publicado: (2026)

VerifierQ: Enhancing LLM Test Time Compute with Q-Learning-based Verifiers
por: Qi, Jianing, et al.
Publicado: (2024)

Energy-Based Preference Model Offers Better Offline Alignment than the Bradley-Terry Preference Model
por: Hong, Yuzhong, et al.
Publicado: (2024)

Test-Time Scaling with Reflective Generative Model
por: Wang, Zixiao, et al.
Publicado: (2025)

Alternating Reinforcement Learning for Rubric-Based Reward Modeling in Non-Verifiable LLM Post-Training
por: Xu, Ran, et al.
Publicado: (2026)

Direct Preference Optimization: Your Language Model is Secretly a Reward Model
por: Rafailov, Rafael, et al.
Publicado: (2023)

Tool Calling is Linearly Readable and Steerable in Language Models
por: Wu, Zekun, et al.
Publicado: (2026)

Reinforcement Learning Teachers of Test Time Scaling
por: Cetin, Edoardo, et al.
Publicado: (2025)

AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
por: Wu, Junkang, et al.
Publicado: (2024)

A Course Correction in Steerability Evaluation: Revealing Miscalibration and Side Effects in LLMs
por: Chang, Trenton, et al.
Publicado: (2025)

Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards
por: Wang, Haoxiang, et al.
Publicado: (2024)

DreamReward: Text-to-3D Generation with Human Preference
por: Ye, Junliang, et al.
Publicado: (2024)

Integrating Time Series into LLMs via Multi-layer Steerable Embedding Fusion for Enhanced Forecasting
por: Chen, Zhuomin, et al.
Publicado: (2025)

Inference-Time Scaling for Generalist Reward Modeling
por: Liu, Zijun, et al.
Publicado: (2025)