Cover Image

ImplicitRM: Unbiased Reward Modeling from Implicit Preference Data for LLM alignment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Hao, Yang, Haocheng, Pan, Licheng, Shen, Lei, Li, Xiaoxi, Wang, Yinuo, Chen, Zhichao, Lu, Yuan, Li, Haoxuan, Lin, Zhouchen
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence Applications
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CausalRM: Causal-Theoretic Reward Modeling for RLHF from Observational User Feedbacks
by: Wang, Hao, et al.
Published: (2026)

Deep Autocorrelation Modeling for Time-Series Forecasting: Progress and Prospects
by: Wang, Hao, et al.
Published: (2026)

Optimal Transport for LLM Reward Modeling from Noisy Preference
by: Pan, Licheng, et al.
Published: (2026)

FreDF: Learning to Forecast in the Frequency Domain
by: Wang, Hao, et al.
Published: (2024)

Can LLM Improve for Expert Forecast Combination? Evidence from the European Central Bank Survey
by: Ren, Yinuo, et al.
Published: (2025)

Implicit Generative Prior for Bayesian Neural Networks
by: Liu, Yijia, et al.
Published: (2024)

Unbiased Estimation for Total Treatment Effect Under Interference Using Aggregated Dyadic Data
by: Deng, Lu, et al.
Published: (2024)

Multilevel Additive Schwarz Preconditioners for High‐Order Block Implicit Methods for Parabolic Equations
by: Shishun Li, et al.
Published: (2025)

Trustworthy AI/ML Regression and Unbiased Causal Inference for Real-World Data
by: Xu, Yifei, et al.
Published: (2026)

DistDF: Time-Series Forecasting Needs Joint-Distribution Wasserstein Alignment
by: Wang, Hao, et al.
Published: (2025)

Optimal Transport for Treatment Effect Estimation
by: Wang, Hao, et al.
Published: (2023)

A Novel Class of Unfolding Models for Binary Preference Data
by: Lei, Rayleigh, et al.
Published: (2023)

The reliability of the gender Implicit Association Test (gIAT) for high-ability careers
by: Young, S. Stanley, et al.
Published: (2024)

Implicit Biases in Refereeing: Lessons from NBA Referees
by: Pelechrinis, Konstantinos
Published: (2022)

Analyzing and Improving Diffusion Models for Time-Series Data Imputation: A Proximal Recursion Perspective
by: Chen, Zhichao, et al.
Published: (2026)

Age-Specific Logistic Regression with Complex Event Time Data
by: Haoxuan, et al.
Published: (2026)

Deep Time-series Forecasting Needs Kernelized Moment Balancing
by: Pan, Licheng, et al.
Published: (2026)

Implicit score-driven filters for time-varying parameter models
by: Lange, Rutger-Jan, et al.
Published: (2025)

Time-o1: Time-Series Forecasting Needs Transformed Label Alignment
by: Wang, Hao, et al.
Published: (2025)

Robust optimal reconciliation for hierarchical time series forecasting with M-estimation
by: Wang, Zhichao, et al.
Published: (2026)

pumBayes: Bayesian Estimation of Probit Unfolding Models for Binary Preference Data in R
by: Shi, Skylar, et al.
Published: (2025)

Towards Unbiased Evaluation of Time-series Anomaly Detector
by: Bhattacharya, Debarpan, et al.
Published: (2024)

An Efficient Two-Dimensional Functional Mixed-Effect Model Framework for Repeatedly Measured Functional Data
by: Cao, Cheng, et al.
Published: (2024)

Optimal starting point for time series forecasting
by: Zhong, Yiming, et al.
Published: (2024)

A Weight-Dependent 1RM Prediction Equation Optimized on 303,494 Near-Failure Sets Across 388 Exercises
by: Marzagao, Thiago
Published: (2026)

Optimal and Unbiased Fluxes from Up-the-Ramp Detectors under Variable Illumination
by: Li, Bowen, et al.
Published: (2026)

Beyond Missing Data: Questionnaire Uncertainty Responses as Early Digital Biomarkers of Cognitive Decline and Neurodegenerative Diseases
by: Lu, Yukun, et al.
Published: (2025)

A BJT‐Based Temperature Sensor With 58 pJ·K 2 FOM and ± 0.6°C Inaccuracy From −40 to 125°C
by: Xiaojia Wang, et al.
Published: (2025)

Gust Factor of Typhoon in the South China Sea: Based on Data From a Small Island
by: Guo‐Zhang Wang, et al.
Published: (2026)

Rectifier load modeling and zero voltage switching design of inductive power transfer system with S‐type topology on the secondary side
by: Haomin Shen, et al.
Published: (2024)

Implicit Third‐Order Peer Triplets with Variable Stepsizes for Gradient‐Based Solutions in Large‐Scale ODE‐Constrained Optimal Control
by: Jens Lang, et al.
Published: (2026)

On the Calibration of Bayesian Success Criteria and Operating Characteristics for Clinical Trials
by: Yang, Peng, et al.
Published: (2026)

Evaluating the Impact of COVID-19 on Transportation Infrastructure Funding
by: Gao, Lu, et al.
Published: (2026)

Mind the Unseen Mass: Unmasking LLM Hallucinations via Soft-Hybrid Alphabet Estimation
by: Pan, Hongxing, et al.
Published: (2026)

Beta-CoRM: A Bayesian Approach for $n$-gram Profiles Analysis
by: Perusquía, José A., et al.
Published: (2020)

Causal inference with dyadic data in randomized experiments
by: Li, Yilin, et al.
Published: (2025)

State‐of‐the‐Art Fabrication of Microneedle Patches: A Mini‐Review on Emerging Techniques
by: Syed Waqas Ali Shah, et al.
Published: (2025)

The Mood of the Sunlight: Visualization of the Sunlight Data for Public Art
by: Wang, Yifan, et al.
Published: (2022)

Density Prediction of Income Distribution Based on Mixed Frequency Data
by: Wang, Yinzhi, et al.
Published: (2025)

Quadratic Direct Forecast for Training Multi-Step Time-Series Forecast Models
by: Wang, Hao, et al.
Published: (2025)