Cover Image

Reward Modeling with Weak Supervision for Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hauptvogel, Ben, Ostendorff, Malte, Rehm, Georg, Möller, Sebastian
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Investigating Gender Bias in Turkish Language Models
by: Caglidil, Orhun Mersin, et al.
Published: (2024)

Symmetric Dot-Product Attention for Efficient Training of BERT Language Models
by: Courtois, Martin, et al.
Published: (2024)

HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information
by: Ruan, Qian, et al.
Published: (2022)

Table Understanding and (Multimodal) LLMs: A Cross-Domain Case Study on Scientific vs. Non-Scientific Data
by: Borisova, Ekaterina, et al.
Published: (2025)

Multilingual European Language Models: Benchmarking Approaches and Challenges
by: Barth, Fabio, et al.
Published: (2025)

SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing
by: Foppiano, Luca, et al.
Published: (2025)

Are Multilingual Language Models an Off-ramp for Under-resourced Languages? Will we arrive at Digital Language Equality in Europe in 2030?
by: Rehm, Georg, et al.
Published: (2025)

How desirable is alignment between LLMs and linguistically diverse human users?
by: Knoeferle, Pia, et al.
Published: (2025)

Optimizing Language Model's Reasoning Abilities with Weak Supervision
by: Tong, Yongqi, et al.
Published: (2024)

Weak Supervision Dynamic KL-Weighted Diffusion Models Guided by Large Language Models
by: Perry, Julian, et al.
Published: (2025)

Weak-to-Strong Preference Optimization: Stealing Reward from Weak Aligned Model
by: Zhu, Wenhong, et al.
Published: (2024)

Generalization of Medical Large Language Models through Cross-Domain Weak Supervision
by: Long, Robert, et al.
Published: (2025)

Simulating User Diversity in Task-Oriented Dialogue Systems using Large Language Models
by: Ahmad, Adnan, et al.
Published: (2025)

Leveraging Large Language Models for Structure Learning in Prompted Weak Supervision
by: Su, Jinyan, et al.
Published: (2024)

Training Agents with Weakly Supervised Feedback from Large Language Models
by: Gong, Dihong, et al.
Published: (2024)

Proceedings of the ISCA/ITG Workshop on Diversity in Large Speech and Language Models
by: Möller, Sebastian, et al.
Published: (2025)

Weak Reward Model Transforms Generative Models into Robust Causal Event Extraction Systems
by: da Silva, Italo Luis, et al.
Published: (2024)

Entity Linking using LLMs for Automated Product Carbon Footprint Estimation
by: Castle, Steffen, et al.
Published: (2025)

A Survey of Process Reward Models: From Outcome Signals to Process Supervisions for Large Language Models
by: Zheng, Congmin, et al.
Published: (2025)

Leveraging Large Language Models for Knowledge-free Weak Supervision in Clinical Natural Language Processing
by: Hsu, Enshuo, et al.
Published: (2024)

Reward Models are Metrics in a Trench Coat
by: Gehrmann, Sebastian
Published: (2025)

Debate Helps Weak Judges Reward Stronger Models
by: Elasky, Ethan, et al.
Published: (2026)

How to Train Text Summarization Model with Weak Supervisions
by: Wang, Yanbo, et al.
Published: (2024)

The Flip Side of RLHF: On-Policy Feedback for Reward Model Self-Supervised Improvement
by: Wang, Xiaobo, et al.
Published: (2026)

Error Typing for Smarter Rewards: Improving Process Reward Models with Error-Aware Hierarchical Supervision
by: Pala, Tej Deep, et al.
Published: (2025)

Self-Rewarding Language Models
by: Yuan, Weizhe, et al.
Published: (2024)

Stylometric Watermarks for Large Language Models
by: Niess, Georg, et al.
Published: (2024)

Ensemble Watermarks for Large Language Models
by: Niess, Georg, et al.
Published: (2024)

Checklists Are Better Than Reward Models For Aligning Language Models
by: Viswanathan, Vijay, et al.
Published: (2025)

Generalist Reward Models: Found Inside Large Language Models
by: Li, Yi-Chen, et al.
Published: (2025)

Sparse Reward Subsystem in Large Language Models
by: Xu, Guowei, et al.
Published: (2026)

ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims
by: Ahmad, Raia Abu, et al.
Published: (2026)

Weak-to-Strong Jailbreaking on Large Language Models
by: Zhao, Xuandong, et al.
Published: (2024)

RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
by: Liu, Yantao, et al.
Published: (2024)

PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models
by: Wang, Chengbing, et al.
Published: (2026)

Enhancing Large Language Model Reasoning with Reward Models: An Analytical Survey
by: Liu, Qiyuan, et al.
Published: (2025)

Learning Goal-Conditioned Representations for Language Reward Models
by: Nath, Vaskar, et al.
Published: (2024)

Reward Modeling from Natural Language Human Feedback
by: Wang, Zongqi, et al.
Published: (2026)

Classifying German Language Proficiency Levels Using Large Language Models
by: Ahlers, Elias-Leander, et al.
Published: (2025)

Prior Constraints-based Reward Model Training for Aligning Large Language Models
by: Zhou, Hang, et al.
Published: (2024)