Image de couverture de livre

Preference Consistency Matters: Enhancing Preference Learning in Language Models with Automated Self-Curation of Training Corpora

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lee, JoonHo, Son, JuYoun, Seok, Juree, Jang, Wooseok, Kwon, Yeong-Dae
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Improving Instruction Following in Language Models through Proxy-Based Uncertainty Estimation
par: Lee, JoonHo, et autres
Publié: (2024)

SGuard-v1: Safety Guardrail for Large Language Models
par: Lee, JoonHo, et autres
Publié: (2025)

A Bayesian Hierarchical Hurdle Beta-Binomial Model for Survey-Weighted Bounded Counts and Its Application to Childcare Enrollment
par: Lee, JoonHo
Publié: (2026)

Design-Conditional Prior Elicitation for Dirichlet Process Mixtures: A Unified Framework for Cluster Counts and Weight Control
par: Lee, JoonHo
Publié: (2026)

Reliability-Targeted Simulation of Item Response Data: Solving the Inverse Design Problem
par: Lee, JoonHo
Publié: (2025)

Design Effect Ratios for Bayesian Survey Models: A Diagnostic Framework for Identifying Survey-Sensitive Parameters
par: Lee, JoonHo
Publié: (2026)

Beyond the Null Effect: Unmasking the True Impact of Teacher-Child Interaction Quality on Child Outcomes in Early Head Start
par: Lee, JoonHo, et autres
Publié: (2026)

Exploring OCR-augmented Generation for Bilingual VQA
par: Lee, JoonHo, et autres
Publié: (2025)

MEGA-GUI: Multi-stage Enhanced Grounding Agents for GUI Elements
par: Kwak, SeokJoo, et autres
Publié: (2025)

CPR: Mitigating Large Language Model Hallucinations with Curative Prompt Refinement
par: Shim, Jung-Woo, et autres
Publié: (2025)

Valid standard errors for Bayesian quantile regression with clustered and independent data
par: Ji, Feng, et autres
Publié: (2024)

V-STRONG: Visual Self-Supervised Traversability Learning for Off-road Navigation
par: Jung, Sanghun, et autres
Publié: (2023)

MIRe: Enhancing Multimodal Queries Representation via Fusion-Free Modality Interaction for Multimodal Retrieval
par: Ju, Yeong-Joon, et autres
Publié: (2024)

Self-Consistency Preference Optimization
par: Prasad, Archiki, et autres
Publié: (2024)

Training Unbiased Diffusion Models From Biased Dataset
par: Kim, Yeongmin, et autres
Publié: (2024)

Self-Training Meets Consistency: Improving LLMs' Reasoning with Consistency-Driven Rationale Evaluation
par: Lee, Jaehyeok, et autres
Publié: (2024)

Publish and Perish: How AI-Accelerated Writing Without Proportional Verification Investment Degrades Scientific Knowledge
par: Kwon, Seok Joon
Publié: (2026)

Computational Design of Optimized Modular Photovoltaic Electrochemical Reactor for Energy Efficient CO2‐to‐Cn Reduction Reaction with Bandgap Tunable Perovskite Tandem Cells
par: Seok Joon Kwon
Publié: (2024)

Citation-Closure Retrieval and Per-Rule Attribution for Real-World Regulatory Compliance Question Answering
par: Ju, Yeong-Joon, et autres
Publié: (2026)

From Generator to Embedder: Harnessing Innate Abilities of Multimodal LLMs via Building Zero-Shot Discriminative Embedding Model
par: Ju, Yeong-Joon, et autres
Publié: (2025)

Self-supervised Preference Optimization: Enhance Your Language Model with Preference Degree Awareness
par: Li, Jian, et autres
Publié: (2024)

Policy-labeled Preference Learning: Is Preference Enough for RLHF?
par: Cho, Taehyun, et autres
Publié: (2025)

Self-Consuming Generative Models with Curated Data Provably Optimize Human Preferences
par: Ferbach, Damien, et autres
Publié: (2024)

Improving the Estimation of Site-Specific Effects and their Distribution in Multisite Trials
par: Lee, JoonHo, et autres
Publié: (2023)

MORPH Wheel: A Passive Variable-Radius Wheel Embedding Mechanical Behavior Logic for Input-Responsive Transformation
par: Jang, JaeHyung, et autres
Publié: (2026)

Visual Preference Inference: An Image Sequence-Based Preference Reasoning in Tabletop Object Manipulation
par: Lee, Joonhyung, et autres
Publié: (2024)

Probability-Consistent Preference Optimization for Enhanced LLM Reasoning
par: Yang, Yunqiao, et autres
Publié: (2025)

Fork-Merge Decoding: Enhancing Multimodal Understanding in Audio-Visual Large Language Models
par: Jung, Chaeyoung, et autres
Publié: (2025)

TSO: Self-Training with Scaled Preference Optimization
par: Chen, Kaihui, et autres
Publié: (2024)

Crystallizing Schemas with Teleoscope: Thematic Curation of Large Text Corpora on Reddit
par: Lee, Patrick Yung Kang, et autres
Publié: (2024)

Automatic Semantic Role Labeling using Selectional Preferences with Very Large Corpora
par: Hiram Calvo
Publié: (2008)

FastAV: Efficient Token Pruning for Audio-Visual Large Language Model Inference
par: Jung, Chaeyoung, et autres
Publié: (2026)

Multi-Domain Recommendation to Attract Users via Domain Preference Modeling
par: Ju, Hyunjun, et autres
Publié: (2024)

Extreme Self-Preference in Language Models
par: Lehr, Steven A., et autres
Publié: (2025)

Online Self-Preferring Language Models
par: Zhai, Yuanzhao, et autres
Publié: (2024)

AVCD: Mitigating Hallucinations in Audio-Visual Large Language Models through Contrastive Decoding
par: Jung, Chaeyoung, et autres
Publié: (2025)

TLPO: Token-Level Policy Optimization for Mitigating Language Confusion in Large Language Models
par: Choo, Jinho, et autres
Publié: (2026)

When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop
par: Zhang, Yang, et autres
Publié: (2026)

Small-Margin Preferences Still Matter-If You Train Them Right
par: Pang, Jinlong, et autres
Publié: (2026)

SafeDPO: A Simple Approach to Direct Preference Optimization with Enhanced Safety
par: Kim, Geon-Hyeong, et autres
Publié: (2025)