Image de couverture de livre

References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kim, Doyoung, Lee, Youngjun, Kim, Joeun, Bang, Jihwan, Song, Hwanjun, Yoon, Susik, Lee, Jae-Gil
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

One Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual Learning
par: Kim, Doyoung, et autres
Publié: (2023)

SimPO: Simple Preference Optimization with a Reference-Free Reward
par: Meng, Yu, et autres
Publié: (2024)

Understanding Reference Policies in Direct Preference Optimization
par: Liu, Yixin, et autres
Publié: (2024)

Back to the Future: Look-ahead Augmentation and Parallel Self-Refinement for Time Series Forecasting
par: Kim, Sunho, et autres
Publié: (2026)

Multi-Reference Preference Optimization for Large Language Models
par: Le, Hung, et autres
Publié: (2024)

Towards Verifiable Text Generation with Symbolic References
par: Hennigen, Lucas Torroba, et autres
Publié: (2023)

DiaTool-DPO: Multi-Turn Direct Preference Optimization for Tool-Augmented Large Language Models
par: Jung, Sunghee, et autres
Publié: (2025)

VPO: Leveraging the Number of Votes in Preference Optimization
par: Cho, Jae Hyeon, et autres
Publié: (2024)

Spread Preference Annotation: Direct Preference Judgment for Efficient LLM Alignment
par: Kim, Dongyoung, et autres
Publié: (2024)

Let Multimodal Embedders Learn When to Augment Query via Adaptive Query Augmentation
par: Kim, Wongyu, et autres
Publié: (2025)

Conversational Query Reformulation with the Guidance of Retrieved Documents
par: Park, Jeonghyun, et autres
Publié: (2024)

ReFeed: Multi-dimensional Summarization Refinement with Reflective Reasoning on Feedback
par: Yun, Taewon, et autres
Publié: (2025)

Projectable Models: One-Shot Generation of Small Specialized Transformers from Large Ones
par: Zhmoginov, Andrey, et autres
Publié: (2025)

Reference-based Metrics Disprove Themselves in Question Generation
par: Nguyen, Bang, et autres
Publié: (2024)

ConfPO: Exploiting Policy Model Confidence for Critical Token Selection in Preference Optimization
par: Yoon, Hee Suk, et autres
Publié: (2025)

Segment-driven Structural Induction and Semantic Alignment for Heterogeneous Tabular Representation
par: Jung, Woojun, et autres
Publié: (2026)

Preference Alignment with Flow Matching
par: Kim, Minu, et autres
Publié: (2024)

FlowBot: Inducing LLM Workflows with Bilevel Optimization and Textual Gradients
par: Yu, Hongyeon, et autres
Publié: (2026)

BAPO: Base-Anchored Preference Optimization for Overcoming Forgetting in Large Language Models Personalization
par: Lee, Gihun, et autres
Publié: (2024)

Text Change Detection in Multilingual Documents Using Image Comparison
par: Park, Doyoung, et autres
Publié: (2024)

MAGE: All-[MASK] Block Already Knows Where to Look in Diffusion LLM
par: Kwon, Omin, et autres
Publié: (2026)

LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
par: Park, Juneyoung, et autres
Publié: (2026)

Multi-level Diagnosis and Evaluation for Robust Tabular Feature Engineering with Large Language Models
par: Lim, Yebin, et autres
Publié: (2025)

Contextually Guided Transformers via Low-Rank Adaptation
par: Zhmoginov, Andrey, et autres
Publié: (2025)

Case-Based Reasoning Approach for Solving Financial Question Answering
par: Kim, Yikyung, et autres
Publié: (2024)

REFA: Reference Free Alignment for multi-preference optimization
par: Gupta, Taneesh, et autres
Publié: (2024)

LLM-based User Profile Management for Recommender System
par: Bang, Seunghwan, et autres
Publié: (2025)

Universal Time-Series Representation Learning: A Survey
par: Trirat, Patara, et autres
Publié: (2024)

EdiText: Controllable Coarse-to-Fine Text Editing with Diffusion Language Models
par: Lee, Che Hyun, et autres
Publié: (2025)

FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acceleration
par: Jo, Dongwon, et autres
Publié: (2025)

SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
par: Song, Jiwon, et autres
Publié: (2024)

Detecting Token-Level Hallucinations Using Variance Signals: A Reference-Free Approach
par: Kumar, Keshav
Publié: (2025)

Multi-Response Preference Optimization with Augmented Ranking Dataset
par: Gwon, Hansle, et autres
Publié: (2024)

Reference-Free Rating of LLM Responses via Latent Information
par: Girrbach, Leander, et autres
Publié: (2025)

Expanding Foundational Language Capabilities in Open-Source LLMs through a Korean Case Study
par: Lim, Junghwan, et autres
Publié: (2025)

From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG
par: Lee, Changmin, et autres
Publié: (2026)

Query-Conditioned Test-Time Self-Training for Large Language Models
par: Song, Chaehee, et autres
Publié: (2026)

MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimation
par: Lee, Se Yoon, et autres
Publié: (2026)

DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum
par: Kim, Jihwan, et autres
Publié: (2026)

SPARK: Stepwise Process-Aware Rewards for Reference-Free Reinforcement Learning
par: Rahman, Salman, et autres
Publié: (2025)