Copertina

Relative Preference Optimization: Enhancing LLM Alignment through Contrasting Responses across Identical and Diverse Prompts

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Yin, Yueqin, Wang, Zhendong, Gu, Yi, Huang, Hai, Chen, Weizhu, Zhou, Mingyuan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Self-Augmented Preference Optimization: Off-Policy Paradigms for Language Model Alignment
di: Yin, Yueqin, et al.
Pubblicazione: (2024)

Diffusion-RPO: Aligning Diffusion Models through Relative Preference Optimization
di: Gu, Yi, et al.
Pubblicazione: (2024)

KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Coding
di: Xu, Zhangchen, et al.
Pubblicazione: (2025)

Segmenting Text and Learning Their Rewards for Improved RLHF in Language Model
di: Yin, Yueqin, et al.
Pubblicazione: (2025)

FlipGuard: Defending Preference Alignment against Update Regression with Constrained Optimization
di: Zhu, Mingye, et al.
Pubblicazione: (2024)

Leveraging Robust Optimization for LLM Alignment under Distribution Shifts
di: Zhu, Mingye, et al.
Pubblicazione: (2025)

TODO: Enhancing LLM Alignment with Ternary Preferences
di: Guo, Yuxiang, et al.
Pubblicazione: (2024)

Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generation
di: Zhou, Mingyuan, et al.
Pubblicazione: (2024)

Contrastive Prompting Enhances Sentence Embeddings in LLMs through Inference-Time Steering
di: Cheng, Zifeng, et al.
Pubblicazione: (2025)

RMGAP: Benchmarking the Generalization of Reward Models across Diverse Preferences
di: Zhou, Yangyang, et al.
Pubblicazione: (2026)

Enhancing Multilingual Counterfactual Generation through Alignment-as-Preference Optimization
di: Wang, Yilong, et al.
Pubblicazione: (2026)

On-the-fly Preference Alignment via Principle-Guided Decoding
di: Zhu, Mingye, et al.
Pubblicazione: (2025)

MACPO: Weak-to-Strong Alignment via Multi-Agent Contrastive Preference Optimization
di: Lyu, Yougang, et al.
Pubblicazione: (2024)

MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization
di: She, Shuaijie, et al.
Pubblicazione: (2024)

Northeastern Uni at Multilingual Counterspeech Generation: Enhancing Counter Speech Generation with LLM Alignment through Direct Preference Optimization
di: Wadhwa, Sahil, et al.
Pubblicazione: (2024)

Enhancing and Accelerating Diffusion-Based Inverse Problem Solving through Measurements Optimization
di: Chen, Tianyu, et al.
Pubblicazione: (2024)

Diverse Preference Optimization
di: Lanchantin, Jack, et al.
Pubblicazione: (2025)

SemPA: Improving Sentence Embeddings of Large Language Models through Semantic Preference Alignment
di: Chen, Ziyang, et al.
Pubblicazione: (2026)

Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation
di: Xu, Haoran, et al.
Pubblicazione: (2024)

Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
di: D'Oosterlinck, Karel, et al.
Pubblicazione: (2024)

Adversarial Preference Optimization: Enhancing Your Alignment via RM-LLM Game
di: Cheng, Pengyu, et al.
Pubblicazione: (2023)

Probability-Consistent Preference Optimization for Enhanced LLM Reasoning
di: Yang, Yunqiao, et al.
Pubblicazione: (2025)

FocalPO: Enhancing Preference Optimizing by Focusing on Correct Preference Rankings
di: Liu, Tong, et al.
Pubblicazione: (2025)

Diverse Preference Learning for Capabilities and Alignment
di: Slocum, Stewart, et al.
Pubblicazione: (2025)

Group Preference Alignment: Customized LLM Response Generation from In-Situ Conversations
di: Mondal, Ishani, et al.
Pubblicazione: (2025)

Accelerated Preference Optimization for Large Language Model Alignment
di: He, Jiafan, et al.
Pubblicazione: (2024)

StoicLLM: Preference Optimization for Philosophical Alignment in Small Language Models
di: Khan, Ishmam, et al.
Pubblicazione: (2026)

Systematic Evaluation of LLM-as-a-Judge in LLM Alignment Tasks: Explainable Metrics and Diverse Prompt Templates
di: Wei, Hui, et al.
Pubblicazione: (2024)

Preference Ranking Optimization for Human Alignment
di: Song, Feifan, et al.
Pubblicazione: (2023)

HIPPO: Enhancing the Table Understanding Capability of LLMs through Hybrid-Modal Preference Optimization
di: Wang, Haolan, et al.
Pubblicazione: (2025)

PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning
di: Lu, Wenquan, et al.
Pubblicazione: (2026)

Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment
di: Wang, Jialu, et al.
Pubblicazione: (2026)

Margin Matching Preference Optimization: Enhanced Model Alignment with Granular Feedback
di: Kim, Kyuyoung, et al.
Pubblicazione: (2024)

Self-Play Preference Optimization for Language Model Alignment
di: Wu, Yue, et al.
Pubblicazione: (2024)

Data-Efficient Domain Adaptation for LLM-based MT using Contrastive Preference Optimization
di: Vieira, Inacio, et al.
Pubblicazione: (2025)

Self-Evolutionary Large Language Models through Uncertainty-Enhanced Preference Optimization
di: Wang, Jianing, et al.
Pubblicazione: (2024)

MaxMin-RLHF: Alignment with Diverse Human Preferences
di: Chakraborty, Souradip, et al.
Pubblicazione: (2024)

Beyond Prompt Content: Enhancing LLM Performance via Content-Format Integrated Prompt Optimization
di: Liu, Yuanye, et al.
Pubblicazione: (2025)

Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Step
di: Zhou, Mingyuan, et al.
Pubblicazione: (2024)

DecoupledESC: Enhancing Emotional Support Generation via Strategy-Response Decoupled Preference Optimization
di: Zhang, Chao, et al.
Pubblicazione: (2025)