Image de couverture de livre

Some things are more CRINGE than others: Iterative Preference Optimization with the Pairwise Cringe Loss

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Xu, Jing, Lee, Andrew, Sukhbaatar, Sainbayar, Weston, Jason
Format:	Preprint
Publié:	2023
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Iterative Reasoning Preference Optimization
par: Pang, Richard Yuanzhe, et autres
Publié: (2024)

Contextual Position Encoding: Learning to Count What's Important
par: Golovneva, Olga, et autres
Publié: (2024)

Reverse Training to Nurse the Reversal Curse
par: Golovneva, Olga, et autres
Publié: (2024)

Self-Consistency Preference Optimization
par: Prasad, Archiki, et autres
Publié: (2024)

Self-Challenging Language Model Agents
par: Zhou, Yifei, et autres
Publié: (2025)

Thinking LLMs: General Instruction Following with Thought Generation
par: Wu, Tianhao, et autres
Publié: (2024)

Self-Rewarding Language Models
par: Yuan, Weizhe, et autres
Publié: (2024)

R.I.P.: Better Models by Survival of the Fittest Prompts
par: Yu, Ping, et autres
Publié: (2025)

Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge
par: Wu, Tianhao, et autres
Publié: (2024)

StepWiser: Stepwise Generative Judges for Wiser Reasoning
par: Xiong, Wei, et autres
Publié: (2025)

CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks
par: Yu, Ping, et autres
Publié: (2025)

Diverse Preference Optimization
par: Lanchantin, Jack, et autres
Publié: (2025)

Adaptive Decoding via Latent Preference Optimization
par: Dhuliawala, Shehzaad, et autres
Publié: (2024)

Multi-Token Attention
par: Golovneva, Olga, et autres
Publié: (2025)

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
par: Sukhbaatar, Sainbayar, et autres
Publié: (2024)

Self-Improving Pretraining: using post-trained models to pretrain better models
par: Tan, Ellen Xiaoqing, et autres
Publié: (2026)

Distilling System 2 into System 1
par: Yu, Ping, et autres
Publié: (2024)

Following Length Constraints in Instructions
par: Yuan, Weizhe, et autres
Publié: (2024)

Iterative Label Refinement Matters More than Preference Optimization under Weak Supervision
par: Ye, Yaowen, et autres
Publié: (2025)

Reasoning over mathematical objects: on-policy reward modeling and test time aggregation
par: Aggarwal, Pranjal, et autres
Publié: (2026)

IndoPref: A Multi-Domain Pairwise Preference Dataset for Indonesian
par: Wiyono, Vanessa Rebecca, et autres
Publié: (2025)

System-Level Natural Language Feedback
par: Yuan, Weizhe, et autres
Publié: (2023)

Training Large Language Models to Reason in a Continuous Latent Space
par: Hao, Shibo, et autres
Publié: (2024)

Multilingual Encoder Knows more than You Realize: Shared Weights Pretraining for Extremely Low-Resource Languages
par: Su, Zeli, et autres
Publié: (2025)

Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators
par: Liu, Yinhong, et autres
Publié: (2024)

ORPO: Monolithic Preference Optimization without Reference Model
par: Hong, Jiwoo, et autres
Publié: (2024)

MobileIPL: Enhancing Mobile Agents Thinking Process via Iterative Preference Learning
par: Huang, Kun, et autres
Publié: (2025)

Multiplayer Nash Preference Optimization
par: Wu, Fang, et autres
Publié: (2025)

Self-supervised Preference Optimization: Enhance Your Language Model with Preference Degree Awareness
par: Li, Jian, et autres
Publié: (2024)

Learning to Plan & Reason for Evaluation with Thinking-LLM-as-a-Judge
par: Saha, Swarnadeep, et autres
Publié: (2025)

Enhancing Multilingual Counterfactual Generation through Alignment-as-Preference Optimization
par: Wang, Yilong, et autres
Publié: (2026)

SGPO: Self-Generated Preference Optimization based on Self-Improver
par: Lee, Hyeonji, et autres
Publié: (2025)

Creative Preference Optimization
par: Ismayilzada, Mete, et autres
Publié: (2025)

Retrieval-Augmented Fine-Tuning With Preference Optimization For Visual Program Generation
par: Kang, Deokhyung, et autres
Publié: (2025)

LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning
par: Zhang, Di, et autres
Publié: (2024)

Personalizing LLMs with Binary Feedback: A Preference-Corrected Optimization Framework
par: Ma, Xilai, et autres
Publié: (2026)

Hallucination Detection-Guided Preference Optimization for Clinical Summarization
par: Seethakantha, Shamanth Kuthpadi, et autres
Publié: (2026)

Preference Packing: Efficient Preference Optimization for Large Language Models
par: Cho, Jaekyung
Publié: (2026)

CAPO: Confidence Aware Preference Optimization Learning for Multilingual Preferences
par: Pokharel, Rhitabrat, et autres
Publié: (2025)

Geometric-Averaged Preference Optimization for Soft Preference Labels
par: Furuta, Hiroki, et autres
Publié: (2024)