Image de couverture de livre

SeaPO: Strategic Error Amplification for Robust Preference Optimization of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Rao, Jun, Liao, Yunjie, Liu, Xuebo, Lin, Zepeng, Lian, Lian, Jin, Dong, Cheng, Shengjun, Yu, Jun, Zhang, Min
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

CommonIT: Commonality-Aware Instruction Tuning for Large Language Models via Data Partitions
par: Rao, Jun, et autres
Publié: (2024)

APT: Improving Specialist LLM Performance with Weakness Case Acquisition and Iterative Preference Training
par: Rao, Jun, et autres
Publié: (2025)

Exploring and Enhancing the Transfer of Distribution in Knowledge Distillation for Autoregressive Language Models
par: Rao, Jun, et autres
Publié: (2024)

Dynamic Sampling that Adapts: Self-Aware Iterative Data Persistent Optimization for Mathematical Reasoning
par: Rao, Jun, et autres
Publié: (2025)

AdPO: Enhancing the Adversarial Robustness of Large Vision-Language Models with Preference Optimization
par: Liu, Chaohu, et autres
Publié: (2025)

DRPruning: Efficient Large Language Model Pruning through Distributionally Robust Optimization
par: Deng, Hexuan, et autres
Publié: (2024)

REA-RL: Reflection-Aware Online Reinforcement Learning for Efficient Reasoning
par: Deng, Hexuan, et autres
Publié: (2025)

AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMs
par: Ke, Xiaopeng, et autres
Publié: (2025)

Nezha‐SeaDart: A tail‐sitting fixed‐wing vertical takeoff and landing hybrid aerial underwater vehicle
par: Yufei Jin, et autres
Publié: (2024)

Improving Attributed Text Generation of Large Language Models via Preference Learning
par: Li, Dongfang, et autres
Publié: (2024)

MidPO: Dual Preference Optimization for Safety and Helpfulness in Large Language Models via a Mixture of Experts Framework
par: Qi, Yupeng, et autres
Publié: (2025)

FairPO: Robust Preference Optimization for Fair Multi-Label Learning
par: Mondal, Soumen Kumar, et autres
Publié: (2025)

FocalPO: Enhancing Preference Optimizing by Focusing on Correct Preference Rankings
par: Liu, Tong, et autres
Publié: (2025)

EmoPrefer: Can Large Language Models Understand Human Emotion Preferences?
par: Lian, Zheng, et autres
Publié: (2025)

RankPO: Preference Optimization for Job-Talent Matching
par: Zhang, Yafei, et autres
Publié: (2025)

PerPO: Perceptual Preference Optimization via Discriminative Rewarding
par: Zhu, Zining, et autres
Publié: (2025)

Evaluating and Steering Modality Preferences in Multimodal Large Language Model
par: Zhang, Yu, et autres
Publié: (2025)

ROPO: Robust Preference Optimization for Large Language Models
par: Liang, Xize, et autres
Publié: (2024)

Semantic and Structural Analysis of Implicit Biases in Large Language Models: An Interpretable Approach
par: Zhang, Renhan, et autres
Publié: (2025)

User Intent Understanding and Service Classification in English Tutoring Systems via Large Language Models Over Wireless Communication Networks
par: Hua Lian
Publié: (2025)

New insight into the N/Z and mass equilibration in heavy-ion collisions
par: Yang, Yu, et autres
Publié: (2024)

SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimization
par: Sun, Huashan, et autres
Publié: (2025)

DiffPO: Diffusion-styled Preference Optimization for Efficient Inference-Time Alignment of Large Language Models
par: Chen, Ruizhe, et autres
Publié: (2025)

Mechanism of the quasi-elastic scattering based on the dinuclear system concept
par: Liao, Zehong, et autres
Publié: (2025)

Shell effects on the drift and fluctuation in multinucleon transfer reactions
par: Liao, Zehong, et autres
Publié: (2024)

LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models
par: Zhu, Fengqi, et autres
Publié: (2025)

DynamicPO: Dynamic Preference Optimization for Recommendation
par: Hu, Xingyu, et autres
Publié: (2026)

PrefPO: Pairwise Preference Prompt Optimization
par: Singhal, Rahul, et autres
Publié: (2026)

ViPO: Visual Preference Optimization at Scale
par: Li, Ming, et autres
Publié: (2026)

DuPO: Enabling Reliable LLM Self-Verification via Dual Preference Optimization
par: She, Shuaijie, et autres
Publié: (2025)

SimPO: Simple Preference Optimization with a Reference-Free Reward
par: Meng, Yu, et autres
Publié: (2024)

Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models
par: Xiang, Hao, et autres
Publié: (2024)

AMaPO: Adaptive Margin-attached Preference Optimization for Language Model Alignment
par: Deng, Ruibo, et autres
Publié: (2025)

LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
par: Chen, Guanzheng, et autres
Publié: (2025)

Mitigating Error Amplification in Fast Adversarial Training
par: Zhao, Mengnan, et autres
Publié: (2026)

Bosonic Quantum Breakdown Hubbard Model
par: Hu, Yu-Min, et autres
Publié: (2024)

From the Quantum Breakdown Model to the Lattice Gauge Theory
par: Hu, Yu-Min, et autres
Publié: (2024)

CiPO: Counterfactual Unlearning for Large Reasoning Models through Iterative Preference Optimization
par: Li, Junyi, et autres
Publié: (2026)

InPO: Inversion Preference Optimization with Reparametrized DDIM for Efficient Diffusion Model Alignment
par: Lu, Yunhong, et autres
Publié: (2025)

Direct Preference Knowledge Distillation for Large Language Models
par: Li, Yixing, et autres
Publié: (2024)