Copertina

FlipGuard: Defending Preference Alignment against Update Regression with Constrained Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhu, Mingye, Liu, Yi, Wang, Quan, Guo, Junbo, Mao, Zhendong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

On-the-fly Preference Alignment via Principle-Guided Decoding
di: Zhu, Mingye, et al.
Pubblicazione: (2025)

Leveraging Importance Sampling to Detach Alignment Modules from Large Language Models
di: Liu, Yi, et al.
Pubblicazione: (2025)

Alignment-Enhanced Decoding:Defending via Token-Level Adaptive Refining of Probability Distributions
di: Liu, Quan, et al.
Pubblicazione: (2024)

Leveraging Robust Optimization for LLM Alignment under Distribution Shifts
di: Zhu, Mingye, et al.
Pubblicazione: (2025)

LIRE: listwise reward enhancement for preference alignment
di: Zhu, Mingye, et al.
Pubblicazione: (2024)

Relative Preference Optimization: Enhancing LLM Alignment through Contrasting Responses across Identical and Diverse Prompts
di: Yin, Yueqin, et al.
Pubblicazione: (2024)

SparseRM: A Lightweight Preference Modeling with Sparse Autoencoder
di: Liu, Dengcan, et al.
Pubblicazione: (2025)

Preference Ranking Optimization for Human Alignment
di: Song, Feifan, et al.
Pubblicazione: (2023)

Enhancing Multilingual Counterfactual Generation through Alignment-as-Preference Optimization
di: Wang, Yilong, et al.
Pubblicazione: (2026)

Defending LLMs against Jailbreaking Attacks via Backtranslation
di: Wang, Yihan, et al.
Pubblicazione: (2024)

Constrain Alignment with Sparse Autoencoders
di: Yin, Qingyu, et al.
Pubblicazione: (2024)

PA-RAG: RAG Alignment via Multi-Perspective Preference Optimization
di: Wu, Jiayi, et al.
Pubblicazione: (2024)

Enhancing Persona Following at Decoding Time via Dynamic Importance Estimation for Role-Playing Agents
di: Liu, Yuxin, et al.
Pubblicazione: (2026)

ICDPO: Effectively Borrowing Alignment Capability of Others via In-context Direct Preference Optimization
di: Song, Feifan, et al.
Pubblicazione: (2024)

Not All Preferences are What You Need for Post-Training: Selective Alignment Strategy for Preference Optimization
di: Dong, Zhijin
Pubblicazione: (2025)

Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment
di: Guo, Yiju, et al.
Pubblicazione: (2024)

ELDER: Enhancing Lifelong Model Editing with Mixture-of-LoRA
di: Li, Jiaang, et al.
Pubblicazione: (2024)

MACPO: Weak-to-Strong Alignment via Multi-Agent Contrastive Preference Optimization
di: Lyu, Yougang, et al.
Pubblicazione: (2024)

Prompt Optimization Is a Coin Flip: Diagnosing When It Helps in Compound AI Systems
di: Zhang, Xing, et al.
Pubblicazione: (2026)

ExpertPrompting: Instructing Large Language Models to be Distinguished Experts
di: Xu, Benfeng, et al.
Pubblicazione: (2023)

Automated Creativity Evaluation for Large Language Models: A Reference-Based Approach
di: Li, Ruizhe, et al.
Pubblicazione: (2025)

Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment
di: Zhang, Jianfei, et al.
Pubblicazione: (2024)

On the Role of Preference Variance in Preference Optimization
di: Guo, Jiacheng, et al.
Pubblicazione: (2025)

Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment
di: Wang, Jialu, et al.
Pubblicazione: (2026)

Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search
di: Cao, Zhiyu, et al.
Pubblicazione: (2026)

Accelerated Preference Optimization for Large Language Model Alignment
di: He, Jiafan, et al.
Pubblicazione: (2024)

Self-Play Preference Optimization for Language Model Alignment
di: Wu, Yue, et al.
Pubblicazione: (2024)

Is On-Policy Data always the Best Choice for Direct Preference Optimization-based LM Alignment?
di: Sun, Zetian, et al.
Pubblicazione: (2025)

DRAGON: Guard LLM Unlearning in Context via Negative Detection and Reasoning
di: Wang, Yaxuan, et al.
Pubblicazione: (2025)

Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models
di: Yi, Jingwei, et al.
Pubblicazione: (2023)

Word Alignment as Preference for Machine Translation
di: Wu, Qiyu, et al.
Pubblicazione: (2024)

Token-level Direct Preference Optimization
di: Zeng, Yongcheng, et al.
Pubblicazione: (2024)

RobustKV: Defending Large Language Models against Jailbreak Attacks via KV Eviction
di: Jiang, Tanqiu, et al.
Pubblicazione: (2024)

Stepwise Alignment for Constrained Language Model Policy Optimization
di: Wachi, Akifumi, et al.
Pubblicazione: (2024)

Preference-Aware Memory Update for Long-Term LLM Agents
di: Sun, Haoran, et al.
Pubblicazione: (2025)

TODO: Enhancing LLM Alignment with Ternary Preferences
di: Guo, Yuxiang, et al.
Pubblicazione: (2024)

MCP-AgentBench: Evaluating Real-World Language Agent Performance with MCP-Mediated Tools
di: Guo, Zikang, et al.
Pubblicazione: (2025)

Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding
di: Song, Feifan, et al.
Pubblicazione: (2025)

Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
di: D'Oosterlinck, Karel, et al.
Pubblicazione: (2024)

Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference Alignment
di: Yang, Wen, et al.
Pubblicazione: (2025)