Copertina

Panacea: Pareto Alignment via Preference Adaptation for LLMs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhong, Yifan, Ma, Chengdong, Zhang, Xiaoyuan, Yang, Ziran, Chen, Haojun, Zhang, Qingfu, Qi, Siyuan, Yang, Yaodong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Amulet: ReAlignment During Test Time for Personalized Preference Adaptation of LLMs
di: Zhang, Zhaowei, et al.
Pubblicazione: (2025)

Magnetic Preference Optimization: Achieving Last-iterate Convergence for Language Model Alignment
di: Wang, Mingzhi, et al.
Pubblicazione: (2024)

Evolving Diverse Red-team Language Models in Multi-round Multi-agent Games
di: Ma, Chengdong, et al.
Pubblicazione: (2023)

Dealing with Structure Constraints in Evolutionary Pareto Set Learning
di: Lin, Xi, et al.
Pubblicazione: (2023)

In-Context Editing: Learning Knowledge from Self-Induced Distributions
di: Qi, Siyuan, et al.
Pubblicazione: (2024)

PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference
di: Ji, Jiaming, et al.
Pubblicazione: (2024)

PANDA: Preference Adaptation for Enhancing Domain-Specific Abilities of LLMs
di: Liu, An, et al.
Pubblicazione: (2024)

Efficient Model-agnostic Alignment via Bayesian Persuasion
di: Bai, Fengshuo, et al.
Pubblicazione: (2024)

Heterogeneous Value Alignment Evaluation for Large Language Models
di: Zhang, Zhaowei, et al.
Pubblicazione: (2023)

CATNIP: LLM Unlearning via Calibrated and Tokenized Negative Preference Alignment
di: Yang, Zhengbang, et al.
Pubblicazione: (2026)

Self-Improvement Towards Pareto Optimality: Mitigating Preference Conflicts in Multi-Objective Alignment
di: Li, Moxin, et al.
Pubblicazione: (2025)

Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answering
di: Zhang, Yichi, et al.
Pubblicazione: (2023)

Can LLMs Understand Unvoiced Speech? Exploring EMG-to-Text Conversion with LLMs
di: Mohapatra, Payal, et al.
Pubblicazione: (2025)

World Models Should Prioritize the Unification of Physical and Social Dynamics
di: Zhang, Xiaoyuan, et al.
Pubblicazione: (2025)

SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset
di: Dai, Josef, et al.
Pubblicazione: (2024)

PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding
di: Sun, Shengyin, et al.
Pubblicazione: (2026)

TokAlign++: Advancing Vocabulary Adaptation via Better Token Alignment
di: Li, Chong, et al.
Pubblicazione: (2026)

Evaluating and Aligning CodeLLMs on Human Preference
di: Yang, Jian, et al.
Pubblicazione: (2024)

LLMs Know More Than Words: A Genre Study with Syntax, Metaphor & Phonetics
di: Shi, Weiye, et al.
Pubblicazione: (2025)

Stream Aligner: Efficient Sentence-Level Alignment via Distribution Induction
di: Lou, Hantao, et al.
Pubblicazione: (2025)

Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards
di: Wang, Haoxiang, et al.
Pubblicazione: (2024)

Safety Alignment as Continual Learning: Mitigating the Alignment Tax via Orthogonal Gradient Projection
di: Sun, Guanglong, et al.
Pubblicazione: (2026)

Roadmap on Incentive Compatibility for AI Alignment and Governance in Sociotechnical Systems
di: Zhang, Zhaowei, et al.
Pubblicazione: (2024)

DecoupledESC: Enhancing Emotional Support Generation via Strategy-Response Decoupled Preference Optimization
di: Zhang, Chao, et al.
Pubblicazione: (2025)

UC-MOA: Utility-Conditioned Multi-Objective Alignment for Distributional Pareto-Optimality
di: Cheng, Zelei, et al.
Pubblicazione: (2025)

Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference Alignment
di: Yang, Wen, et al.
Pubblicazione: (2025)

PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization
di: Jiang, Han, et al.
Pubblicazione: (2025)

UMOEA/D: A Multiobjective Evolutionary Algorithm for Uniform Pareto Objectives based on Decomposition
di: Zhang, Xiaoyuan, et al.
Pubblicazione: (2024)

Does LLM Alignment Really Need Diversity? An Empirical Study of Adapting RLVR Methods for Moral Reasoning
di: Zhang, Zhaowei, et al.
Pubblicazione: (2026)

Self-supervised Attribute-aware Dynamic Preference Ranking Alignment
di: Yang, Hongyu, et al.
Pubblicazione: (2025)

Efficient Preference-based Reinforcement Learning via Aligned Experience Estimation
di: Bai, Fengshuo, et al.
Pubblicazione: (2024)

ProgressGym: Alignment with a Millennium of Moral Progress
di: Qiu, Tianyi, et al.
Pubblicazione: (2024)

PACIFIC: Can LLMs Discern the Traits Influencing Your Preferences? Evaluating Personality-Driven Preference Alignment in LLMs
di: Zhao, Tianyu, et al.
Pubblicazione: (2026)

Speech-Worthy Alignment for Japanese SpeechLLMs via Direct Preference Optimization
di: Zhao, Mengjie, et al.
Pubblicazione: (2026)

TokAlign: Efficient Vocabulary Adaptation via Token Alignment
di: Li, Chong, et al.
Pubblicazione: (2025)

Adversarial Preference Optimization: Enhancing Your Alignment via RM-LLM Game
di: Cheng, Pengyu, et al.
Pubblicazione: (2023)

ParetoHqD: Fast Offline Multiobjective Alignment of Large Language Models using Pareto High-quality Data
di: Gu, Haoran, et al.
Pubblicazione: (2025)

ReCUT: Balancing Reasoning Length and Accuracy in LLMs via Stepwise Trails and Preference Optimization
di: Jin, Zhensheng, et al.
Pubblicazione: (2025)

Mix-CPT: A Domain Adaptation Framework via Decoupling Knowledge Learning and Format Alignment
di: Jiang, Jinhao, et al.
Pubblicazione: (2024)

SAE-V: Interpreting Multimodal Models for Enhanced Alignment
di: Lou, Hantao, et al.
Pubblicazione: (2025)