Copertina

Beyond Compromise: Pareto-Lenient Consensus for Efficient Multi-Preference LLM Alignment

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Tan, Renxuan, Li, Rongpeng, Zhao, Zhifeng, Zhang, Honggang
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LLM-Empowered Agentic MAC Protocols: A Dynamic Stackelberg Game Approach
di: Tan, Renxuan, et al.
Pubblicazione: (2025)

Pareto Actor-Critic for Communication and Computation Co-Optimization in Non-Cooperative Federated Learning Services
di: Tan, Renxuan, et al.
Pubblicazione: (2025)

Decentralized Consensus Inference-based Hierarchical Reinforcement Learning for Multi-Constrained UAV Pursuit-Evasion Game
di: Yuming, Xiang, et al.
Pubblicazione: (2025)

Tool-Aided Evolutionary LLM for Generative Policy Toward Efficient Resource Management in Wireless Federated Learning
di: Tan, Chongyang, et al.
Pubblicazione: (2025)

LLM4MAC: An LLM-Driven Reinforcement Learning Framework for MAC Protocol Emergence
di: Tan, Renxuan, et al.
Pubblicazione: (2025)

Adaptive Layer Splitting for Wireless LLM Inference in Edge Computing: A Model-Based Reinforcement Learning Approach
di: Chen, Yuxuan, et al.
Pubblicazione: (2024)

Topology-Assisted Spatio-Temporal Pattern Disentangling for Scalable MARL in Large-scale Autonomous Traffic Control
di: Li, Rongpeng, et al.
Pubblicazione: (2025)

AirLLM: Diffusion Policy-based Adaptive LoRA for Remote Fine-Tuning of LLM over the Air
di: Yang, Shiyi, et al.
Pubblicazione: (2025)

RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms
di: Wang, Ziyao, et al.
Pubblicazione: (2025)

Snake Learning: A Communication- and Computation-Efficient Distributed Learning Framework for 6G
di: Yu, Xiaoxue, et al.
Pubblicazione: (2024)

Select2Col: Leveraging Spatial-Temporal Importance of Semantic Information for Efficient Collaborative Perception
di: Liu, Yuntao, et al.
Pubblicazione: (2023)

Beyond Preferences in AI Alignment
di: Zhi-Xuan, Tan, et al.
Pubblicazione: (2024)

Noise Distribution Decomposition based Multi-Agent Distributional Reinforcement Learning
di: Geng, Wei, et al.
Pubblicazione: (2023)

MERLOT: A Distilled LLM-based Mixture-of-Experts Framework for Scalable Encrypted Traffic Classification
di: Chen, Yuxuan, et al.
Pubblicazione: (2024)

Reinforcement Learning-Based Heterogeneous Multi-Task Optimization in Semantic Broadcast Communications
di: Lu, Zhilin, et al.
Pubblicazione: (2025)

Multi-Agent Conditional Diffusion Model with Mean Field Communication as Wireless Resource Allocation Planner
di: Meng, Kechen, et al.
Pubblicazione: (2025)

Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
di: Zhou, Zhanhui, et al.
Pubblicazione: (2023)

Unified Preference Optimization: Language Model Alignment Beyond the Preference Frontier
di: Badrinath, Anirudhan, et al.
Pubblicazione: (2024)

Spread Preference Annotation: Direct Preference Judgment for Efficient LLM Alignment
di: Kim, Dongyoung, et al.
Pubblicazione: (2024)

Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment
di: Zhang, Jianfei, et al.
Pubblicazione: (2024)

Pareto Multi-Objective Alignment for Language Models
di: He, Qiang, et al.
Pubblicazione: (2025)

Retrieval-Feedback-Driven Distillation and Preference Alignment for Efficient LLM-based Query Expansion
di: Li, Minghan, et al.
Pubblicazione: (2026)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
di: Shin, Hyunjune, et al.
Pubblicazione: (2024)

Not All Preferences Are Created Equal: Stability-Aware and Gradient-Efficient Alignment for Reasoning Models
di: Wu, Hui, et al.
Pubblicazione: (2026)

Evolutionary Preference Sampling for Pareto Set Learning
di: Ye, Rongguang, et al.
Pubblicazione: (2024)

Adversarial Preference Learning for Robust LLM Alignment
di: Wang, Yuanfu, et al.
Pubblicazione: (2025)

Pareto-Optimal Learning from Preferences with Hidden Context
di: Bahlous-Boldi, Ryan, et al.
Pubblicazione: (2024)

UC-MOA: Utility-Conditioned Multi-Objective Alignment for Distributional Pareto-Optimality
di: Cheng, Zelei, et al.
Pubblicazione: (2025)

Beyond Consensus: Mitigating the Agreeableness Bias in LLM Judge Evaluations
di: Jain, Suryaansh, et al.
Pubblicazione: (2025)

Beyond Single-Point Judgment: Distribution Alignment for LLM-as-a-Judge
di: Chen, Luyu, et al.
Pubblicazione: (2025)

Communications-Incentivized Collaborative Reasoning in NetGPT through Agentic Reinforcement Learning
di: Yu, Xiaoxue, et al.
Pubblicazione: (2026)

Topology Data Analysis-based Error Detection for Semantic Image Transmission with Incremental Knowledge-based HARQ
di: Ni, Fei, et al.
Pubblicazione: (2024)

Beyond Ordinal Preferences: Why Alignment Needs Cardinal Human Feedback
di: Whitfill, Parker, et al.
Pubblicazione: (2025)

TODO: Enhancing LLM Alignment with Ternary Preferences
di: Guo, Yuxiang, et al.
Pubblicazione: (2024)

The Geometry of Compromise: Unlocking Generative Capabilities via Controllable Modality Alignment
di: Liu, Hongyuan, et al.
Pubblicazione: (2026)

HPS: Hard Preference Sampling for Human Preference Alignment
di: Zou, Xiandong, et al.
Pubblicazione: (2025)

Pareto Continual Learning: Preference-Conditioned Learning and Adaption for Dynamic Stability-Plasticity Trade-off
di: Lai, Song, et al.
Pubblicazione: (2025)

ProteinOPD: Towards Effective and Efficient Preference Alignment for Protein Design
di: Zhang, Yulin, et al.
Pubblicazione: (2026)

NetWorld: Communication-Based Diffusion World Model for Multi-Agent Reinforcement Learning in Wireless Networks
di: Meng, Kechen, et al.
Pubblicazione: (2026)

Beyond Under-Alignment: Atomic Preference Enhanced Factuality Tuning for Large Language Models
di: Yuan, Hongbang, et al.
Pubblicazione: (2024)