Imagen de Portada

Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Agnihotri, Akhil, Jain, Rahul, Ramachandran, Deepak, Wen, Zheng
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Online Bandit Learning with Offline Preference Data for Improved RLHF
por: Agnihotri, Akhil, et al.
Publicado: (2024)

Best Policy Learning from Trajectory Preference Feedback
por: Agnihotri, Akhil, et al.
Publicado: (2025)

Multi-Objective Reward and Preference Optimization: Theory and Algorithms
por: Agnihotri, Akhil
Publicado: (2025)

e-COP : Episodic Constrained Optimization of Policies
por: Agnihotri, Akhil, et al.
Publicado: (2024)

ACPO: A Policy Optimization Algorithm for Average MDPs with Constraints
por: Agnihotri, Akhil, et al.
Publicado: (2023)

Robust LLM Alignment via Distributionally Robust Direct Preference Optimization
por: Xu, Zaiyan, et al.
Publicado: (2025)

Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
por: Zhou, Zhanhui, et al.
Publicado: (2023)

Meta-Aligner: Bidirectional Preference-Policy Optimization for Multi-Objective LLMs Alignment
por: Xu, Wenzhe, et al.
Publicado: (2026)

Robust Multi-Objective Preference Alignment with Online DPO
por: Gupta, Raghav, et al.
Publicado: (2025)

Pareto Merging: Multi-Objective Optimization for Preference-Aware Model Merging
por: Chen, Weiyu, et al.
Publicado: (2024)

Multi-Objective $\textit{min-max}$ Online Convex Optimization
por: Vaze, Rahul, et al.
Publicado: (2025)

Property-driven Protein Inverse Folding With Multi-Objective Preference Alignment
por: Hou, Xiaoyang, et al.
Publicado: (2026)

MOSS: Multi-Objective Optimization for Stable Rule Sets
por: Liu, Brian, et al.
Publicado: (2025)

Hindsight Preference Replay Improves Preference-Conditioned Multi-Objective Reinforcement Learning
por: Shianifar, Jonaid, et al.
Publicado: (2026)

Preference-Guided Diffusion for Multi-Objective Offline Optimization
por: Annadani, Yashas, et al.
Publicado: (2025)

MODULI: Unlocking Preference Generalization via Diffusion Models for Offline Multi-Objective Reinforcement Learning
por: Yuan, Yifu, et al.
Publicado: (2024)

PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Model
por: Lin, Baijiong, et al.
Publicado: (2025)

Latent Embedding Adaptation for Human Preference Alignment in Diffusion Planners
por: Ng, Wen Zheng Terence, et al.
Publicado: (2025)

User Preference Meets Pareto-Optimality in Multi-Objective Bayesian Optimization
por: Ip, Joshua Hang Sai, et al.
Publicado: (2025)

Decoding Human Preferences in Alignment: An Improved Approach to Inverse Constitutional AI
por: Henneking, Carl-Leander, et al.
Publicado: (2025)

Mixture-Model Preference Learning for Many-Objective Bayesian Optimization
por: Dubey, Manisha, et al.
Publicado: (2026)

Improving LLM Safety Alignment with Dual-Objective Optimization
por: Zhao, Xuandong, et al.
Publicado: (2025)

Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards
por: Wang, Haoxiang, et al.
Publicado: (2024)

Self-Improvement Towards Pareto Optimality: Mitigating Preference Conflicts in Multi-Objective Alignment
por: Li, Moxin, et al.
Publicado: (2025)

Generalized Preference Optimization: A Unified Approach to Offline Alignment
por: Tang, Yunhao, et al.
Publicado: (2024)

SAHOO: Safeguarded Alignment for High-Order Optimization Objectives in Recursive Self-Improvement
por: Sahoo, Subramanyam, et al.
Publicado: (2026)

Meta-Learning Objectives for Preference Optimization
por: Alfano, Carlo, et al.
Publicado: (2024)

Preference-based Multi-Objective Reinforcement Learning
por: Mu, Ni, et al.
Publicado: (2025)

Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learning
por: Giovanelli, Joseph, et al.
Publicado: (2023)

Data-Centric Human Preference with Rationales for Direct Preference Alignment
por: Just, Hoang Anh, et al.
Publicado: (2024)

Adaptive Alignment: Dynamic Preference Adjustments via Multi-Objective Reinforcement Learning for Pluralistic AI
por: Harland, Hadassah, et al.
Publicado: (2024)

Amortized Multi-Objective Optimization Across Tasks with Generative Solution Modeling
por: Wei, Tingyang, et al.
Publicado: (2025)

Uncovering Cross-Objective Interference in Multi-Objective Alignment
por: Lu, Yining, et al.
Publicado: (2026)

Learning to Optimize Multi-Objective Alignment Through Dynamic Reward Weighting
por: Lu, Yining, et al.
Publicado: (2025)

Multi-Objective Alignment of Language Models for Personalized Psychotherapy
por: Beikzadeh, Mehrab, et al.
Publicado: (2026)

Human Alignment of Large Language Models through Online Preference Optimisation
por: Calandriello, Daniele, et al.
Publicado: (2024)

Multi-Objective Alignment of Large Language Models Through Hypervolume Maximization
por: Mukherjee, Subhojyoti, et al.
Publicado: (2024)

Pareto Multi-Objective Alignment for Language Models
por: He, Qiang, et al.
Publicado: (2025)

Multi-Preference Optimization: Generalizing DPO via Set-Level Contrasts
por: Gupta, Taneesh, et al.
Publicado: (2024)

Multi-Objective Latent Space Optimization of Generative Molecular Design Models
por: Abeer, A N M Nafiz, et al.
Publicado: (2022)