Image de couverture de livre

PIPA: Preference Alignment as Prior-Informed Statistical Estimation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Junbo, Wang, Zhangyang, Liu, Qiang
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
par: Wang, Kevin, et autres
Publié: (2024)

Federated Variational Preference Alignment with Gumbel-Softmax Prior for Personalized User Preferences
par: Koo, Jabin, et autres
Publié: (2026)

Reward-Augmented Data Enhances Direct Preference Alignment of LLMs
par: Zhang, Shenao, et autres
Publié: (2024)

Adversarial Preference Learning for Robust LLM Alignment
par: Wang, Yuanfu, et autres
Publié: (2025)

Direct Alignment with Heterogeneous Preferences
par: Shirali, Ali, et autres
Publié: (2025)

Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
par: Zhou, Zhanhui, et autres
Publié: (2023)

ProteinOPD: Towards Effective and Efficient Preference Alignment for Protein Design
par: Zhang, Yulin, et autres
Publié: (2026)

Self-Exploring Language Models: Active Preference Elicitation for Online Alignment
par: Zhang, Shenao, et autres
Publié: (2024)

Property-driven Protein Inverse Folding With Multi-Objective Preference Alignment
par: Hou, Xiaoyang, et autres
Publié: (2026)

Position: Weight Space Should Be a First-Class Generative AI Modality
par: Wang, Zhangyang, et autres
Publié: (2026)

From Demonstrations to Rewards: Alignment Without Explicit Human Preferences
par: Zeng, Siliang, et autres
Publié: (2025)

Exploring Subnetwork Interactions in Heterogeneous Brain Network via Prior-Informed Graph Learning
par: Liu, Siyu, et autres
Publié: (2026)

Adaptive Helpfulness-Harmlessness Alignment with Preference Vectors
par: Liang, Ren-Wei, et autres
Publié: (2025)

Preference-Based Alignment of Discrete Diffusion Models
par: Borso, Umberto, et autres
Publié: (2025)

Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?
par: Gu, Zhuojun, et autres
Publié: (2025)

Refining Alignment Framework for Diffusion Models with Intermediate-Step Preference Ranking
par: Ren, Jie, et autres
Publié: (2025)

Preference Learning for AI Alignment: a Causal Perspective
par: Kobalczyk, Katarzyna, et autres
Publié: (2025)

Meta-Aligner: Bidirectional Preference-Policy Optimization for Multi-Objective LLMs Alignment
par: Xu, Wenzhe, et autres
Publié: (2026)

Encoding Temporal Statistical-space Priors via Augmented Representation
par: Choi, Insu, et autres
Publié: (2024)

Reflective Preference Optimization (RPO): Enhancing On-Policy Alignment via Hint-Guided Reflection
par: Zhao, Zihui, et autres
Publié: (2025)

Human Alignment of Large Language Models through Online Preference Optimisation
par: Calandriello, Daniele, et autres
Publié: (2024)

Meta-Statistical Learning: Supervised Learning of Statistical Estimators
par: Peyrard, Maxime, et autres
Publié: (2025)

Generalized Preference Optimization: A Unified Approach to Offline Alignment
par: Tang, Yunhao, et autres
Publié: (2024)

Sample Efficient Preference Alignment in LLMs via Active Exploration
par: Mehta, Viraj, et autres
Publié: (2023)

Preference Alignment for Diffusion Model via Explicit Denoised Distribution Estimation
par: Shi, Dingyuan, et autres
Publié: (2024)

Bridging the Gap Between Preference Alignment and Machine Unlearning
par: Feng, Xiaohua, et autres
Publié: (2025)

Teaching Your Models to Understand Code via Focal Preference Alignment
par: Wu, Jie, et autres
Publié: (2025)

Similarity as Reward Alignment: Robust and Versatile Preference-based Reinforcement Learning
par: Rajaram, Sara, et autres
Publié: (2025)

ActiveDPO: Active Direct Preference Optimization for Sample-Efficient Alignment
par: Lin, Xiaoqiang, et autres
Publié: (2025)

Robust LLM Alignment via Distributionally Robust Direct Preference Optimization
par: Xu, Zaiyan, et autres
Publié: (2025)

APPA: Adaptive Preference Pluralistic Alignment for Fair Federated RLHF of LLMs
par: Srewa, Mahmoud, et autres
Publié: (2026)

Junk DNA Hypothesis: Pruning Small Pre-Trained Weights Irreversibly and Monotonically Impairs "Difficult" Downstream Tasks in LLMs
par: Yin, Lu, et autres
Publié: (2023)

Larger or Smaller Reward Margins to Select Preferences for Alignment?
par: Huang, Kexin, et autres
Publié: (2025)

Data Distribution as a Lever for Guiding Optimizers Toward Superior Generalization in LLMs
par: Gangavarapu, Tushaar, et autres
Publié: (2026)

Spread Preference Annotation: Direct Preference Judgment for Efficient LLM Alignment
par: Kim, Dongyoung, et autres
Publié: (2024)

Guide: Generalized-Prior and Data Encoders for DAG Estimation
par: Roy, Amartya, et autres
Publié: (2025)

When Is Rank-1 Steering Cheap? Geometry, Granularity, and Budgeted Search
par: Robertson, John T., et autres
Publié: (2026)

Course-Correction: Safety Alignment Using Synthetic Preferences
par: Xu, Rongwu, et autres
Publié: (2024)

Neurosymbolic LoRA: Why and When to Tune Weights vs. Rewrite Prompts
par: Wang, Kevin, et autres
Publié: (2026)

GEM: Generative Entropy-Guided Preference Modeling for Few-shot Alignment of LLMs
par: Zhao, Yiyang, et autres
Publié: (2025)