Copertina

Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Shanyong, Lin, Shuhang, Zhao, Yining, Zhu, Xi, Zhang, Yongfeng
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Cache Mechanism for Agent RAG Systems
di: Lin, Shuhang, et al.
Pubblicazione: (2025)

Entropy-Adaptive Fine-Tuning: Resolving Confident Conflicts to Mitigate Forgetting
di: Diao, Muxi, et al.
Pubblicazione: (2026)

LRHP: Learning Representations for Human Preferences via Preference Pairs
di: Wang, Chenglong, et al.
Pubblicazione: (2024)

OmniRouter: Budget and Performance Controllable Multi-LLM Routing
di: Mei, Kai, et al.
Pubblicazione: (2025)

TruthfulRAG: Resolving Factual-level Conflicts in Retrieval-Augmented Generation with Knowledge Graphs
di: Liu, Shuyi, et al.
Pubblicazione: (2025)

UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter-Efficient Fine-Tuning of Large Models
di: Zhang, Xueyan, et al.
Pubblicazione: (2025)

MVPBench: A Benchmark and Fine-Tuning Framework for Aligning Large Language Models with Diverse Human Values
di: Liang, Yao, et al.
Pubblicazione: (2025)

ReaGAN: Node-as-Agent-Reasoning Graph Agentic Network
di: Guo, Minghao, et al.
Pubblicazione: (2025)

MPO: An Efficient Post-Processing Framework for Mixing Diverse Preference Alignment
di: Wang, Tianze, et al.
Pubblicazione: (2025)

Triplets Better Than Pairs: Towards Stable and Effective Self-Play Fine-Tuning for LLMs
di: Wang, Yibo, et al.
Pubblicazione: (2026)

Resolving Knowledge Conflicts in Large Language Models
di: Wang, Yike, et al.
Pubblicazione: (2023)

DEFT: Distribution-guided Efficient Fine-Tuning for Human Alignment
di: Zhu, Liang, et al.
Pubblicazione: (2026)

SOLAR: Towards Characterizing Subjectivity of Individuals through Modeling Value Conflicts and Trade-offs
di: Lee, Younghun, et al.
Pubblicazione: (2025)

ConflictRAG: Detecting and Resolving Knowledge Conflicts in Retrieval Augmented Generation
di: Wang, Chenyu, et al.
Pubblicazione: (2026)

Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment
di: Zhang, Jianfei, et al.
Pubblicazione: (2024)

$λ$-GRPO: Unifying the GRPO Frameworks with Learnable Token Preferences
di: Wang, Yining, et al.
Pubblicazione: (2025)

Linear Alignment: A Closed-form Solution for Aligning Human Preferences without Tuning and Feedback
di: Gao, Songyang, et al.
Pubblicazione: (2024)

Align Generative Artificial Intelligence with Human Preferences: A Novel Large Language Model Fine-Tuning Method for Online Review Management
di: Wang, Yanan, et al.
Pubblicazione: (2026)

AlignSum: Data Pyramid Hierarchical Fine-tuning for Aligning with Human Summarization Preference
di: Han, Yang, et al.
Pubblicazione: (2024)

COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values
di: P Team, et al.
Pubblicazione: (2025)

Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training
di: Lai, Song, et al.
Pubblicazione: (2025)

Transitivity Meets Cyclicity: Explicit Preference Decomposition for Dynamic Large Language Model Alignment
di: Huang, Yucong, et al.
Pubblicazione: (2026)

Beyond Single-Reward: Multi-Pair, Multi-Perspective Preference Optimization for Machine Translation
di: Wang, Hao, et al.
Pubblicazione: (2025)

Preference-Oriented Supervised Fine-Tuning: Favoring Target Model Over Aligned Large Language Models
di: Fan, Yuchen, et al.
Pubblicazione: (2024)

ValueSim: Generating Backstories to Model Individual Value Systems
di: Du, Bangde, et al.
Pubblicazione: (2025)

Fine-Tuning LLMs with Fine-Grained Human Feedback on Text Spans
di: CH-Wang, Sky, et al.
Pubblicazione: (2025)

Dynamics of Instruction Fine-Tuning for Chinese Large Language Models
di: Song, Chiyu, et al.
Pubblicazione: (2023)

TuCo: Measuring the Contribution of Fine-Tuning to Individual Responses of LLMs
di: Nuti, Felipe, et al.
Pubblicazione: (2025)

Generalization to Political Beliefs from Fine-Tuning on Sports Team Preferences
di: Terry, Owen
Pubblicazione: (2026)

Retrieval-Augmented Fine-Tuning With Preference Optimization For Visual Program Generation
di: Kang, Deokhyung, et al.
Pubblicazione: (2025)

Can Language Models Reason about Individualistic Human Values and Preferences?
di: Jiang, Liwei, et al.
Pubblicazione: (2024)

SoRFT: Issue Resolving with Subtask-oriented Reinforced Fine-Tuning
di: Ma, Zexiong, et al.
Pubblicazione: (2025)

ConflictBench: Evaluating Human-AI Conflict via Interactive and Visually Grounded Environments
di: Zhao, Weixiang, et al.
Pubblicazione: (2026)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
di: Huang, Yining, et al.
Pubblicazione: (2025)

LoRA$^2$ : Multi-Scale Low-Rank Approximations for Fine-Tuning Large Language Models
di: Zhang, Jia-Chen, et al.
Pubblicazione: (2024)

Consensus or Conflict? Fine-Grained Evaluation of Conflicting Answers in Question-Answering
di: Nachshoni, Eviatar, et al.
Pubblicazione: (2025)

PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs
di: Zhang, Rongzhi, et al.
Pubblicazione: (2024)

Fine-Tuning Language Models for Ethical Ambiguity: A Comparative Study of Alignment with Human Responses
di: Senthilkumar, Pranav, et al.
Pubblicazione: (2024)

Natural Language Fine-Tuning
di: Liu, Jia, et al.
Pubblicazione: (2024)

Beyond QA Pairs: Assessing Parameter-Efficient Fine-Tuning for Fact Embedding in LLMs
di: Ratnakar, Shivam, et al.
Pubblicazione: (2025)