Image de couverture de livre

Adaptive Batch-Wise Sample Scheduling for Direct Preference Optimization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Huang, Zixuan, Ban, Yikun, Fu, Lean, Li, Xiaojie, Dai, Zhongxiang, Li, Jianxin, Wang, Deqing
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

ActiveDPO: Active Direct Preference Optimization for Sample-Efficient Alignment
par: Lin, Xiaoqiang, et autres
Publié: (2025)

FedPOB: Sample-Efficient Federated Prompt Optimization via Bandits
par: Lu, Pingchen, et autres
Publié: (2025)

T-POP: Test-Time Personalization with Online Preference Feedback
par: Qu, Zikun, et autres
Publié: (2025)

Policy Improvement Reinforcement Learning
par: Wang, Huaiyang, et autres
Publié: (2026)

Refining Adaptive Zeroth-Order Optimization at Ease
par: Shu, Yao, et autres
Publié: (2025)

Neural Dueling Bandits: Preference-Based Optimization with Human Feedback
par: Verma, Arun, et autres
Publié: (2024)

LLMBoost: Make Large Language Models Stronger with Boosting
par: Chen, Zehao, et autres
Publié: (2025)

Preference as Reward, Maximum Preference Optimization with Importance Sampling
par: Jiang, Zaifan, et autres
Publié: (2023)

Adaptive Defense against Harmful Fine-Tuning for Large Language Models via Bayesian Data Scheduler
par: Hu, Zixuan, et autres
Publié: (2025)

ADPO: Anchored Direct Preference Optimization
par: Zixian, Wang
Publié: (2025)

AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
par: Wu, Junkang, et autres
Publié: (2024)

Contextual Rollout Bandits for Reinforcement Learning with Verifiable Rewards
par: Lu, Xiaodong, et autres
Publié: (2026)

Risk-aware Direct Preference Optimization under Nested Risk Measure
par: Zhang, Lijun, et autres
Publié: (2025)

Real-Time Aligned Reward Model beyond Semantics
par: Huang, Zixuan, et autres
Publié: (2026)

Sample-Efficiency in Multi-Batch Reinforcement Learning: The Need for Dimension-Dependent Adaptivity
par: Johnson, Emmeran, et autres
Publié: (2023)

Continuous-Utility Direct Preference Optimization
par: Mohsin, Muhammad Ahmed, et autres
Publié: (2026)

Batch Bayesian Active Learning with Partial Batch Label Sampling
par: Hu, Kangping, et autres
Publié: (2025)

$β$-DPO: Direct Preference Optimization with Dynamic $β$
par: Wu, Junkang, et autres
Publié: (2024)

Beyond Training: Optimizing Reinforcement Learning Based Job Shop Scheduling Through Adaptive Action Sampling
par: de Puiseau, Constantin Waubert, et autres
Publié: (2024)

Aligning CodeLLMs with Direct Preference Optimization
par: Miao, Yibo, et autres
Publié: (2024)

Trust the Batch, On- or Off-Policy: Adaptive Policy Optimization for RL Post-Training
par: Fakoor, Rasool, et autres
Publié: (2026)

Filtered Direct Preference Optimization
par: Morimura, Tetsuro, et autres
Publié: (2024)

Direct Preference Optimization with an Offset
par: Amini, Afra, et autres
Publié: (2024)

Orthogonal Finetuning for Direct Preference Optimization
par: Yang, Chenxu, et autres
Publié: (2024)

Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
par: Zhou, Zhanhui, et autres
Publié: (2023)

Beyond State-Wise Mirror Descent: Offline Policy Optimization with Parametric Policies
par: Li, Xiang, et autres
Publié: (2026)

Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing
par: Qi, Biqing, et autres
Publié: (2024)

BOTS: Batch Bayesian Optimization of Extended Thompson Sampling for Severely Episode-Limited RL Settings
par: Karine, Karine, et autres
Publié: (2024)

KL Penalty Control via Perturbation for Direct Preference Optimization
par: Lee, Sangkyu, et autres
Publié: (2025)

MDPO: Multi-Granularity Direct Preference Optimization for Mathematical Reasoning
par: Lin, Yunze
Publié: (2025)

C2-DPO: Constrained Controlled Direct Preference Optimization
par: Asadi, Kavosh, et autres
Publié: (2025)

AMoPO: Adaptive Multi-objective Preference Optimization without Reward Models and Reference Models
par: Liu, Qi, et autres
Publié: (2025)

MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples
par: Xie, Shuo, et autres
Publié: (2024)

Entropy Controllable Direct Preference Optimization
par: Omura, Motoki, et autres
Publié: (2024)

Prompt Optimization with Human Feedback
par: Lin, Xiaoqiang, et autres
Publié: (2024)

On the Role of Preference Variance in Preference Optimization
par: Guo, Jiacheng, et autres
Publié: (2025)

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler
par: Shen, Yikang, et autres
Publié: (2024)

Directly Aligning the Full Diffusion Trajectory with Fine-Grained Human Preference
par: Shen, Xiangwei, et autres
Publié: (2025)

Batch Active Learning of Reward Functions from Human Preferences
par: Bıyık, Erdem, et autres
Publié: (2024)

HiPO: Hierarchical Preference Optimization for Adaptive Reasoning in LLMs
par: Kachroo, Darsh, et autres
Publié: (2026)