Saved in:
Bibliographic Details
Main Author: Jia, Chen
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.12867
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911336803336192
author Jia, Chen
author_facet Jia, Chen
contents Bootstrapping large language models (LLMs) through preference-based policy optimization offers a promising direction for aligning model behavior with human preferences without relying on extensive manual annotations. In this work, we propose a novel preference-based policy optimization (PbPO) framework that formulates the learning process as a min-max game between the main policy and a reward model (RM). The RM is constrained within a confidence set derived from preference data to ensure reliable exploitation. Our iterative online algorithm actively collects preference data through guided exploration of the evolving policy, enabling continual self-improvement of both the policy and the RM. We provide theoretical guarantees for our method, establishing high-probability regret bounds for both settings with sequence-level RM and token-level RM, demonstrating its effectiveness in bootstrapping LLMs. Extensive experiments on five benchmarks show that our approach consistently outperforms existing state-of-the-art preference optimization techniques.
format Preprint
id arxiv_https___arxiv_org_abs_2511_12867
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bootstrapping LLMs via Preference-Based Policy Optimization
Jia, Chen
Artificial Intelligence
Machine Learning
Bootstrapping large language models (LLMs) through preference-based policy optimization offers a promising direction for aligning model behavior with human preferences without relying on extensive manual annotations. In this work, we propose a novel preference-based policy optimization (PbPO) framework that formulates the learning process as a min-max game between the main policy and a reward model (RM). The RM is constrained within a confidence set derived from preference data to ensure reliable exploitation. Our iterative online algorithm actively collects preference data through guided exploration of the evolving policy, enabling continual self-improvement of both the policy and the RM. We provide theoretical guarantees for our method, establishing high-probability regret bounds for both settings with sequence-level RM and token-level RM, demonstrating its effectiveness in bootstrapping LLMs. Extensive experiments on five benchmarks show that our approach consistently outperforms existing state-of-the-art preference optimization techniques.
title Bootstrapping LLMs via Preference-Based Policy Optimization
topic Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2511.12867