Saved in:
Bibliographic Details
Main Authors: Hu, Mingjie, Gao, Siyang, Hu, Jian-qiang, Zhou, Enlu
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.08779
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914463086542848
author Hu, Mingjie
Gao, Siyang
Hu, Jian-qiang
Zhou, Enlu
author_facet Hu, Mingjie
Gao, Siyang
Hu, Jian-qiang
Zhou, Enlu
contents Large language models (LLMs) have significant potential to improve operational efficiency in operations management. Deploying these models requires specifying a policy that governs response quality, shapes user experience, and influences operational value. In this research, we treat LLMs as stochastic simulators and propose a pairwise comparison-based adaptive simulation experiment framework for identifying the optimal policy from a finite set of candidates. We consider two policy spaces: an unstructured space with no parametric assumption, and a structured space in which the data are generated from a preference model. For both settings, we characterize the fundamental data requirements for identifying the optimal policy with high probability. In the unstructured case, we derive a closed-form expression for the optimal sampling proportions, together with a clear operational interpretation. In the structured case, we formulate a regularized convex program to compute the optimal proportions. We then develop an adaptive experimental procedure, termed LLM-PO, for both policy spaces, and prove that it identifies the optimal policy with the desired statistical guarantee while asymptotically attaining the fundamental data requirements. Numerical experiments demonstrate that LLM-PO consistently outperforms benchmark methods and improves LLM performance.
format Preprint
id arxiv_https___arxiv_org_abs_2604_08779
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Adaptive Simulation Experiment for LLM Policy Optimization
Hu, Mingjie
Gao, Siyang
Hu, Jian-qiang
Zhou, Enlu
Machine Learning
Large language models (LLMs) have significant potential to improve operational efficiency in operations management. Deploying these models requires specifying a policy that governs response quality, shapes user experience, and influences operational value. In this research, we treat LLMs as stochastic simulators and propose a pairwise comparison-based adaptive simulation experiment framework for identifying the optimal policy from a finite set of candidates. We consider two policy spaces: an unstructured space with no parametric assumption, and a structured space in which the data are generated from a preference model. For both settings, we characterize the fundamental data requirements for identifying the optimal policy with high probability. In the unstructured case, we derive a closed-form expression for the optimal sampling proportions, together with a clear operational interpretation. In the structured case, we formulate a regularized convex program to compute the optimal proportions. We then develop an adaptive experimental procedure, termed LLM-PO, for both policy spaces, and prove that it identifies the optimal policy with the desired statistical guarantee while asymptotically attaining the fundamental data requirements. Numerical experiments demonstrate that LLM-PO consistently outperforms benchmark methods and improves LLM performance.
title Adaptive Simulation Experiment for LLM Policy Optimization
topic Machine Learning
url https://arxiv.org/abs/2604.08779