A Two-Layer Framework for Joint Online Configuration Selection and Admission Control

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shen, Owen, Xu, Haoran, Ye, Yinyu, Glynn, Peter, Jaillet, Patrick
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911431378599936
author Shen, Owen
Xu, Haoran
Ye, Yinyu
Glynn, Peter
Jaillet, Patrick
author_facet Shen, Owen
Xu, Haoran
Ye, Yinyu
Glynn, Peter
Jaillet, Patrick
contents We study online configuration selection with admission control problem, which arises in LLM serving, GPU scheduling, and revenue management. In a planning horizon with $T$ periods, we consider a two-layer framework for the decisions made within each time period. In the first layer, the decision maker selects one of the $K$ configurations (ex. quantization, parallelism, fare class) which induces distribution over the reward-resource pair of the incoming request. In the second layer, the decision maker observes the request and then decides whether to accept it or not. Benchmarking this framework requires care. We introduce a \textbf{switching-aware fluid oracle} that accounts for the value of mixing configurations over time, provably upper-bounding any online policy. We derive a max-min formulation for evaluating the benchmark, and we characterize saddle points of the max-min problem via primal-dual optimality conditions linking equilibrium, feasibility, and complementarity. This guides the design of \textbf{SP-UCB--OLP} algorithm, which solves an optimistic saddle point problem and achieves $\tilde{O}(\sqrt{KT})$ regret.
format Preprint
id arxiv_https___arxiv_org_abs_2602_07663
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Two-Layer Framework for Joint Online Configuration Selection and Admission Control
Shen, Owen
Xu, Haoran
Ye, Yinyu
Glynn, Peter
Jaillet, Patrick
Optimization and Control
Data Structures and Algorithms
We study online configuration selection with admission control problem, which arises in LLM serving, GPU scheduling, and revenue management. In a planning horizon with $T$ periods, we consider a two-layer framework for the decisions made within each time period. In the first layer, the decision maker selects one of the $K$ configurations (ex. quantization, parallelism, fare class) which induces distribution over the reward-resource pair of the incoming request. In the second layer, the decision maker observes the request and then decides whether to accept it or not. Benchmarking this framework requires care. We introduce a \textbf{switching-aware fluid oracle} that accounts for the value of mixing configurations over time, provably upper-bounding any online policy. We derive a max-min formulation for evaluating the benchmark, and we characterize saddle points of the max-min problem via primal-dual optimality conditions linking equilibrium, feasibility, and complementarity. This guides the design of \textbf{SP-UCB--OLP} algorithm, which solves an optimistic saddle point problem and achieves $\tilde{O}(\sqrt{KT})$ regret.
title A Two-Layer Framework for Joint Online Configuration Selection and Admission Control
topic Optimization and Control
Data Structures and Algorithms
url https://arxiv.org/abs/2602.07663