Online Resource Allocation with Non-Stationary Customers

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Xiaoyue, Qin, Hanzhang, Chou, Mabel C.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910466595356672
author Zhang, Xiaoyue
Qin, Hanzhang
Chou, Mabel C.
author_facet Zhang, Xiaoyue
Qin, Hanzhang
Chou, Mabel C.
contents We propose a novel algorithm for online resource allocation with non-stationary customer arrivals and unknown click-through rates. We assume multiple types of customers arrive in a nonstationary stochastic fashion, with unknown arrival rates in each period, and that customers' click-through rates are unknown and can only be learned online. By leveraging results from the stochastic contextual bandit with knapsack and online matching with adversarial arrivals, we develop an online scheme to allocate the resources to nonstationary customers. We prove that under mild conditions, our scheme achieves a ``best-of-both-world'' result: the scheme has a sublinear regret when the customer arrivals are near-stationary, and enjoys an optimal competitive ratio under general (non-stationary) customer arrival distributions. Finally, we conduct extensive numerical experiments to show our approach generates near-optimal revenues for all different customer scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2401_16945
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Online Resource Allocation with Non-Stationary Customers
Zhang, Xiaoyue
Qin, Hanzhang
Chou, Mabel C.
Machine Learning
Optimization and Control
We propose a novel algorithm for online resource allocation with non-stationary customer arrivals and unknown click-through rates. We assume multiple types of customers arrive in a nonstationary stochastic fashion, with unknown arrival rates in each period, and that customers' click-through rates are unknown and can only be learned online. By leveraging results from the stochastic contextual bandit with knapsack and online matching with adversarial arrivals, we develop an online scheme to allocate the resources to nonstationary customers. We prove that under mild conditions, our scheme achieves a ``best-of-both-world'' result: the scheme has a sublinear regret when the customer arrivals are near-stationary, and enjoys an optimal competitive ratio under general (non-stationary) customer arrival distributions. Finally, we conduct extensive numerical experiments to show our approach generates near-optimal revenues for all different customer scenarios.
title Online Resource Allocation with Non-Stationary Customers
topic Machine Learning
Optimization and Control
url https://arxiv.org/abs/2401.16945