Online Mixed Discrete and Continuous Optimization: Algorithms, Regret Analysis and Applications

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ye, Lintao, Chi, Ming, Liu, Zhi-Wei, Wang, Xiaoling, Gupta, Vijay
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913479453048832
author Ye, Lintao
Chi, Ming
Liu, Zhi-Wei
Wang, Xiaoling
Gupta, Vijay
author_facet Ye, Lintao
Chi, Ming
Liu, Zhi-Wei
Wang, Xiaoling
Gupta, Vijay
contents We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a continuous actions and then receives a reward associated with the chosen actions. The goal for the decision maker is to maximize the accumulative reward after $T$ rounds. We propose algorithms to solve the online mixed discrete and continuous optimization problem and prove that the algorithms yield sublinear regret in $T$. We show that a wide range of applications in practice fit into the framework of the online mixed discrete and continuous optimization problem, and apply the proposed algorithms to solve these applications with regret guarantees. We validate our theoretical results with numerical experiments.
format Preprint
id arxiv_https___arxiv_org_abs_2309_07630
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Online Mixed Discrete and Continuous Optimization: Algorithms, Regret Analysis and Applications
Ye, Lintao
Chi, Ming
Liu, Zhi-Wei
Wang, Xiaoling
Gupta, Vijay
Optimization and Control
We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a continuous actions and then receives a reward associated with the chosen actions. The goal for the decision maker is to maximize the accumulative reward after $T$ rounds. We propose algorithms to solve the online mixed discrete and continuous optimization problem and prove that the algorithms yield sublinear regret in $T$. We show that a wide range of applications in practice fit into the framework of the online mixed discrete and continuous optimization problem, and apply the proposed algorithms to solve these applications with regret guarantees. We validate our theoretical results with numerical experiments.
title Online Mixed Discrete and Continuous Optimization: Algorithms, Regret Analysis and Applications
topic Optimization and Control
url https://arxiv.org/abs/2309.07630