Tight Generalization Bounds for Noiseless Inverse Optimization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Fatemi, Pouria, Maskan, Hoomaan, Sra, Suvrit, Esfahani, Peyman Mohajerin
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910205047996416
author Fatemi, Pouria
Maskan, Hoomaan
Sra, Suvrit
Esfahani, Peyman Mohajerin
author_facet Fatemi, Pouria
Maskan, Hoomaan
Sra, Suvrit
Esfahani, Peyman Mohajerin
contents Inverse optimization (IO) seeks to infer the parameters of a decision-maker's objective from observed context--action data. We study noiseless IO, where demonstrations are generated by a ground-truth objective. We provide a high-probability ${O}(\frac{d}{T})$ generalization bound for the induced action set, where $d$ is the number of unknown parameters and $T$ is the size of the training dataset. We strengthen these guarantees under additional conditions that ensure uniqueness of the chosen action, bringing our IO guarantees in line with best-arm identification results in the bandit literature. We further show that the ${O}(\frac{d}{T})$ rate is tight over all consistent estimators considered here, and extend the result to both instantaneous and cumulative regret. Notably, the resulting regret lower bound matches the corresponding upper bounds in the adversarial setting, indicating that the stochastic IO setting is effectively adversarial for the class of estimators studied here. Finally, we propose a parameter-free algorithm with lower per-iteration complexity than generic solvers. Experiments validate the predicted rates and illustrate the tightness of our bounds.
format Preprint
id arxiv_https___arxiv_org_abs_2605_08866
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Tight Generalization Bounds for Noiseless Inverse Optimization
Fatemi, Pouria
Maskan, Hoomaan
Sra, Suvrit
Esfahani, Peyman Mohajerin
Machine Learning
Optimization and Control
Inverse optimization (IO) seeks to infer the parameters of a decision-maker's objective from observed context--action data. We study noiseless IO, where demonstrations are generated by a ground-truth objective. We provide a high-probability ${O}(\frac{d}{T})$ generalization bound for the induced action set, where $d$ is the number of unknown parameters and $T$ is the size of the training dataset. We strengthen these guarantees under additional conditions that ensure uniqueness of the chosen action, bringing our IO guarantees in line with best-arm identification results in the bandit literature. We further show that the ${O}(\frac{d}{T})$ rate is tight over all consistent estimators considered here, and extend the result to both instantaneous and cumulative regret. Notably, the resulting regret lower bound matches the corresponding upper bounds in the adversarial setting, indicating that the stochastic IO setting is effectively adversarial for the class of estimators studied here. Finally, we propose a parameter-free algorithm with lower per-iteration complexity than generic solvers. Experiments validate the predicted rates and illustrate the tightness of our bounds.
title Tight Generalization Bounds for Noiseless Inverse Optimization
topic Machine Learning
Optimization and Control
url https://arxiv.org/abs/2605.08866