Scalable Kernel Inverse Optimization

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Long, Youyuan, Ok, Tolga, Scroccaro, Pedro Zattoni, Esfahani, Peyman Mohajerin
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910679338844160
author Long, Youyuan
Ok, Tolga
Scroccaro, Pedro Zattoni
Esfahani, Peyman Mohajerin
author_facet Long, Youyuan
Ok, Tolga
Scroccaro, Pedro Zattoni
Esfahani, Peyman Mohajerin
contents Inverse Optimization (IO) is a framework for learning the unknown objective function of an expert decision-maker from a past dataset. In this paper, we extend the hypothesis class of IO objective functions to a reproducing kernel Hilbert space (RKHS), thereby enhancing feature representation to an infinite-dimensional space. We demonstrate that a variant of the representer theorem holds for a specific training loss, allowing the reformulation of the problem as a finite-dimensional convex optimization program. To address scalability issues commonly associated with kernel methods, we propose the Sequential Selection Optimization (SSO) algorithm to efficiently train the proposed Kernel Inverse Optimization (KIO) model. Finally, we validate the generalization capabilities of the proposed KIO model and the effectiveness of the SSO algorithm through learning-from-demonstration tasks on the MuJoCo benchmark.
format Preprint
id arxiv_https___arxiv_org_abs_2410_23952
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Scalable Kernel Inverse Optimization
Long, Youyuan
Ok, Tolga
Scroccaro, Pedro Zattoni
Esfahani, Peyman Mohajerin
Machine Learning
Systems and Control
Optimization and Control
Inverse Optimization (IO) is a framework for learning the unknown objective function of an expert decision-maker from a past dataset. In this paper, we extend the hypothesis class of IO objective functions to a reproducing kernel Hilbert space (RKHS), thereby enhancing feature representation to an infinite-dimensional space. We demonstrate that a variant of the representer theorem holds for a specific training loss, allowing the reformulation of the problem as a finite-dimensional convex optimization program. To address scalability issues commonly associated with kernel methods, we propose the Sequential Selection Optimization (SSO) algorithm to efficiently train the proposed Kernel Inverse Optimization (KIO) model. Finally, we validate the generalization capabilities of the proposed KIO model and the effectiveness of the SSO algorithm through learning-from-demonstration tasks on the MuJoCo benchmark.
title Scalable Kernel Inverse Optimization
topic Machine Learning
Systems and Control
Optimization and Control
url https://arxiv.org/abs/2410.23952