Learning Joint Models of Prediction and Optimization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kotary, James, Di Vito, Vincenzo, Cristopher, Jacob, Van Hentenryck, Pascal, Fioretto, Ferdinando
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912018756272128
author Kotary, James
Di Vito, Vincenzo
Cristopher, Jacob
Van Hentenryck, Pascal
Fioretto, Ferdinando
author_facet Kotary, James
Di Vito, Vincenzo
Cristopher, Jacob
Van Hentenryck, Pascal
Fioretto, Ferdinando
contents The Predict-Then-Optimize framework uses machine learning models to predict unknown parameters of an optimization problem from exogenous features before solving. This setting is common to many real-world decision processes, and recently it has been shown that decision quality can be substantially improved by solving and differentiating the optimization problem within an end-to-end training loop. However, this approach requires significant computational effort in addition to handcrafted, problem-specific rules for backpropagation through the optimization step, challenging its applicability to a broad class of optimization problems. This paper proposes an alternative method, in which optimal solutions are learned directly from the observable features by joint predictive models. The approach is generic, and based on an adaptation of the Learning-to-Optimize paradigm, from which a rich variety of existing techniques can be employed. Experimental evaluations show the ability of several Learning-to-Optimize methods to provide efficient and accurate solutions to an array of challenging Predict-Then-Optimize problems.
format Preprint
id arxiv_https___arxiv_org_abs_2409_04898
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Joint Models of Prediction and Optimization
Kotary, James
Di Vito, Vincenzo
Cristopher, Jacob
Van Hentenryck, Pascal
Fioretto, Ferdinando
Machine Learning
The Predict-Then-Optimize framework uses machine learning models to predict unknown parameters of an optimization problem from exogenous features before solving. This setting is common to many real-world decision processes, and recently it has been shown that decision quality can be substantially improved by solving and differentiating the optimization problem within an end-to-end training loop. However, this approach requires significant computational effort in addition to handcrafted, problem-specific rules for backpropagation through the optimization step, challenging its applicability to a broad class of optimization problems. This paper proposes an alternative method, in which optimal solutions are learned directly from the observable features by joint predictive models. The approach is generic, and based on an adaptation of the Learning-to-Optimize paradigm, from which a rich variety of existing techniques can be employed. Experimental evaluations show the ability of several Learning-to-Optimize methods to provide efficient and accurate solutions to an array of challenging Predict-Then-Optimize problems.
title Learning Joint Models of Prediction and Optimization
topic Machine Learning
url https://arxiv.org/abs/2409.04898