Solver-Free Decision-Focused Learning for Linear Optimization Problems

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Berden, Senne, Mahmutoğulları, Ali İrfan, Tsouros, Dimos, Guns, Tias
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909898952933376
author Berden, Senne
Mahmutoğulları, Ali İrfan
Tsouros, Dimos
Guns, Tias
author_facet Berden, Senne
Mahmutoğulları, Ali İrfan
Tsouros, Dimos
Guns, Tias
contents Mathematical optimization is a fundamental tool for decision-making in a wide range of applications. However, in many real-world scenarios, the parameters of the optimization problem are not known a priori and must be predicted from contextual features. This gives rise to predict-then-optimize problems, where a machine learning model predicts problem parameters that are then used to make decisions via optimization. A growing body of work on decision-focused learning (DFL) addresses this setting by training models specifically to produce predictions that maximize downstream decision quality, rather than accuracy. While effective, DFL is computationally expensive, because it requires solving the optimization problem with the predicted parameters at each loss evaluation. In this work, we address this computational bottleneck for linear optimization problems, a common class of problems in both DFL literature and real-world applications. We propose a solver-free training method that exploits the geometric structure of linear optimization to enable efficient training with minimal degradation in solution quality. Our method is based on the insight that a solution is optimal if and only if it achieves an objective value that is at least as good as that of its adjacent vertices on the feasible polytope. Building on this, our method compares the estimated quality of the ground-truth optimal solution with that of its precomputed adjacent vertices, and uses this as loss function. Experiments demonstrate that our method significantly reduces computational cost while maintaining high decision quality.
format Preprint
id arxiv_https___arxiv_org_abs_2505_22224
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Solver-Free Decision-Focused Learning for Linear Optimization Problems
Berden, Senne
Mahmutoğulları, Ali İrfan
Tsouros, Dimos
Guns, Tias
Machine Learning
Artificial Intelligence
Mathematical optimization is a fundamental tool for decision-making in a wide range of applications. However, in many real-world scenarios, the parameters of the optimization problem are not known a priori and must be predicted from contextual features. This gives rise to predict-then-optimize problems, where a machine learning model predicts problem parameters that are then used to make decisions via optimization. A growing body of work on decision-focused learning (DFL) addresses this setting by training models specifically to produce predictions that maximize downstream decision quality, rather than accuracy. While effective, DFL is computationally expensive, because it requires solving the optimization problem with the predicted parameters at each loss evaluation. In this work, we address this computational bottleneck for linear optimization problems, a common class of problems in both DFL literature and real-world applications. We propose a solver-free training method that exploits the geometric structure of linear optimization to enable efficient training with minimal degradation in solution quality. Our method is based on the insight that a solution is optimal if and only if it achieves an objective value that is at least as good as that of its adjacent vertices on the feasible polytope. Building on this, our method compares the estimated quality of the ground-truth optimal solution with that of its precomputed adjacent vertices, and uses this as loss function. Experiments demonstrate that our method significantly reduces computational cost while maintaining high decision quality.
title Solver-Free Decision-Focused Learning for Linear Optimization Problems
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2505.22224