Benchmarking PtO and PnO Methods in the Predictive Combinatorial Optimization Regime

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Geng, Haoyu, Ruan, Hang, Wang, Runzhong, Li, Yang, Wang, Yang, Chen, Lei, Yan, Junchi
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929598485233664
author Geng, Haoyu
Ruan, Hang
Wang, Runzhong
Li, Yang
Wang, Yang
Chen, Lei
Yan, Junchi
author_facet Geng, Haoyu
Ruan, Hang
Wang, Runzhong
Li, Yang
Wang, Yang
Chen, Lei
Yan, Junchi
contents Predictive combinatorial optimization, where the parameters of combinatorial optimization (CO) are unknown at the decision-making time, is the precise modeling of many real-world applications, including energy cost-aware scheduling and budget allocation on advertising. Tackling such a problem usually involves a prediction model and a CO solver. These two modules are integrated into the predictive CO pipeline following two design principles: "Predict-then-Optimize (PtO)", which learns predictions by supervised training and subsequently solves CO using predicted coefficients, while the other, named "Predict-and-Optimize (PnO)", directly optimizes towards the ultimate decision quality and claims to yield better decisions than traditional PtO approaches. However, there lacks a systematic benchmark of both approaches, including the specific design choices at the module level, as well as an evaluation dataset that covers representative real-world scenarios. To this end, we develop a modular framework to benchmark 11 existing PtO/PnO methods on 8 problems, including a new industrial dataset for combinatorial advertising that will be released. Our study shows that PnO approaches are better than PtO on 7 out of 8 benchmarks, but there is no silver bullet found for the specific design choices of PnO. A comprehensive categorization of current approaches and integration of typical scenarios are provided under a unified benchmark. Therefore, this paper could serve as a comprehensive benchmark for future PnO approach development and also offer fast prototyping for application-focused development. The code is available at https://github.com/Thinklab-SJTU/PredictiveCO-Benchmark.
format Preprint
id arxiv_https___arxiv_org_abs_2311_07633
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Benchmarking PtO and PnO Methods in the Predictive Combinatorial Optimization Regime
Geng, Haoyu
Ruan, Hang
Wang, Runzhong
Li, Yang
Wang, Yang
Chen, Lei
Yan, Junchi
Machine Learning
Artificial Intelligence
Optimization and Control
Predictive combinatorial optimization, where the parameters of combinatorial optimization (CO) are unknown at the decision-making time, is the precise modeling of many real-world applications, including energy cost-aware scheduling and budget allocation on advertising. Tackling such a problem usually involves a prediction model and a CO solver. These two modules are integrated into the predictive CO pipeline following two design principles: "Predict-then-Optimize (PtO)", which learns predictions by supervised training and subsequently solves CO using predicted coefficients, while the other, named "Predict-and-Optimize (PnO)", directly optimizes towards the ultimate decision quality and claims to yield better decisions than traditional PtO approaches. However, there lacks a systematic benchmark of both approaches, including the specific design choices at the module level, as well as an evaluation dataset that covers representative real-world scenarios. To this end, we develop a modular framework to benchmark 11 existing PtO/PnO methods on 8 problems, including a new industrial dataset for combinatorial advertising that will be released. Our study shows that PnO approaches are better than PtO on 7 out of 8 benchmarks, but there is no silver bullet found for the specific design choices of PnO. A comprehensive categorization of current approaches and integration of typical scenarios are provided under a unified benchmark. Therefore, this paper could serve as a comprehensive benchmark for future PnO approach development and also offer fast prototyping for application-focused development. The code is available at https://github.com/Thinklab-SJTU/PredictiveCO-Benchmark.
title Benchmarking PtO and PnO Methods in the Predictive Combinatorial Optimization Regime
topic Machine Learning
Artificial Intelligence
Optimization and Control
url https://arxiv.org/abs/2311.07633