A Reinforcement-Learning-Based Multiple-Column Selection Strategy for Column Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yuan, Haofeng, Fang, Lichang, Song, Shiji
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909162831609856
author Yuan, Haofeng
Fang, Lichang
Song, Shiji
author_facet Yuan, Haofeng
Fang, Lichang
Song, Shiji
contents Column generation (CG) is one of the most successful approaches for solving large-scale linear programming (LP) problems. Given an LP with a prohibitively large number of variables (i.e., columns), the idea of CG is to explicitly consider only a subset of columns and iteratively add potential columns to improve the objective value. While adding the column with the most negative reduced cost can guarantee the convergence of CG, it has been shown that adding multiple columns per iteration rather than a single column can lead to faster convergence. However, it remains a challenge to design a multiple-column selection strategy to select the most promising columns from a large number of candidate columns. In this paper, we propose a novel reinforcement-learning-based (RL) multiple-column selection strategy. To the best of our knowledge, it is the first RL-based multiple-column selection strategy for CG. The effectiveness of our approach is evaluated on two sets of problems: the cutting stock problem and the graph coloring problem. Compared to several widely used single-column and multiple-column selection strategies, our RL-based multiple-column selection strategy leads to faster convergence and achieves remarkable reductions in the number of CG iterations and runtime.
format Preprint
id arxiv_https___arxiv_org_abs_2312_14213
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A Reinforcement-Learning-Based Multiple-Column Selection Strategy for Column Generation
Yuan, Haofeng
Fang, Lichang
Song, Shiji
Optimization and Control
Machine Learning
Column generation (CG) is one of the most successful approaches for solving large-scale linear programming (LP) problems. Given an LP with a prohibitively large number of variables (i.e., columns), the idea of CG is to explicitly consider only a subset of columns and iteratively add potential columns to improve the objective value. While adding the column with the most negative reduced cost can guarantee the convergence of CG, it has been shown that adding multiple columns per iteration rather than a single column can lead to faster convergence. However, it remains a challenge to design a multiple-column selection strategy to select the most promising columns from a large number of candidate columns. In this paper, we propose a novel reinforcement-learning-based (RL) multiple-column selection strategy. To the best of our knowledge, it is the first RL-based multiple-column selection strategy for CG. The effectiveness of our approach is evaluated on two sets of problems: the cutting stock problem and the graph coloring problem. Compared to several widely used single-column and multiple-column selection strategies, our RL-based multiple-column selection strategy leads to faster convergence and achieves remarkable reductions in the number of CG iterations and runtime.
title A Reinforcement-Learning-Based Multiple-Column Selection Strategy for Column Generation
topic Optimization and Control
Machine Learning
url https://arxiv.org/abs/2312.14213