Neural Algorithmic Reasoning for Combinatorial Optimisation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Georgiev, Dobrik, Numeroso, Danilo, Bacciu, Davide, Liò, Pietro
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916122856521728
author Georgiev, Dobrik
Numeroso, Danilo
Bacciu, Davide
Liò, Pietro
author_facet Georgiev, Dobrik
Numeroso, Danilo
Bacciu, Davide
Liò, Pietro
contents Solving NP-hard/complete combinatorial problems with neural networks is a challenging research area that aims to surpass classical approximate algorithms. The long-term objective is to outperform hand-designed heuristics for NP-hard/complete problems by learning to generate superior solutions solely from training data. Current neural-based methods for solving CO problems often overlook the inherent "algorithmic" nature of the problems. In contrast, heuristics designed for CO problems, e.g. TSP, frequently leverage well-established algorithms, such as those for finding the minimum spanning tree. In this paper, we propose leveraging recent advancements in neural algorithmic reasoning to improve the learning of CO problems. Specifically, we suggest pre-training our neural model on relevant algorithms before training it on CO instances. Our results demonstrate that by using this learning setup, we achieve superior performance compared to non-algorithmically informed deep learning models.
format Preprint
id arxiv_https___arxiv_org_abs_2306_06064
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Neural Algorithmic Reasoning for Combinatorial Optimisation
Georgiev, Dobrik
Numeroso, Danilo
Bacciu, Davide
Liò, Pietro
Neural and Evolutionary Computing
Machine Learning
Solving NP-hard/complete combinatorial problems with neural networks is a challenging research area that aims to surpass classical approximate algorithms. The long-term objective is to outperform hand-designed heuristics for NP-hard/complete problems by learning to generate superior solutions solely from training data. Current neural-based methods for solving CO problems often overlook the inherent "algorithmic" nature of the problems. In contrast, heuristics designed for CO problems, e.g. TSP, frequently leverage well-established algorithms, such as those for finding the minimum spanning tree. In this paper, we propose leveraging recent advancements in neural algorithmic reasoning to improve the learning of CO problems. Specifically, we suggest pre-training our neural model on relevant algorithms before training it on CO instances. Our results demonstrate that by using this learning setup, we achieve superior performance compared to non-algorithmically informed deep learning models.
title Neural Algorithmic Reasoning for Combinatorial Optimisation
topic Neural and Evolutionary Computing
Machine Learning
url https://arxiv.org/abs/2306.06064