Saved in:
Bibliographic Details
Main Authors: Wang, Yang, Jia, Ya-Hui, Chen, Wei-Neng, Mei, Yi
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.06979
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916089979469824
author Wang, Yang
Jia, Ya-Hui
Chen, Wei-Neng
Mei, Yi
author_facet Wang, Yang
Jia, Ya-Hui
Chen, Wei-Neng
Mei, Yi
contents Neural solvers based on attention mechanism have demonstrated remarkable effectiveness in solving vehicle routing problems. However, in the generalization process from small scale to large scale, we find a phenomenon of the dispersion of attention scores in existing neural solvers, which leads to poor performance. To address this issue, this paper proposes a distance-aware attention reshaping method, assisting neural solvers in solving large-scale vehicle routing problems. Specifically, without the need for additional training, we utilize the Euclidean distance information between current nodes to adjust attention scores. This enables a neural solver trained on small-scale instances to make rational choices when solving a large-scale problem. Experimental results show that the proposed method significantly outperforms existing state-of-the-art neural solvers on the large-scale CVRPLib dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2401_06979
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Distance-aware Attention Reshaping: Enhance Generalization of Neural Solver for Large-scale Vehicle Routing Problems
Wang, Yang
Jia, Ya-Hui
Chen, Wei-Neng
Mei, Yi
Artificial Intelligence
Machine Learning
Neural solvers based on attention mechanism have demonstrated remarkable effectiveness in solving vehicle routing problems. However, in the generalization process from small scale to large scale, we find a phenomenon of the dispersion of attention scores in existing neural solvers, which leads to poor performance. To address this issue, this paper proposes a distance-aware attention reshaping method, assisting neural solvers in solving large-scale vehicle routing problems. Specifically, without the need for additional training, we utilize the Euclidean distance information between current nodes to adjust attention scores. This enables a neural solver trained on small-scale instances to make rational choices when solving a large-scale problem. Experimental results show that the proposed method significantly outperforms existing state-of-the-art neural solvers on the large-scale CVRPLib dataset.
title Distance-aware Attention Reshaping: Enhance Generalization of Neural Solver for Large-scale Vehicle Routing Problems
topic Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2401.06979