Saved in:
Bibliographic Details
Main Authors: Meng, Dian, Cao, Zhiguang, Wu, Yaoxin, Hou, Yaqing, Ge, Hongwei, Zhang, Qiang
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.16428
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911014867435520
author Meng, Dian
Cao, Zhiguang
Wu, Yaoxin
Hou, Yaqing
Ge, Hongwei
Zhang, Qiang
author_facet Meng, Dian
Cao, Zhiguang
Wu, Yaoxin
Hou, Yaqing
Ge, Hongwei
Zhang, Qiang
contents Recent neural heuristics for the Vehicle Routing Problem (VRP) primarily rely on node coordinates as input, which may be less effective in practical scenarios where real cost metrics-such as edge-based distances-are more relevant. To address this limitation, we introduce EFormer, an Edge-based Transformer model that uses edge as the sole input for VRPs. Our approach employs a precoder module with a mixed-score attention mechanism to convert edge information into temporary node embeddings. We also present a parallel encoding strategy characterized by a graph encoder and a node encoder, each responsible for processing graph and node embeddings in distinct feature spaces, respectively. This design yields a more comprehensive representation of the global relationships among edges. In the decoding phase, parallel context embedding and multi-query integration are used to compute separate attention mechanisms over the two encoded embeddings, facilitating efficient path construction. We train EFormer using reinforcement learning in an autoregressive manner. Extensive experiments on the Traveling Salesman Problem (TSP) and Capacitated Vehicle Routing Problem (CVRP) reveal that EFormer outperforms established baselines on synthetic datasets, including large-scale and diverse distributions. Moreover, EFormer demonstrates strong generalization on real-world instances from TSPLib and CVRPLib. These findings confirm the effectiveness of EFormer's core design in solving VRPs.
format Preprint
id arxiv_https___arxiv_org_abs_2506_16428
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EFormer: An Effective Edge-based Transformer for Vehicle Routing Problems
Meng, Dian
Cao, Zhiguang
Wu, Yaoxin
Hou, Yaqing
Ge, Hongwei
Zhang, Qiang
Machine Learning
Recent neural heuristics for the Vehicle Routing Problem (VRP) primarily rely on node coordinates as input, which may be less effective in practical scenarios where real cost metrics-such as edge-based distances-are more relevant. To address this limitation, we introduce EFormer, an Edge-based Transformer model that uses edge as the sole input for VRPs. Our approach employs a precoder module with a mixed-score attention mechanism to convert edge information into temporary node embeddings. We also present a parallel encoding strategy characterized by a graph encoder and a node encoder, each responsible for processing graph and node embeddings in distinct feature spaces, respectively. This design yields a more comprehensive representation of the global relationships among edges. In the decoding phase, parallel context embedding and multi-query integration are used to compute separate attention mechanisms over the two encoded embeddings, facilitating efficient path construction. We train EFormer using reinforcement learning in an autoregressive manner. Extensive experiments on the Traveling Salesman Problem (TSP) and Capacitated Vehicle Routing Problem (CVRP) reveal that EFormer outperforms established baselines on synthetic datasets, including large-scale and diverse distributions. Moreover, EFormer demonstrates strong generalization on real-world instances from TSPLib and CVRPLib. These findings confirm the effectiveness of EFormer's core design in solving VRPs.
title EFormer: An Effective Edge-based Transformer for Vehicle Routing Problems
topic Machine Learning
url https://arxiv.org/abs/2506.16428