Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lu, Yongfan, Di, Zixiang, Li, Bingdong, Liu, Shengcai, Qian, Hong, Yang, Peng, Tang, Ke, Zhou, Aimin
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917902920187904
author Lu, Yongfan
Di, Zixiang
Li, Bingdong
Liu, Shengcai
Qian, Hong
Yang, Peng
Tang, Ke
Zhou, Aimin
author_facet Lu, Yongfan
Di, Zixiang
Li, Bingdong
Liu, Shengcai
Qian, Hong
Yang, Peng
Tang, Ke
Zhou, Aimin
contents Multi-objective combinatorial optimization (MOCO) problems are prevalent in various real-world applications. Most existing neural MOCO methods rely on problem decomposition to transform an MOCO problem into a series of singe-objective combinatorial optimization (SOCO) problems and train attention models based on a single-step and deterministic greedy rollout. However, inappropriate decomposition and undesirable short-sighted behaviors of previous methods tend to induce a decline in diversity. To address the above limitation, we design a Context-aware Diversity Enhancement algorithm named CDE, which casts the neural MOCO problems as conditional sequence modeling via autoregression (node-level context awareness) and establishes a direct relationship between the mapping of preferences and diversity indicator of reward based on hypervolume expectation maximization (solution-level context awareness). Based on the solution-level context awareness, we further propose a hypervolume residual update strategy to enable the Pareto attention model to capture both local and non-local information of the Pareto set/front. The proposed CDE can effectively and efficiently grasp the context information, resulting in diversity enhancement. Experimental results on three classic MOCO problems demonstrate that our CDE outperforms several state-of-the-art baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2405_08604
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization
Lu, Yongfan
Di, Zixiang
Li, Bingdong
Liu, Shengcai
Qian, Hong
Yang, Peng
Tang, Ke
Zhou, Aimin
Machine Learning
Artificial Intelligence
Multi-objective combinatorial optimization (MOCO) problems are prevalent in various real-world applications. Most existing neural MOCO methods rely on problem decomposition to transform an MOCO problem into a series of singe-objective combinatorial optimization (SOCO) problems and train attention models based on a single-step and deterministic greedy rollout. However, inappropriate decomposition and undesirable short-sighted behaviors of previous methods tend to induce a decline in diversity. To address the above limitation, we design a Context-aware Diversity Enhancement algorithm named CDE, which casts the neural MOCO problems as conditional sequence modeling via autoregression (node-level context awareness) and establishes a direct relationship between the mapping of preferences and diversity indicator of reward based on hypervolume expectation maximization (solution-level context awareness). Based on the solution-level context awareness, we further propose a hypervolume residual update strategy to enable the Pareto attention model to capture both local and non-local information of the Pareto set/front. The proposed CDE can effectively and efficiently grasp the context information, resulting in diversity enhancement. Experimental results on three classic MOCO problems demonstrate that our CDE outperforms several state-of-the-art baselines.
title Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2405.08604