Enregistré dans:
Détails bibliographiques
Auteurs principaux: Peer, Hadar, Hernandez, Carlos, Koenig, Sven, Felner, Ariel, Salzman, Oren
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:https://arxiv.org/abs/2603.24084
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908912681222144
author Peer, Hadar
Hernandez, Carlos
Koenig, Sven
Felner, Ariel
Salzman, Oren
author_facet Peer, Hadar
Hernandez, Carlos
Koenig, Sven
Felner, Ariel
Salzman, Oren
contents Empirical evaluation in multi-objective search (MOS) has historically suffered from fragmentation, relying on heterogeneous problem instances with incompatible objective definitions that make cross-study comparisons difficult. This standardization gap is further exacerbated by the realization that DIMACS road networks, a historical default benchmark for the field, exhibit highly correlated objectives that fail to capture diverse Pareto-front structures. To address this, we introduce the first comprehensive, standardized benchmark suite for exact and approximate MOS. Our suite spans four structurally diverse domains: real-world road networks, structured synthetic graphs, game-based grid environments, and high-dimensional robotic motion-planning roadmaps. By providing fixed graph instances, standardized start-goal queries, and both exact and approximate reference Pareto-optimal solution sets, this suite captures a full spectrum of objective interactions: from strongly correlated to strictly independent. Ultimately, this benchmark provides a common foundation to ensure future MOS evaluations are robust, reproducible, and structurally comprehensive.
format Preprint
id arxiv_https___arxiv_org_abs_2603_24084
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Bridging the Evaluation Gap: Standardized Benchmarks for Multi-Objective Search
Peer, Hadar
Hernandez, Carlos
Koenig, Sven
Felner, Ariel
Salzman, Oren
Artificial Intelligence
Empirical evaluation in multi-objective search (MOS) has historically suffered from fragmentation, relying on heterogeneous problem instances with incompatible objective definitions that make cross-study comparisons difficult. This standardization gap is further exacerbated by the realization that DIMACS road networks, a historical default benchmark for the field, exhibit highly correlated objectives that fail to capture diverse Pareto-front structures. To address this, we introduce the first comprehensive, standardized benchmark suite for exact and approximate MOS. Our suite spans four structurally diverse domains: real-world road networks, structured synthetic graphs, game-based grid environments, and high-dimensional robotic motion-planning roadmaps. By providing fixed graph instances, standardized start-goal queries, and both exact and approximate reference Pareto-optimal solution sets, this suite captures a full spectrum of objective interactions: from strongly correlated to strictly independent. Ultimately, this benchmark provides a common foundation to ensure future MOS evaluations are robust, reproducible, and structurally comprehensive.
title Bridging the Evaluation Gap: Standardized Benchmarks for Multi-Objective Search
topic Artificial Intelligence
url https://arxiv.org/abs/2603.24084