Saved in:
Bibliographic Details
Main Authors: Güzel, Yusuf Berdan, Khare, Kushagra, Harvey, Nathan, Dsouza, Kian, Jang, Dong Hyeog, Chen, Junheng, Lam, Cheng Ze, Muñoz, Mario Andrés
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2501.16646
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916930447736832
author Güzel, Yusuf Berdan
Khare, Kushagra
Harvey, Nathan
Dsouza, Kian
Jang, Dong Hyeog
Chen, Junheng
Lam, Cheng Ze
Muñoz, Mario Andrés
author_facet Güzel, Yusuf Berdan
Khare, Kushagra
Harvey, Nathan
Dsouza, Kian
Jang, Dong Hyeog
Chen, Junheng
Lam, Cheng Ze
Muñoz, Mario Andrés
contents Instance Space Analysis is a methodology to evaluate algorithm performance across diverse problem fields. Through visualisation and exploratory data analysis techniques, Instance Space Analysis offers objective, data-driven insights into the diversity of test instances, algorithm behaviour, and algorithm strengths and weaknesses. As such, it supports automated algorithm selection and synthetic test instance generation, increasing testing reliability in optimisation, machine learning, and scheduling fields. This paper introduces instancespace, a Python package that implements an automated pipeline for Instance Space Analysis. This package supports research by streamlining the testing process, providing unbiased metrics, and facilitating more informed algorithmic design and deployment decisions, particularly for complex and safety-critical systems.
format Preprint
id arxiv_https___arxiv_org_abs_2501_16646
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle instancespace: a Python Package for Insightful Algorithm Testing through Instance Space Analysis
Güzel, Yusuf Berdan
Khare, Kushagra
Harvey, Nathan
Dsouza, Kian
Jang, Dong Hyeog
Chen, Junheng
Lam, Cheng Ze
Muñoz, Mario Andrés
Software Engineering
Instance Space Analysis is a methodology to evaluate algorithm performance across diverse problem fields. Through visualisation and exploratory data analysis techniques, Instance Space Analysis offers objective, data-driven insights into the diversity of test instances, algorithm behaviour, and algorithm strengths and weaknesses. As such, it supports automated algorithm selection and synthetic test instance generation, increasing testing reliability in optimisation, machine learning, and scheduling fields. This paper introduces instancespace, a Python package that implements an automated pipeline for Instance Space Analysis. This package supports research by streamlining the testing process, providing unbiased metrics, and facilitating more informed algorithmic design and deployment decisions, particularly for complex and safety-critical systems.
title instancespace: a Python Package for Insightful Algorithm Testing through Instance Space Analysis
topic Software Engineering
url https://arxiv.org/abs/2501.16646