Constraint acquisition needs better benchmarks

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Stachowiak, Rafał, Pawlak, Tomasz P.
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914602139254784
author Stachowiak, Rafał
Pawlak, Tomasz P.
author_facet Stachowiak, Rafał
Pawlak, Tomasz P.
contents Constraint Acquisition (CA) and related research on the validation and enhancement of Mathematical Programming (MP) models from domain knowledge artifacts are currently limited by inadequate benchmarks. This deficiency impedes reproducibility and cross-study comparability, slowing the maturation of CA methods. Existing benchmarks were designed for solver evaluation rather than for assessing CA algorithms. They are loosely organized, treat individual problems inconsistently, and omit the domain knowledge artifacts required by CA methods. This work presents MPMMine, a benchmark suite designed to assess algorithms that discover, validate, and enhance MP models using diverse domain knowledge artifacts. MPMMine is guided by consistency, standardization, completeness, extensibility, openness, and version control. It adopts a uniform structure and relies on open formats: MiniZinc, CommonMark, and JSON. It provides multiple models per problem, tens of instances per model, and thousands of solutions and non-solutions in both integer and continuous domains, alongside natural-language descriptions to support text-to-model methods.
format Preprint
id arxiv_https___arxiv_org_abs_2605_26279
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Constraint acquisition needs better benchmarks
Stachowiak, Rafał
Pawlak, Tomasz P.
Artificial Intelligence
Computational Engineering, Finance, and Science
90C90 (Primary), 90C05 (Secondary)
I.6.3; I.2.2; I.2.7
Constraint Acquisition (CA) and related research on the validation and enhancement of Mathematical Programming (MP) models from domain knowledge artifacts are currently limited by inadequate benchmarks. This deficiency impedes reproducibility and cross-study comparability, slowing the maturation of CA methods. Existing benchmarks were designed for solver evaluation rather than for assessing CA algorithms. They are loosely organized, treat individual problems inconsistently, and omit the domain knowledge artifacts required by CA methods. This work presents MPMMine, a benchmark suite designed to assess algorithms that discover, validate, and enhance MP models using diverse domain knowledge artifacts. MPMMine is guided by consistency, standardization, completeness, extensibility, openness, and version control. It adopts a uniform structure and relies on open formats: MiniZinc, CommonMark, and JSON. It provides multiple models per problem, tens of instances per model, and thousands of solutions and non-solutions in both integer and continuous domains, alongside natural-language descriptions to support text-to-model methods.
title Constraint acquisition needs better benchmarks
topic Artificial Intelligence
Computational Engineering, Finance, and Science
90C90 (Primary), 90C05 (Secondary)
I.6.3; I.2.2; I.2.7
url https://arxiv.org/abs/2605.26279