Constrained Machine Learning Through Hyperspherical Representation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Signorelli, Gaetano, Lombardi, Michele
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910909148954624
author Signorelli, Gaetano
Lombardi, Michele
author_facet Signorelli, Gaetano
Lombardi, Michele
contents The problem of ensuring constraints satisfaction on the output of machine learning models is critical for many applications, especially in safety-critical domains. Modern approaches rely on penalty-based methods at training time, which do not guarantee to avoid constraints violations; or constraint-specific model architectures (e.g., for monotonocity); or on output projection, which requires to solve an optimization problem that might be computationally demanding. We present the Hypersherical Constrained Representation, a novel method to enforce constraints in the output space for convex and bounded feasibility regions (generalizable to star domains). Our method operates on a different representation system, where Euclidean coordinates are converted into hyperspherical coordinates relative to the constrained region, which can only inherently represent feasible points. Experiments on a synthetic and a real-world dataset show that our method has predictive performance comparable to the other approaches, can guarantee 100% constraint satisfaction, and has a minimal computational cost at inference time.
format Preprint
id arxiv_https___arxiv_org_abs_2504_08415
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Constrained Machine Learning Through Hyperspherical Representation
Signorelli, Gaetano
Lombardi, Michele
Machine Learning
Artificial Intelligence
The problem of ensuring constraints satisfaction on the output of machine learning models is critical for many applications, especially in safety-critical domains. Modern approaches rely on penalty-based methods at training time, which do not guarantee to avoid constraints violations; or constraint-specific model architectures (e.g., for monotonocity); or on output projection, which requires to solve an optimization problem that might be computationally demanding. We present the Hypersherical Constrained Representation, a novel method to enforce constraints in the output space for convex and bounded feasibility regions (generalizable to star domains). Our method operates on a different representation system, where Euclidean coordinates are converted into hyperspherical coordinates relative to the constrained region, which can only inherently represent feasible points. Experiments on a synthetic and a real-world dataset show that our method has predictive performance comparable to the other approaches, can guarantee 100% constraint satisfaction, and has a minimal computational cost at inference time.
title Constrained Machine Learning Through Hyperspherical Representation
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2504.08415