Minimum Volume Conformal Sets for Multivariate Regression

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Braun, Sacha, Aolaritei, Liviu, Jordan, Michael I., Bach, Francis
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915872421969920
author Braun, Sacha
Aolaritei, Liviu
Jordan, Michael I.
Bach, Francis
author_facet Braun, Sacha
Aolaritei, Liviu
Jordan, Michael I.
Bach, Francis
contents Conformal prediction provides a principled framework for constructing predictive sets with finite-sample validity. While much of the focus has been on univariate response variables, existing multivariate methods either impose rigid geometric assumptions or rely on flexible but computationally expensive approaches that do not explicitly optimize prediction set volume. We propose an optimization-driven framework based on a novel loss function that directly learns minimum-volume covering sets while ensuring valid coverage. This formulation naturally induces a new nonconformity score for conformal prediction, which adapts to the residual distribution and covariates. Our approach optimizes over prediction sets defined by arbitrary norm balls, including single and multi-norm formulations. Additionally, by jointly optimizing both the predictive model and predictive uncertainty, we obtain prediction sets that are tight, informative, and computationally efficient, as demonstrated in our experiments on real-world datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2503_19068
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Minimum Volume Conformal Sets for Multivariate Regression
Braun, Sacha
Aolaritei, Liviu
Jordan, Michael I.
Bach, Francis
Machine Learning
Artificial Intelligence
Methodology
Other Statistics
Conformal prediction provides a principled framework for constructing predictive sets with finite-sample validity. While much of the focus has been on univariate response variables, existing multivariate methods either impose rigid geometric assumptions or rely on flexible but computationally expensive approaches that do not explicitly optimize prediction set volume. We propose an optimization-driven framework based on a novel loss function that directly learns minimum-volume covering sets while ensuring valid coverage. This formulation naturally induces a new nonconformity score for conformal prediction, which adapts to the residual distribution and covariates. Our approach optimizes over prediction sets defined by arbitrary norm balls, including single and multi-norm formulations. Additionally, by jointly optimizing both the predictive model and predictive uncertainty, we obtain prediction sets that are tight, informative, and computationally efficient, as demonstrated in our experiments on real-world datasets.
title Minimum Volume Conformal Sets for Multivariate Regression
topic Machine Learning
Artificial Intelligence
Methodology
Other Statistics
url https://arxiv.org/abs/2503.19068