Saved in:
Bibliographic Details
Main Authors: Guille-Escuret, Charles, Ndiaye, Eugene
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.15254
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910309877284864
author Guille-Escuret, Charles
Ndiaye, Eugene
author_facet Guille-Escuret, Charles
Ndiaye, Eugene
contents We explore a novel methodology for constructing confidence regions for parameters of linear models, using predictions from any arbitrary predictor. Our framework requires minimal assumptions on the noise and can be extended to functions deviating from strict linearity up to some adjustable threshold, thereby accommodating a comprehensive and pragmatically relevant set of functions. The derived confidence regions can be cast as constraints within a Mixed Integer Linear Programming framework, enabling optimisation of linear objectives. This representation enables robust optimization and the extraction of confidence intervals for specific parameter coordinates. Unlike previous methods, the confidence region can be empty, which can be used for hypothesis testing. Finally, we validate the empirical applicability of our method on synthetic data.
format Preprint
id arxiv_https___arxiv_org_abs_2401_15254
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Finite Sample Confidence Regions for Linear Regression Parameters Using Arbitrary Predictors
Guille-Escuret, Charles
Ndiaye, Eugene
Machine Learning
Statistics Theory
We explore a novel methodology for constructing confidence regions for parameters of linear models, using predictions from any arbitrary predictor. Our framework requires minimal assumptions on the noise and can be extended to functions deviating from strict linearity up to some adjustable threshold, thereby accommodating a comprehensive and pragmatically relevant set of functions. The derived confidence regions can be cast as constraints within a Mixed Integer Linear Programming framework, enabling optimisation of linear objectives. This representation enables robust optimization and the extraction of confidence intervals for specific parameter coordinates. Unlike previous methods, the confidence region can be empty, which can be used for hypothesis testing. Finally, we validate the empirical applicability of our method on synthetic data.
title Finite Sample Confidence Regions for Linear Regression Parameters Using Arbitrary Predictors
topic Machine Learning
Statistics Theory
url https://arxiv.org/abs/2401.15254