Probabilistic Conformal Prediction with Approximate Conditional Validity
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912063708725248 |
|---|---|
| author | Plassier, Vincent Fishkov, Alexander Guizani, Mohsen Panov, Maxim Moulines, Eric |
| author_facet | Plassier, Vincent Fishkov, Alexander Guizani, Mohsen Panov, Maxim Moulines, Eric |
| contents | We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile regression and probabilistic conformal prediction, usually provide only a marginal coverage guarantee. In contrast, our approach extends these frameworks to achieve approximately conditional coverage, which is crucial for many practical applications. Our prediction sets adapt to the behavior of the predictive distribution, making them effective even under high heteroscedasticity. While exact conditional guarantees are infeasible without assumptions on the underlying data distribution, we derive non-asymptotic bounds that depend on the total variation distance of the conditional distribution and its estimate. Using extensive simulations, we show that our method consistently outperforms existing approaches in terms of conditional coverage, leading to more reliable statistical inference in a variety of applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_01794 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Probabilistic Conformal Prediction with Approximate Conditional Validity Plassier, Vincent Fishkov, Alexander Guizani, Mohsen Panov, Maxim Moulines, Eric Machine Learning Probability Statistics Theory Methodology We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile regression and probabilistic conformal prediction, usually provide only a marginal coverage guarantee. In contrast, our approach extends these frameworks to achieve approximately conditional coverage, which is crucial for many practical applications. Our prediction sets adapt to the behavior of the predictive distribution, making them effective even under high heteroscedasticity. While exact conditional guarantees are infeasible without assumptions on the underlying data distribution, we derive non-asymptotic bounds that depend on the total variation distance of the conditional distribution and its estimate. Using extensive simulations, we show that our method consistently outperforms existing approaches in terms of conditional coverage, leading to more reliable statistical inference in a variety of applications. |
| title | Probabilistic Conformal Prediction with Approximate Conditional Validity |
| topic | Machine Learning Probability Statistics Theory Methodology |
| url | https://arxiv.org/abs/2407.01794 |