Single Trajectory Conformal Prediction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lee, Brian, Matni, Nikolai
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910469783027712
author Lee, Brian
Matni, Nikolai
author_facet Lee, Brian
Matni, Nikolai
contents We study the performance of risk-controlling prediction sets (RCPS), an empirical risk minimization-based formulation of conformal prediction, with a single trajectory of temporally correlated data from an unknown stochastic dynamical system. First, we use the blocking technique to show that RCPS attains performance guarantees similar to those enjoyed in the iid setting whenever data is generated by asymptotically stationary and contractive dynamics. Next, we use the decoupling technique to characterize the graceful degradation in RCPS guarantees when the data generating process deviates from stationarity and contractivity. We conclude by discussing how these tools could be used toward a unified analysis of online and offline conformal prediction algorithms, which are currently treated with very different tools.
format Preprint
id arxiv_https___arxiv_org_abs_2406_01570
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Single Trajectory Conformal Prediction
Lee, Brian
Matni, Nikolai
Machine Learning
Systems and Control
We study the performance of risk-controlling prediction sets (RCPS), an empirical risk minimization-based formulation of conformal prediction, with a single trajectory of temporally correlated data from an unknown stochastic dynamical system. First, we use the blocking technique to show that RCPS attains performance guarantees similar to those enjoyed in the iid setting whenever data is generated by asymptotically stationary and contractive dynamics. Next, we use the decoupling technique to characterize the graceful degradation in RCPS guarantees when the data generating process deviates from stationarity and contractivity. We conclude by discussing how these tools could be used toward a unified analysis of online and offline conformal prediction algorithms, which are currently treated with very different tools.
title Single Trajectory Conformal Prediction
topic Machine Learning
Systems and Control
url https://arxiv.org/abs/2406.01570